-- Logs begin at Wed 2021-10-27 14:19:37 UTC, end at Wed 2021-10-27 15:27:28 UTC. -- Oct 27 14:47:46.755555 dv-cinder-815673-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Oct 27 14:47:46.762698 dv-cinder-815673-1-iscsi devstack@keystone.service[65970]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 27 14:47:46.765402 dv-cinder-815673-1-iscsi devstack@keystone.service[65970]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 27 14:47:46 2021] *** Oct 27 14:47:46.765402 dv-cinder-815673-1-iscsi devstack@keystone.service[65970]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 27 14:47:46.765402 dv-cinder-815673-1-iscsi devstack@keystone.service[65970]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 27 14:47:46.765402 dv-cinder-815673-1-iscsi devstack@keystone.service[65970]: nodename: dv-cinder-815673-1-iscsi Oct 27 14:47:46.765402 dv-cinder-815673-1-iscsi devstack@keystone.service[65970]: machine: x86_64 Oct 27 14:47:46.765402 dv-cinder-815673-1-iscsi devstack@keystone.service[65970]: clock source: unix Oct 27 14:47:46.765402 dv-cinder-815673-1-iscsi devstack@keystone.service[65970]: pcre jit disabled Oct 27 14:47:46.765402 dv-cinder-815673-1-iscsi devstack@keystone.service[65970]: detected number of CPU cores: 4 Oct 27 14:47:46.765402 dv-cinder-815673-1-iscsi devstack@keystone.service[65970]: current working directory: / Oct 27 14:47:46.765402 dv-cinder-815673-1-iscsi devstack@keystone.service[65970]: detected binary path: /usr/bin/uwsgi-core Oct 27 14:47:46.766058 dv-cinder-815673-1-iscsi devstack@keystone.service[65970]: your processes number limit is 47680 Oct 27 14:47:46.766058 dv-cinder-815673-1-iscsi devstack@keystone.service[65970]: your memory page size is 4096 bytes Oct 27 14:47:46.766058 dv-cinder-815673-1-iscsi devstack@keystone.service[65970]: detected max file descriptor number: 2048 Oct 27 14:47:46.766058 dv-cinder-815673-1-iscsi devstack@keystone.service[65970]: lock engine: pthread robust mutexes Oct 27 14:47:46.766058 dv-cinder-815673-1-iscsi devstack@keystone.service[65970]: thunder lock: enabled Oct 27 14:47:46.766058 dv-cinder-815673-1-iscsi devstack@keystone.service[65970]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 27 14:47:46.766058 dv-cinder-815673-1-iscsi devstack@keystone.service[65970]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 27 14:47:46.806400 dv-cinder-815673-1-iscsi devstack@keystone.service[65970]: Python main interpreter initialized at 0x55f48f63d9c0 Oct 27 14:47:46.806400 dv-cinder-815673-1-iscsi devstack@keystone.service[65970]: python threads support enabled Oct 27 14:47:46.806400 dv-cinder-815673-1-iscsi devstack@keystone.service[65970]: your server socket listen backlog is limited to 100 connections Oct 27 14:47:46.806400 dv-cinder-815673-1-iscsi devstack@keystone.service[65970]: your mercy for graceful operations on workers is 90 seconds Oct 27 14:47:46.806803 dv-cinder-815673-1-iscsi devstack@keystone.service[65970]: mapped 403077 bytes (393 KB) for 2 cores Oct 27 14:47:46.806875 dv-cinder-815673-1-iscsi devstack@keystone.service[65970]: *** Operational MODE: preforking *** Oct 27 14:47:46.807113 dv-cinder-815673-1-iscsi devstack@keystone.service[65970]: *** uWSGI is running in multiple interpreter mode *** Oct 27 14:47:46.807113 dv-cinder-815673-1-iscsi devstack@keystone.service[65970]: spawned uWSGI master process (pid: 65970) Oct 27 14:47:46.807310 dv-cinder-815673-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Oct 27 14:47:46.811611 dv-cinder-815673-1-iscsi devstack@keystone.service[65970]: spawned uWSGI worker 1 (pid: 65984, cores: 1) Oct 27 14:47:46.811611 dv-cinder-815673-1-iscsi devstack@keystone.service[65970]: spawned uWSGI worker 2 (pid: 65985, cores: 1) Oct 27 14:47:46.811611 dv-cinder-815673-1-iscsi devstack@keystone.service[65970]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 27 14:47:49.573775 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 14:47:49.574316 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 14:47:49.574700 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 14:47:49.574784 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 14:47:49.574868 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] command line args: [] {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 14:47:49.574947 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] command line args: [] {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 14:47:49.575024 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 14:47:49.575024 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ================================================================================ {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 14:47:49.575162 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 14:47:49.575162 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ================================================================================ {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 14:47:49.575283 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] admin_token = **** {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.575365 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] admin_token = **** {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.575457 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] config_dir = [] {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.575457 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.575599 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] config_dir = [] {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.575674 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] config_source = [] {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.575751 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.575827 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] debug = True {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.575897 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] config_source = [] {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.575963 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.576193 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] debug = True {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.576193 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.576341 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.576406 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.576464 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] insecure_debug = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.576527 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] insecure_debug = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.576590 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.576659 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.576819 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.576895 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.577038 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] list_limit = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.577128 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] list_limit = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.577194 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] log_config_append = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.577258 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] log_config_append = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.577377 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.577482 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.577585 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] log_dir = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.577695 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] log_dir = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.577798 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] log_file = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.577905 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] log_file = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.578000 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.578100 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.578170 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.578283 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.578402 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.578530 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.578668 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.578767 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.578847 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.578930 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.579002 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.579127 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.579231 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.579317 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.579493 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.579576 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.579710 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.579787 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.579942 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.580064 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.580172 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.580252 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.580398 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.580490 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.580639 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.580722 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.580877 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] notification_format = cadf {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.581017 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] notification_format = cadf {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.581146 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.581229 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.581621 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.89/identity {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.581703 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.89/identity {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.581785 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] publish_errors = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.581857 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] publish_errors = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.582015 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.582138 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.582256 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.582368 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.582487 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.582600 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.582719 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.582844 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.582958 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.583076 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.583195 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] standard_threads = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.583308 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] standard_threads = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.583431 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] strict_password_check = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.583580 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] strict_password_check = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.583695 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.583865 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.583983 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] use_eventlog = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.584104 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] use_eventlog = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.584218 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] use_journal = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.584336 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] use_journal = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.584449 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] use_json = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.584567 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] use_json = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.584687 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] use_stderr = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.584812 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] use_stderr = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.584933 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] use_syslog = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.585046 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] use_syslog = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.585159 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] watch_log_file = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.585271 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] watch_log_file = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 14:47:49.585383 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.585506 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.585621 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.585740 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.585857 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.585978 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.586091 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.586213 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.586332 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.586453 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.586566 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.586678 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.586790 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.586911 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.587026 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.587145 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.587264 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.587383 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.587528 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.587651 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.587765 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.587882 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.587995 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.588101 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.588290 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.588665 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.588785 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.588905 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.589025 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.589140 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.589261 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.589375 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.589488 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.589600 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.589718 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.589838 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.589960 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.590074 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.590193 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.590307 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.590419 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.590531 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.590651 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.590766 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.590879 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.590991 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.591103 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.591217 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.591341 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.591471 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.591596 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.591711 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.591823 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.591942 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.592063 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.592184 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.592299 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.592412 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.592525 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.592644 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.592766 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.592886 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.593000 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.593113 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.593225 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.593339 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.593459 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.593573 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.593686 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.593799 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.593911 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.594029 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.594217 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.594343 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.594456 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.594569 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.594687 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.594801 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.594923 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.595038 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.595156 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.595275 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.595396 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.595534 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.595665 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.595781 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.595897 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.596010 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.596123 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.596235 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.596367 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.596491 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.596605 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.596717 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.596829 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.596949 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.597069 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.597183 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.597296 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.597408 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.597521 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.597644 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.597758 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.597875 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.597987 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.598100 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.598212 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.598333 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.598446 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.598560 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.598672 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.598784 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.598896 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] cache.enabled = True {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.599004 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] cache.enabled = True {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.599101 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.599197 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.599291 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.599291 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.599482 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.599600 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.599728 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.599834 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.599932 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.599932 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.600126 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.600126 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.600349 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.600463 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.600567 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.600679 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.600798 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.600910 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.601030 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.601153 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.601268 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.601392 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.601499 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.601623 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.601739 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.601865 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.601985 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.602091 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.602209 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.602323 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.602427 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.602547 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.602662 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.602773 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.602887 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.603000 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.603113 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.603234 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.603349 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.603524 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] auth.external = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.603642 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.603757 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] auth.mapped = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.603871 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] auth.external = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.603997 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.604104 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] auth.mapped = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.604206 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.604318 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.604432 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] auth.password = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.604545 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.604666 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] auth.token = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.604781 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] auth.password = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.604896 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.605010 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] auth.token = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.605129 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] catalog.caching = True {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.605244 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.605431 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.605555 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] catalog.caching = True {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.605670 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.605783 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.605907 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.606022 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.606143 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.606258 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.606372 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.606485 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.606605 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] credential.caching = True {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.606719 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.606841 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] credential.driver = sql {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.606957 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] credential.caching = True {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.607079 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.607200 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] credential.driver = sql {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.607321 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.607454 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.607583 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.607705 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.607820 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.608428 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.608547 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.608669 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.608784 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.608897 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.609020 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.609144 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.609260 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.609374 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.609487 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.609609 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.609725 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.609844 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.609959 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.610073 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.610187 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.610309 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.610430 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.610551 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.610666 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.610780 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.610893 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] federation.caching = True {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.611016 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.611138 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.611253 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] federation.caching = True {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.611367 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] federation.driver = sql {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.611533 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.611650 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.611776 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] federation.driver = sql {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.611892 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.612005 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.612149 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.612276 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.612392 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.612506 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.612622 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.612744 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.612860 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.612975 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.613096 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.613213 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.613328 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.613451 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.613567 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.613681 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.613795 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] identity.caching = True {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.613910 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.614024 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.614147 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] identity.caching = True {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.614271 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.614395 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.614516 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.614631 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.614746 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.614869 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.614986 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] identity.driver = sql {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.615099 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.615214 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.615329 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] identity.driver = sql {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.615466 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.615595 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.615711 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.615839 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.615956 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.616070 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.616193 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.616308 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.616424 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.616424 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.616639 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.616639 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.616862 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.616978 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.617092 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.617206 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.617320 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.617435 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.617600 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.617719 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.617834 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.617949 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.618071 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.618188 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.618311 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.618311 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.618528 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.618642 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.618756 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.618870 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.618992 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.619109 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.619223 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.619338 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.619472 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.619591 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.619781 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.619900 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.620015 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.620130 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.620314 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.620451 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.620575 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.620691 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.620805 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.620919 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.621039 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.621154 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.621276 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.621398 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.621513 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.621629 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.621743 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.621857 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.621979 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.622094 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.622208 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.622322 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.password = **** {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.622436 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.622550 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.622676 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.622792 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.622906 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.password = **** {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.623020 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.623133 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.623247 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.623369 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.623498 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.623614 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.624340 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.624454 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.624612 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.624742 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.624860 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.624975 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.625089 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.625210 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.625326 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.625449 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.625596 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.625715 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.625831 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.625949 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.626064 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.626187 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.626303 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.626418 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.626538 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.user = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.626678 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.626803 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.626929 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.627045 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.627161 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.user = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.627275 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.627395 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.627538 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.627666 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.627822 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.627938 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.628053 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.628167 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.628290 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.628405 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.628520 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.628634 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.628749 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.628869 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.628994 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.629110 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.629224 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.629338 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.629454 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.629568 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.629689 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.629806 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.629920 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.630035 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.630180 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.630297 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.630420 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.630536 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.630650 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.630765 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.630885 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.631007 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.631168 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.631283 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.631397 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.631527 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.631640 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.631784 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.631911 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.632029 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.632144 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.632258 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.632372 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.632486 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.632612 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.632729 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.632843 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.632964 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.633079 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] policy.driver = sql {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.633195 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.633317 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.633433 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.633547 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.633660 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] policy.driver = sql {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.633775 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.633889 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.634011 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] receipt.caching = True {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.634127 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.634243 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.634374 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.634492 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.634607 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] receipt.caching = True {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.634729 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.634858 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.634974 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.634974 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.635196 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.635312 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] resource.caching = True {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.635482 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.635482 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.635703 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.635818 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.635935 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] resource.driver = sql {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.636051 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] resource.caching = True {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.636178 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.636297 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.636418 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.636534 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] resource.driver = sql {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.636650 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.636650 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] revoke.caching = True {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.636873 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.636990 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.637104 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.637219 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.637334 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.637449 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] role.cache_time = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.637573 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] revoke.caching = True {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.637690 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] role.caching = True {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.637805 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.637919 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] role.driver = sql {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.638034 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.638148 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] role.list_limit = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.638271 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] role.cache_time = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.638389 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.638510 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] role.caching = True {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.638626 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.638742 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] role.driver = sql {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.638856 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.638980 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] role.list_limit = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.639096 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.639232 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.639349 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.639483 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.639612 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.639737 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.639854 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.639969 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.640084 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.640199 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.640322 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.640438 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.640554 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.640668 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.640782 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.640897 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.641020 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.641137 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.641252 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.641366 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.641366 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.641582 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.641705 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.641821 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.641936 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.642051 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.642051 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.642265 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.642388 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.642504 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.642621 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.642736 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.642850 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.642965 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.643155 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.643274 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.643389 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.643518 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.643635 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.643749 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.643876 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.643993 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.644108 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.644223 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.644337 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.644452 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.644575 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.644693 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.644814 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.644929 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.645042 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.645157 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.645279 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.645396 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.645510 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.645623 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.645738 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] token.cache_time = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.645861 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.645980 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] token.caching = True {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.646095 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.646209 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.646323 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.646437 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] token.provider = fernet {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.646560 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] token.cache_time = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.646676 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.646792 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] token.caching = True {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.646906 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.647020 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.647134 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.647256 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] token.provider = fernet {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.647372 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.647550 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.647668 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.647784 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.647898 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.648025 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.648142 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] trust.driver = sql {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.648257 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.648371 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.648486 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.648600 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.648722 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.648839 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.648953 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] trust.driver = sql {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.649068 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.649183 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.649297 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.649420 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.649536 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.649650 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.649765 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.649880 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.649994 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.650118 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.650233 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] database.connection = **** {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.650348 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.650462 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.650576 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.650691 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.650813 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.650930 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.651044 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] database.connection = **** {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.651159 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.651273 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.651387 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.651526 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.651644 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.651758 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.651872 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.651987 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.652102 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.652224 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.652340 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.652455 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.652570 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.652684 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.652798 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.652921 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.653038 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.653153 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.653267 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.653381 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.653496 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.653618 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.653734 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.653849 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.653963 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.654078 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.654192 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.654314 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.654431 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.654431 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=65985) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 14:47:49.654646 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.654646 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.654646 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.654646 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 14:47:49.654646 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=65984) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 14:47:49.678481 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=65985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.678710 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=65985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.678933 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=65985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.679261 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=65984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.679524 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=65984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.679752 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=65984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.688759 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=65985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.689656 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=65984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.716706 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=65985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.716932 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=65985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.717459 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=65984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.717687 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=65984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.770932 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=65985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.771506 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=65984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.820465 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=65985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.820700 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=65985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.821797 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=65984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.822033 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=65984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.884783 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=65985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.884954 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=65985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.885174 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=65985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.885266 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=65984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.885391 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=65985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.885475 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=65984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.885603 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=65985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.885687 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=65984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.885811 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=65985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.885907 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=65984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.886024 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=65984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.886237 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=65984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.910387 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=65985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.910619 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=65985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.910717 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=65984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.910837 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=65985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.910921 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=65984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.911051 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=65985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.911134 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=65984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.911261 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=65985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.911346 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=65984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.911491 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=65985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.911579 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=65984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.911704 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=65985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.911786 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=65984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.911930 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=65984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.923724 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=65985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.924046 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=65984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.936189 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=65985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.936416 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=65985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.936583 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=65984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.936664 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=65985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.936765 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=65984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.936850 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=65985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.936990 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=65984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.937082 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=65985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.937210 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=65984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.937293 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=65985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.937427 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=65984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.937509 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=65985) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.937641 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=65984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.937852 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=65984) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 14:47:49.954211 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.954420 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 27 14:47:49.954503 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.954647 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 27 14:47:49.954742 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.954927 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 27 14:47:49.955009 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.955164 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 27 14:47:49.955246 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.955425 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.955541 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.955700 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.955784 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.955947 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.956028 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.956198 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.966131 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.966401 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.966484 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.966662 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.966745 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.966929 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.967014 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.967211 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.975308 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=65985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:49.975677 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=65984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:49.978417 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=65985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:49.978689 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.978771 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=65984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:49.978959 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.979042 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.979230 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.979313 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.979534 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.979619 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.979787 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.979880 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.980045 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.980127 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.980306 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.980387 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.980565 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.980654 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.980823 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.980903 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.981076 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.981156 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:49.981332 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.006856 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.007136 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.008406 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=65985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:50.008676 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.008772 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=65984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:50.008949 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.013649 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=65985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:50.013930 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=65984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:50.014014 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.014315 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.014409 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.014602 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.021231 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=65985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:50.021502 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.021585 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=65984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:50.021809 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.025729 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=65985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:50.026005 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.026106 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=65984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:50.026279 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.026373 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.026552 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.026634 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.026817 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.026898 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.027078 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.027166 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.027337 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.027418 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.027619 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.027701 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.027880 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.046713 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.046983 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.047066 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.047321 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.051330 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=65985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:50.051852 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=65984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:50.054918 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.055204 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.055403 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.055718 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.060012 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=65985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:50.060540 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=65984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:50.063528 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=65985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:50.064053 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=65984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:50.067131 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.067420 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.067707 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.067790 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.067977 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.068071 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.068242 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.068325 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.068509 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.068592 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.068788 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.069076 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.086841 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=65985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:50.087116 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.087375 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.087478 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=65984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:50.087655 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.087739 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.087982 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.088244 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.095633 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.096271 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.097345 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.097613 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.097994 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.098261 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.100485 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=65985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:50.100758 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.101045 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.101163 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=65984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:50.101315 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.101434 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.101579 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.101725 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.101996 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.102265 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.114937 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=65985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:50.115209 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.115504 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.115624 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=65984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:50.115788 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.115897 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.116059 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.116152 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.116325 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.116600 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.116680 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.116874 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.117144 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.117420 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.133626 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=65985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:50.134497 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=65984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:50.137806 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=65985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:50.138665 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=65984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:50.141458 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.142371 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.142960 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.143930 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.144512 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=65985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:50.144783 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.145054 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.145473 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=65984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:50.145745 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.146016 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.221357 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.221824 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.222914 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=65985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:50.223383 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=65984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:50.226045 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.226327 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.226471 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.226607 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.226740 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.226874 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.227007 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.227235 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.235721 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=65985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:50.236002 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.236145 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=65984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:50.236279 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.236425 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.236647 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.243809 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=65985) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:50.244082 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.244250 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=65984) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 14:47:50.244402 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.244540 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.244684 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.244818 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.244951 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.245119 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.245265 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.245400 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.245533 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.245674 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.245808 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.245949 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.246083 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.246227 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.246368 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.246502 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.246636 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.246777 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.246911 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.247044 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.247176 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.247308 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.247477 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=65985) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.247630 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.247776 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=65984) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 14:47:50.284190 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WSGI app 0 (mountpoint='') ready in 4 seconds on interpreter 0x55f48f63d9c0 pid: 65985 (default app) Oct 27 14:47:50.284991 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WSGI app 0 (mountpoint='') ready in 4 seconds on interpreter 0x55f48f63d9c0 pid: 65984 (default app) Oct 27 14:47:50.287404 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0689d4-84ec-4966-b510-15d6b3213252 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:47:50.287726 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0689d4-84ec-4966-b510-15d6b3213252 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:47:50.288017 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0689d4-84ec-4966-b510-15d6b3213252 None None] PATH_INFO: `/v3` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:47:50.292304 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1/1] 10.222.0.89 () {50 vars in 791 bytes} [Wed Oct 27 14:47:50 2021] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:47:55.599168 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0334d8-ae87-45c2-b0c3-f20a3a6d8618 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:47:55.599679 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0334d8-ae87-45c2-b0c3-f20a3a6d8618 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:47:55.599679 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0334d8-ae87-45c2-b0c3-f20a3a6d8618 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:47:55.604484 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1/2] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:47:55 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 14:47:55.610131 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0937f38-fde4-4e69-9fa5-bb16d31bb5e9 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:47:55.610555 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0937f38-fde4-4e69-9fa5-bb16d31bb5e9 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:47:55.610698 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0937f38-fde4-4e69-9fa5-bb16d31bb5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:47:55.650229 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG oslo_db.sqlalchemy.engines [None req-a0937f38-fde4-4e69-9fa5-bb16d31bb5e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65985) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Oct 27 14:47:55.798642 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG passlib.handlers.bcrypt [None req-a0937f38-fde4-4e69-9fa5-bb16d31bb5e9 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=65985) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:567}} Oct 27 14:47:55.799043 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG passlib.handlers.bcrypt [None req-a0937f38-fde4-4e69-9fa5-bb16d31bb5e9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=65985) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:382}} Oct 27 14:47:55.859249 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-a0937f38-fde4-4e69-9fa5-bb16d31bb5e9 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:47:55.860776 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-a0937f38-fde4-4e69-9fa5-bb16d31bb5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:47:55.961121 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 2/3] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:47:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:47:56.123289 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0334d8-ae87-45c2-b0c3-f20a3a6d8618 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:47:56.165942 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG oslo_db.sqlalchemy.engines [None req-ff0334d8-ae87-45c2-b0c3-f20a3a6d8618 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=65984) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:304}} Oct 27 14:47:56.265981 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0334d8-ae87-45c2-b0c3-f20a3a6d8618 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:47:56.269820 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900c3d0-7ddf-4317-b024-54d0447d2f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:47:56.270410 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900c3d0-7ddf-4317-b024-54d0447d2f0b admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:47:56.270699 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900c3d0-7ddf-4317-b024-54d0447d2f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:47:56.270978 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900c3d0-7ddf-4317-b024-54d0447d2f0b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:47:56.279075 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900c3d0-7ddf-4317-b024-54d0447d2f0b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:47:56.310217 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f900c3d0-7ddf-4317-b024-54d0447d2f0b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 27 14:47:56.310554 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900c3d0-7ddf-4317-b024-54d0447d2f0b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:47:56.319323 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 2/4] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:47:56 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:47:56.325471 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0937f38-fde4-4e69-9fa5-bb16d31bb5e9 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:47:56.337171 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0937f38-fde4-4e69-9fa5-bb16d31bb5e9 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:47:56.341210 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a332c64-661a-4c9b-b672-b299d5a59ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:47:56.342031 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a332c64-661a-4c9b-b672-b299d5a59ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:47:56.342974 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a332c64-661a-4c9b-b672-b299d5a59ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:47:56.343262 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a332c64-661a-4c9b-b672-b299d5a59ef6 admin admin] PATH_INFO: `/v3/projects/788e6d12550a446aa50a0962b825388d` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:47:56.344541 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a332c64-661a-4c9b-b672-b299d5a59ef6 admin admin] RBAC: Authorizing `identity:get_project(project_id=788e6d12550a446aa50a0962b825388d)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:47:56.375651 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6a332c64-661a-4c9b-b672-b299d5a59ef6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 27 14:47:56.375940 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a332c64-661a-4c9b-b672-b299d5a59ef6 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:47:56.380293 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 3/5] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:47:56 2021] GET /identity/v3/projects/788e6d12550a446aa50a0962b825388d => generated 344 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:47:58.317736 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ae7a0-4fed-42f5-a00f-06418252cab2 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:47:58.318201 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ae7a0-4fed-42f5-a00f-06418252cab2 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:47:58.318304 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ae7a0-4fed-42f5-a00f-06418252cab2 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:47:58.322671 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 3/6] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:47:58 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 14:47:58.328767 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ef2dc-3464-497e-9d42-445226ac9645 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:47:58.329183 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ef2dc-3464-497e-9d42-445226ac9645 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:47:58.329322 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ef2dc-3464-497e-9d42-445226ac9645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:47:58.351870 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-cb6ef2dc-3464-497e-9d42-445226ac9645 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:47:58.353339 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-cb6ef2dc-3464-497e-9d42-445226ac9645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:47:58.360215 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 4/7] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:47:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:47:58.381872 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ae7a0-4fed-42f5-a00f-06418252cab2 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:47:58.393606 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ae7a0-4fed-42f5-a00f-06418252cab2 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:47:58.397336 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77998c-1689-4ed4-9668-d32a31bfbaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:47:58.397898 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77998c-1689-4ed4-9668-d32a31bfbaaf admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:47:58.398185 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77998c-1689-4ed4-9668-d32a31bfbaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:47:58.398463 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77998c-1689-4ed4-9668-d32a31bfbaaf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:47:58.407341 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c77998c-1689-4ed4-9668-d32a31bfbaaf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:47:58.434814 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c77998c-1689-4ed4-9668-d32a31bfbaaf admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:47:58.443793 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 4/8] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:47:58 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:47:58.449222 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ef2dc-3464-497e-9d42-445226ac9645 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:47:58.457940 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ef2dc-3464-497e-9d42-445226ac9645 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:47:58.461869 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ce4da-e55b-49c9-b7fd-cea3e004c86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:47:58.462666 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ce4da-e55b-49c9-b7fd-cea3e004c86f admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:47:58.462959 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ce4da-e55b-49c9-b7fd-cea3e004c86f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:47:58.463241 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ce4da-e55b-49c9-b7fd-cea3e004c86f admin admin] PATH_INFO: `/v3/users/99b1f8461d2e454c9cd6d6d3c9dc623c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:47:58.464522 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ce4da-e55b-49c9-b7fd-cea3e004c86f admin admin] RBAC: Authorizing `identity:get_user(user_id=99b1f8461d2e454c9cd6d6d3c9dc623c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:47:58.492000 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ce4da-e55b-49c9-b7fd-cea3e004c86f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:47:58.493418 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 5/9] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:47:58 2021] GET /identity/v3/users/99b1f8461d2e454c9cd6d6d3c9dc623c => generated 247 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:00.436669 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e671d-699c-4ee9-87b4-313e8a6e784e None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:00.437218 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e671d-699c-4ee9-87b4-313e8a6e784e None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:00.437218 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e671d-699c-4ee9-87b4-313e8a6e784e None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:00.438904 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 5/10] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:48:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:48:00.443858 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc32ce-a8b4-4d6a-a860-47100e294d0d None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:00.444263 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc32ce-a8b4-4d6a-a860-47100e294d0d None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:00.444439 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc32ce-a8b4-4d6a-a860-47100e294d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:00.466581 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-6cbc32ce-a8b4-4d6a-a860-47100e294d0d None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:48:00.467752 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-6cbc32ce-a8b4-4d6a-a860-47100e294d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:48:00.474304 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 6/11] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:48:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:48:00.496183 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e671d-699c-4ee9-87b4-313e8a6e784e None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:00.507840 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e671d-699c-4ee9-87b4-313e8a6e784e None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:00.511676 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760999aa-d64e-4587-a8a2-b7f50f723b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:00.512326 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760999aa-d64e-4587-a8a2-b7f50f723b23 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:00.512617 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760999aa-d64e-4587-a8a2-b7f50f723b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:00.512902 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760999aa-d64e-4587-a8a2-b7f50f723b23 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:00.526133 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760999aa-d64e-4587-a8a2-b7f50f723b23 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:48:00.532400 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-760999aa-d64e-4587-a8a2-b7f50f723b23 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 14:48:00.533488 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 6/12] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:48:00 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 14:48:00.538804 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc32ce-a8b4-4d6a-a860-47100e294d0d None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:00.547494 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc32ce-a8b4-4d6a-a860-47100e294d0d None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:00.551363 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31451742-417c-4abd-9565-9fa7eea56a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:00.551987 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31451742-417c-4abd-9565-9fa7eea56a27 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:00.552282 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31451742-417c-4abd-9565-9fa7eea56a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:00.552569 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31451742-417c-4abd-9565-9fa7eea56a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:00.553283 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31451742-417c-4abd-9565-9fa7eea56a27 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:48:00.553586 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31451742-417c-4abd-9565-9fa7eea56a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:00.579237 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING py.warnings [None req-31451742-417c-4abd-9565-9fa7eea56a27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:48:00.579237 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: warnings.warn(msg) Oct 27 14:48:00.579237 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: Oct 27 14:48:00.580179 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31451742-417c-4abd-9565-9fa7eea56a27 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:00.591141 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 7/13] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:48:00 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:00.596346 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760999aa-d64e-4587-a8a2-b7f50f723b23 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:00.605734 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760999aa-d64e-4587-a8a2-b7f50f723b23 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:00.609610 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3d4ef-3604-4890-a289-7a6aecd2b9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:00.610376 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3d4ef-3604-4890-a289-7a6aecd2b9d8 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:00.610664 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3d4ef-3604-4890-a289-7a6aecd2b9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:00.610945 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3d4ef-3604-4890-a289-7a6aecd2b9d8 admin admin] PATH_INFO: `/v3/users/99b1f8461d2e454c9cd6d6d3c9dc623c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:00.612432 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3d4ef-3604-4890-a289-7a6aecd2b9d8 admin admin] RBAC: Authorizing `identity:get_user(user_id=99b1f8461d2e454c9cd6d6d3c9dc623c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:00.637344 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a3d4ef-3604-4890-a289-7a6aecd2b9d8 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:00.638788 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 7/14] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:48:00 2021] GET /identity/v3/users/99b1f8461d2e454c9cd6d6d3c9dc623c => generated 247 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:00.644563 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31451742-417c-4abd-9565-9fa7eea56a27 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:00.653842 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31451742-417c-4abd-9565-9fa7eea56a27 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:00.657757 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8490e-1334-43fd-a5a2-23853a5c68af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:00.658466 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8490e-1334-43fd-a5a2-23853a5c68af admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:00.658759 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8490e-1334-43fd-a5a2-23853a5c68af admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:00.659041 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8490e-1334-43fd-a5a2-23853a5c68af admin admin] PATH_INFO: `/v3/domains/default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:00.660128 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8490e-1334-43fd-a5a2-23853a5c68af admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:00.685545 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8490e-1334-43fd-a5a2-23853a5c68af admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:00.687566 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 8/15] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:48:00 2021] GET /identity/v3/domains/default => generated 199 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:00.693146 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3d4ef-3604-4890-a289-7a6aecd2b9d8 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:00.702308 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3d4ef-3604-4890-a289-7a6aecd2b9d8 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:00.706230 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb2791-be8f-4e9c-b8d8-49ae39421b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:00.706799 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb2791-be8f-4e9c-b8d8-49ae39421b93 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:00.707091 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb2791-be8f-4e9c-b8d8-49ae39421b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:00.707374 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb2791-be8f-4e9c-b8d8-49ae39421b93 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:00.708180 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb2791-be8f-4e9c-b8d8-49ae39421b93 admin admin] RBAC: Adding query filter params (role.id=c243fbeb99ae4f51910f72ddc1773778, scope.domain.id=default, user.id=99b1f8461d2e454c9cd6d6d3c9dc623c) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:48:00.708483 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb2791-be8f-4e9c-b8d8-49ae39421b93 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:00.733379 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING py.warnings [None req-41eb2791-be8f-4e9c-b8d8-49ae39421b93 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:48:00.733379 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: warnings.warn(msg) Oct 27 14:48:00.733379 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: Oct 27 14:48:00.734543 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb2791-be8f-4e9c-b8d8-49ae39421b93 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:00.741118 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 8/16] 10.222.0.89 () {56 vars in 1343 bytes} [Wed Oct 27 14:48:00 2021] GET /identity/v3/role_assignments?user.id=99b1f8461d2e454c9cd6d6d3c9dc623c&scope.domain.id=default&role.id=c243fbeb99ae4f51910f72ddc1773778 => generated 233 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:02.667153 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a744ae-9410-4697-b5dc-82c48b26d9f6 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:02.667671 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a744ae-9410-4697-b5dc-82c48b26d9f6 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:02.667768 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a744ae-9410-4697-b5dc-82c48b26d9f6 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:02.669671 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 9/17] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:48:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:48:02.675406 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939fea3-8a84-4445-a3c3-0990231a8b0f None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:02.675851 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939fea3-8a84-4445-a3c3-0990231a8b0f None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:02.676054 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939fea3-8a84-4445-a3c3-0990231a8b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:02.709788 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG passlib.handlers.bcrypt [None req-3939fea3-8a84-4445-a3c3-0990231a8b0f None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=65984) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:567}} Oct 27 14:48:02.710225 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG passlib.handlers.bcrypt [None req-3939fea3-8a84-4445-a3c3-0990231a8b0f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=65984) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:382}} Oct 27 14:48:02.756777 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-3939fea3-8a84-4445-a3c3-0990231a8b0f None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:48:02.758393 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-3939fea3-8a84-4445-a3c3-0990231a8b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:48:02.765515 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 9/18] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:48:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:48:02.787384 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a744ae-9410-4697-b5dc-82c48b26d9f6 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:02.799657 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a744ae-9410-4697-b5dc-82c48b26d9f6 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:02.803409 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403f25d-7bc9-459c-99ee-47f673df9e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:02.804136 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403f25d-7bc9-459c-99ee-47f673df9e4c admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:02.804431 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403f25d-7bc9-459c-99ee-47f673df9e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:02.804712 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403f25d-7bc9-459c-99ee-47f673df9e4c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:02.815799 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403f25d-7bc9-459c-99ee-47f673df9e4c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:48:02.822030 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-7403f25d-7bc9-459c-99ee-47f673df9e4c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 14:48:02.823116 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 10/19] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:48:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:48:02.828568 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939fea3-8a84-4445-a3c3-0990231a8b0f None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:02.837045 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939fea3-8a84-4445-a3c3-0990231a8b0f None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:02.841105 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d53114-66b8-44e5-8a5e-ccd7d0154c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:02.841692 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d53114-66b8-44e5-8a5e-ccd7d0154c0c admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:02.841984 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d53114-66b8-44e5-8a5e-ccd7d0154c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:02.842782 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d53114-66b8-44e5-8a5e-ccd7d0154c0c admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:02.843515 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d53114-66b8-44e5-8a5e-ccd7d0154c0c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:48:02.843838 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d53114-66b8-44e5-8a5e-ccd7d0154c0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:02.869765 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING py.warnings [None req-e3d53114-66b8-44e5-8a5e-ccd7d0154c0c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:48:02.869765 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: warnings.warn(msg) Oct 27 14:48:02.869765 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: Oct 27 14:48:02.870701 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d53114-66b8-44e5-8a5e-ccd7d0154c0c admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:02.880477 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 10/20] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:48:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:02.885539 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403f25d-7bc9-459c-99ee-47f673df9e4c admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:02.895903 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403f25d-7bc9-459c-99ee-47f673df9e4c admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:02.899844 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887806c-adf1-4be3-828d-b234d6a13d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:02.900618 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887806c-adf1-4be3-828d-b234d6a13d0e admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:02.900909 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887806c-adf1-4be3-828d-b234d6a13d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:02.901193 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2887806c-adf1-4be3-828d-b234d6a13d0e admin admin] PATH_INFO: `/v3/users/99b1f8461d2e454c9cd6d6d3c9dc623c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:02.902287 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887806c-adf1-4be3-828d-b234d6a13d0e admin admin] RBAC: Authorizing `identity:get_user(user_id=99b1f8461d2e454c9cd6d6d3c9dc623c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:02.928130 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2887806c-adf1-4be3-828d-b234d6a13d0e admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:02.929490 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 11/21] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:48:02 2021] GET /identity/v3/users/99b1f8461d2e454c9cd6d6d3c9dc623c => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:02.934259 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d53114-66b8-44e5-8a5e-ccd7d0154c0c admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:02.943242 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d53114-66b8-44e5-8a5e-ccd7d0154c0c admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:02.947175 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1e0afe-b96c-4040-abba-4cb28aa87f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:02.947905 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e0afe-b96c-4040-abba-4cb28aa87f5c admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:02.948195 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e0afe-b96c-4040-abba-4cb28aa87f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:02.948475 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1e0afe-b96c-4040-abba-4cb28aa87f5c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:02.949546 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e0afe-b96c-4040-abba-4cb28aa87f5c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:02.975219 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1e0afe-b96c-4040-abba-4cb28aa87f5c admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:02.976618 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 11/22] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:48:02 2021] GET /identity/v3/domains/default => generated 199 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:48:02.981379 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887806c-adf1-4be3-828d-b234d6a13d0e admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:02.990353 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2887806c-adf1-4be3-828d-b234d6a13d0e admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:02.994272 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406648cd-b59b-4270-b30a-71892bda0839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:02.995033 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406648cd-b59b-4270-b30a-71892bda0839 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:02.995324 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406648cd-b59b-4270-b30a-71892bda0839 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:02.995651 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406648cd-b59b-4270-b30a-71892bda0839 admin admin] PATH_INFO: `/v3/domains/default/users/99b1f8461d2e454c9cd6d6d3c9dc623c/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:02.997421 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406648cd-b59b-4270-b30a-71892bda0839 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=99b1f8461d2e454c9cd6d6d3c9dc623c, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:03.022166 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING py.warnings [None req-406648cd-b59b-4270-b30a-71892bda0839 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:48:03.022166 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: warnings.warn(msg) Oct 27 14:48:03.022166 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: Oct 27 14:48:03.024191 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406648cd-b59b-4270-b30a-71892bda0839 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:03.217045 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 12/23] 10.222.0.89 () {58 vars in 1382 bytes} [Wed Oct 27 14:48:02 2021] PUT /identity/v3/domains/default/users/99b1f8461d2e454c9cd6d6d3c9dc623c/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:48:05.144749 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f2701-6d71-4271-8646-a368aa5bc635 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:05.145291 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f2701-6d71-4271-8646-a368aa5bc635 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:05.145291 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f2701-6d71-4271-8646-a368aa5bc635 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:05.147024 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 12/24] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:48:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:48:05.152954 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee5934-30e5-4322-91f5-d6c7f66a0f75 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:05.153343 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee5934-30e5-4322-91f5-d6c7f66a0f75 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:05.153528 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee5934-30e5-4322-91f5-d6c7f66a0f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:05.177394 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-b5ee5934-30e5-4322-91f5-d6c7f66a0f75 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:48:05.178893 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-b5ee5934-30e5-4322-91f5-d6c7f66a0f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:48:05.240651 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 13/25] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:48:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:48:05.262866 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f2701-6d71-4271-8646-a368aa5bc635 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:05.274323 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4f2701-6d71-4271-8646-a368aa5bc635 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:05.278084 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6a838-bfb9-4781-af6d-4c85734b3ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:05.278794 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6a838-bfb9-4781-af6d-4c85734b3ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:05.279082 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6a838-bfb9-4781-af6d-4c85734b3ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:05.279363 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6a838-bfb9-4781-af6d-4c85734b3ee9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:05.291175 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6a838-bfb9-4781-af6d-4c85734b3ee9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:48:05.297874 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-b5e6a838-bfb9-4781-af6d-4c85734b3ee9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 14:48:05.298935 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 13/26] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:48:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 14:48:05.304301 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee5934-30e5-4322-91f5-d6c7f66a0f75 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:05.313532 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee5934-30e5-4322-91f5-d6c7f66a0f75 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:05.317470 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f052fd9-eeb6-471f-a2a6-e7a47f28e95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:05.318065 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f052fd9-eeb6-471f-a2a6-e7a47f28e95d admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:05.318361 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f052fd9-eeb6-471f-a2a6-e7a47f28e95d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:05.318648 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f052fd9-eeb6-471f-a2a6-e7a47f28e95d admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:05.319363 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f052fd9-eeb6-471f-a2a6-e7a47f28e95d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:48:05.319695 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f052fd9-eeb6-471f-a2a6-e7a47f28e95d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:05.344906 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f052fd9-eeb6-471f-a2a6-e7a47f28e95d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:05.356108 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 14/27] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:48:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:05.361884 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6a838-bfb9-4781-af6d-4c85734b3ee9 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:05.370986 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6a838-bfb9-4781-af6d-4c85734b3ee9 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:05.375563 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a15afc-9ed9-4a94-9105-ff9cf1b662f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:05.376328 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a15afc-9ed9-4a94-9105-ff9cf1b662f2 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:05.376613 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a15afc-9ed9-4a94-9105-ff9cf1b662f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:05.376890 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a15afc-9ed9-4a94-9105-ff9cf1b662f2 admin admin] PATH_INFO: `/v3/users/99b1f8461d2e454c9cd6d6d3c9dc623c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:05.377985 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a15afc-9ed9-4a94-9105-ff9cf1b662f2 admin admin] RBAC: Authorizing `identity:get_user(user_id=99b1f8461d2e454c9cd6d6d3c9dc623c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:05.402560 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a15afc-9ed9-4a94-9105-ff9cf1b662f2 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:05.403990 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 14/28] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:48:05 2021] GET /identity/v3/users/99b1f8461d2e454c9cd6d6d3c9dc623c => generated 247 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:05.408786 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f052fd9-eeb6-471f-a2a6-e7a47f28e95d admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:05.417987 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f052fd9-eeb6-471f-a2a6-e7a47f28e95d admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:05.422638 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c865831-b80c-46cc-8ab1-7b1890cf8e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:05.423511 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c865831-b80c-46cc-8ab1-7b1890cf8e84 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:05.423888 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c865831-b80c-46cc-8ab1-7b1890cf8e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:05.424178 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c865831-b80c-46cc-8ab1-7b1890cf8e84 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:05.425420 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c865831-b80c-46cc-8ab1-7b1890cf8e84 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:05.450941 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c865831-b80c-46cc-8ab1-7b1890cf8e84 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:05.452939 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 15/29] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:48:05 2021] GET /identity/v3/domains/default => generated 199 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:48:05.458253 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a15afc-9ed9-4a94-9105-ff9cf1b662f2 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:05.467399 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a15afc-9ed9-4a94-9105-ff9cf1b662f2 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:05.471963 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8becf23a-06e2-4ea0-9ca7-96cb999c8f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:05.472533 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becf23a-06e2-4ea0-9ca7-96cb999c8f6c admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:05.472826 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becf23a-06e2-4ea0-9ca7-96cb999c8f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:05.473109 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becf23a-06e2-4ea0-9ca7-96cb999c8f6c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:05.473920 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8becf23a-06e2-4ea0-9ca7-96cb999c8f6c admin admin] RBAC: Adding query filter params (role.id=c243fbeb99ae4f51910f72ddc1773778, scope.domain.id=default, user.id=99b1f8461d2e454c9cd6d6d3c9dc623c) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:48:05.474229 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8becf23a-06e2-4ea0-9ca7-96cb999c8f6c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:05.499308 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8becf23a-06e2-4ea0-9ca7-96cb999c8f6c admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:05.504937 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 15/30] 10.222.0.89 () {56 vars in 1343 bytes} [Wed Oct 27 14:48:05 2021] GET /identity/v3/role_assignments?user.id=99b1f8461d2e454c9cd6d6d3c9dc623c&scope.domain.id=default&role.id=c243fbeb99ae4f51910f72ddc1773778 => generated 530 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:07.475042 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b253101-870f-47cb-9996-fec416d1e2ba None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:07.475592 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b253101-870f-47cb-9996-fec416d1e2ba None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:07.475677 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b253101-870f-47cb-9996-fec416d1e2ba None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:07.477321 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 16/31] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:48:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:48:07.482397 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a30632-055f-4dc2-a198-df6e070ccd0c None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:07.482769 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a30632-055f-4dc2-a198-df6e070ccd0c None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:07.482968 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a30632-055f-4dc2-a198-df6e070ccd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:07.506179 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-59a30632-055f-4dc2-a198-df6e070ccd0c None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:48:07.507268 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-59a30632-055f-4dc2-a198-df6e070ccd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:48:07.513811 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 16/32] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:48:07 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:48:07.534408 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b253101-870f-47cb-9996-fec416d1e2ba None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:07.546612 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b253101-870f-47cb-9996-fec416d1e2ba None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:07.550437 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee54e42-a35e-4b78-a916-d450ce61154e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:07.551003 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee54e42-a35e-4b78-a916-d450ce61154e admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:07.551297 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee54e42-a35e-4b78-a916-d450ce61154e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:07.551618 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee54e42-a35e-4b78-a916-d450ce61154e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:07.559109 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee54e42-a35e-4b78-a916-d450ce61154e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:07.585210 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee54e42-a35e-4b78-a916-d450ce61154e admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:07.594146 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 17/33] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:48:07 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:48:07.599158 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a30632-055f-4dc2-a198-df6e070ccd0c None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:07.607522 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a30632-055f-4dc2-a198-df6e070ccd0c None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:07.611423 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c311224-9cc0-4bdd-9a8a-acd6404bd458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:07.612160 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c311224-9cc0-4bdd-9a8a-acd6404bd458 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:07.612449 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c311224-9cc0-4bdd-9a8a-acd6404bd458 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:07.612730 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c311224-9cc0-4bdd-9a8a-acd6404bd458 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:07.613781 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c311224-9cc0-4bdd-9a8a-acd6404bd458 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:07.638339 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c311224-9cc0-4bdd-9a8a-acd6404bd458 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:07.640373 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 17/34] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:48:07 2021] GET /identity/v3/domains/default => generated 199 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:09.558894 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca1fae-790c-4f70-adb4-42a796a3fcd0 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:09.559397 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca1fae-790c-4f70-adb4-42a796a3fcd0 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:09.559397 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca1fae-790c-4f70-adb4-42a796a3fcd0 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:09.561721 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 18/35] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:48:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:48:09.566689 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb9a2f-ab4e-4628-9ba9-028133b5477e None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:09.567098 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb9a2f-ab4e-4628-9ba9-028133b5477e None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:09.567256 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb9a2f-ab4e-4628-9ba9-028133b5477e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:09.589656 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-c4fb9a2f-ab4e-4628-9ba9-028133b5477e None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:48:09.590784 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-c4fb9a2f-ab4e-4628-9ba9-028133b5477e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:48:09.597333 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 18/36] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:48:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:48:09.618889 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca1fae-790c-4f70-adb4-42a796a3fcd0 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:09.630845 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca1fae-790c-4f70-adb4-42a796a3fcd0 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:09.634669 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bbb05-0362-4b29-80ef-ac1f30a5f752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:09.635382 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bbb05-0362-4b29-80ef-ac1f30a5f752 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:09.635706 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bbb05-0362-4b29-80ef-ac1f30a5f752 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:09.635992 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101bbb05-0362-4b29-80ef-ac1f30a5f752 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:09.648363 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bbb05-0362-4b29-80ef-ac1f30a5f752 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:09.673800 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101bbb05-0362-4b29-80ef-ac1f30a5f752 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:09.691113 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-101bbb05-0362-4b29-80ef-ac1f30a5f752 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:48:09.692195 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 19/37] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:48:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:48:09.697568 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb9a2f-ab4e-4628-9ba9-028133b5477e None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:09.706040 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fb9a2f-ab4e-4628-9ba9-028133b5477e None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:09.709979 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66910e77-ca77-4f9d-aec3-63c87c5b0661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:09.710563 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66910e77-ca77-4f9d-aec3-63c87c5b0661 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:09.710853 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66910e77-ca77-4f9d-aec3-63c87c5b0661 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:09.711136 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66910e77-ca77-4f9d-aec3-63c87c5b0661 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:09.711852 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66910e77-ca77-4f9d-aec3-63c87c5b0661 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:48:09.712151 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66910e77-ca77-4f9d-aec3-63c87c5b0661 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:09.736549 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING py.warnings [None req-66910e77-ca77-4f9d-aec3-63c87c5b0661 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:48:09.736549 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: warnings.warn(msg) Oct 27 14:48:09.736549 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: Oct 27 14:48:09.737443 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66910e77-ca77-4f9d-aec3-63c87c5b0661 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:09.753268 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 19/38] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:48:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:09.759176 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bbb05-0362-4b29-80ef-ac1f30a5f752 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:09.768203 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101bbb05-0362-4b29-80ef-ac1f30a5f752 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:09.772119 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5999c-5bbd-4866-8f2b-8d219e0f9f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:09.772686 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5999c-5bbd-4866-8f2b-8d219e0f9f70 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:09.772979 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5999c-5bbd-4866-8f2b-8d219e0f9f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:09.773263 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5999c-5bbd-4866-8f2b-8d219e0f9f70 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:09.773919 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5999c-5bbd-4866-8f2b-8d219e0f9f70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:09.798823 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING py.warnings [None req-ada5999c-5bbd-4866-8f2b-8d219e0f9f70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:48:09.798823 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: warnings.warn(msg) Oct 27 14:48:09.798823 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: Oct 27 14:48:09.800056 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5999c-5bbd-4866-8f2b-8d219e0f9f70 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:09.827544 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 20/39] 10.222.0.89 () {60 vars in 1162 bytes} [Wed Oct 27 14:48:09 2021] POST /identity/v3/projects => generated 301 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:48:11.751043 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd1d26-02c4-45d5-b378-d5250692d0e3 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:11.751575 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd1d26-02c4-45d5-b378-d5250692d0e3 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:11.751718 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd1d26-02c4-45d5-b378-d5250692d0e3 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:11.753294 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 20/40] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:48:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:48:11.758372 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b1468-e59f-43ad-9fba-4fad710577d5 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:11.758780 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b1468-e59f-43ad-9fba-4fad710577d5 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:11.758950 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b1468-e59f-43ad-9fba-4fad710577d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:11.781057 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-553b1468-e59f-43ad-9fba-4fad710577d5 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:48:11.782193 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-553b1468-e59f-43ad-9fba-4fad710577d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:48:11.844986 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 21/41] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:48:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:48:11.866610 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd1d26-02c4-45d5-b378-d5250692d0e3 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:11.878009 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd1d26-02c4-45d5-b378-d5250692d0e3 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:11.881791 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e433dd-35af-442e-985c-cce503a17bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:11.882378 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e433dd-35af-442e-985c-cce503a17bb6 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:11.882717 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e433dd-35af-442e-985c-cce503a17bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:11.883003 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e433dd-35af-442e-985c-cce503a17bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:11.883738 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e433dd-35af-442e-985c-cce503a17bb6 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:11.908942 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING py.warnings [None req-48e433dd-35af-442e-985c-cce503a17bb6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:48:11.908942 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: warnings.warn(msg) Oct 27 14:48:11.908942 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: Oct 27 14:48:11.909843 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e433dd-35af-442e-985c-cce503a17bb6 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:12.110518 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 21/42] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 14:48:11 2021] POST /identity/v3/roles => generated 219 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:48:14.032550 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a3e81-fea5-459b-8771-91f2bb002806 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:14.033090 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a3e81-fea5-459b-8771-91f2bb002806 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:14.033179 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a3e81-fea5-459b-8771-91f2bb002806 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:14.034814 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 22/43] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:48:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:48:14.040651 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ec463-e70d-4d7c-86f9-6a11f03441f1 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:14.041048 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ec463-e70d-4d7c-86f9-6a11f03441f1 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:14.041232 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ec463-e70d-4d7c-86f9-6a11f03441f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:14.064224 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-560ec463-e70d-4d7c-86f9-6a11f03441f1 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:48:14.065668 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-560ec463-e70d-4d7c-86f9-6a11f03441f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:48:14.072532 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 22/44] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:48:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:48:14.094434 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a3e81-fea5-459b-8771-91f2bb002806 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:14.105799 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a3e81-fea5-459b-8771-91f2bb002806 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:14.109602 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75cdf46-bb6d-4a21-8c09-e04a628bc357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:14.110196 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cdf46-bb6d-4a21-8c09-e04a628bc357 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:14.110485 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cdf46-bb6d-4a21-8c09-e04a628bc357 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:14.110769 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75cdf46-bb6d-4a21-8c09-e04a628bc357 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:14.111492 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75cdf46-bb6d-4a21-8c09-e04a628bc357 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:14.135914 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING py.warnings [None req-d75cdf46-bb6d-4a21-8c09-e04a628bc357 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:48:14.135914 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: warnings.warn(msg) Oct 27 14:48:14.135914 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: Oct 27 14:48:14.136827 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75cdf46-bb6d-4a21-8c09-e04a628bc357 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:14.150610 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 23/45] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 14:48:14 2021] POST /identity/v3/roles => generated 225 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:48:16.087729 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576345a9-2a0e-4e98-83bd-672cc3f7baf2 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:16.088253 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576345a9-2a0e-4e98-83bd-672cc3f7baf2 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:16.088336 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576345a9-2a0e-4e98-83bd-672cc3f7baf2 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:16.089964 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 23/46] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:48:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:48:16.095015 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da458da0-7823-419b-abae-fa1867f01ee6 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:16.095383 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da458da0-7823-419b-abae-fa1867f01ee6 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:16.095744 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da458da0-7823-419b-abae-fa1867f01ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:16.117688 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-da458da0-7823-419b-abae-fa1867f01ee6 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:48:16.118818 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-da458da0-7823-419b-abae-fa1867f01ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:48:16.125897 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 24/47] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:48:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:48:16.147548 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576345a9-2a0e-4e98-83bd-672cc3f7baf2 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:16.158869 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576345a9-2a0e-4e98-83bd-672cc3f7baf2 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:16.162612 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd826a-1997-47ee-9f64-f2d70fddd3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:16.163190 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd826a-1997-47ee-9f64-f2d70fddd3df admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:16.163511 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd826a-1997-47ee-9f64-f2d70fddd3df admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:16.163800 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd826a-1997-47ee-9f64-f2d70fddd3df admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:16.164490 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd826a-1997-47ee-9f64-f2d70fddd3df admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:16.190044 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd826a-1997-47ee-9f64-f2d70fddd3df admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:16.201584 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 24/48] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 14:48:16 2021] POST /identity/v3/roles => generated 223 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:48:18.152203 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b11eb6-15ca-4a7f-86d9-62cd35407323 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:18.152741 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b11eb6-15ca-4a7f-86d9-62cd35407323 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:18.152845 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b11eb6-15ca-4a7f-86d9-62cd35407323 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:18.154448 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 25/49] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:48:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:48:18.159639 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16479085-4357-4f5a-8c9f-e740ba7c1319 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:18.160066 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16479085-4357-4f5a-8c9f-e740ba7c1319 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:18.160211 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16479085-4357-4f5a-8c9f-e740ba7c1319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:18.184293 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-16479085-4357-4f5a-8c9f-e740ba7c1319 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:48:18.185663 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-16479085-4357-4f5a-8c9f-e740ba7c1319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:48:18.192962 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 25/50] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:48:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:48:18.214873 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b11eb6-15ca-4a7f-86d9-62cd35407323 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:18.226171 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b11eb6-15ca-4a7f-86d9-62cd35407323 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:18.229937 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b8fcb-1e5e-436c-a8ea-1a5d561ef958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:18.230644 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b8fcb-1e5e-436c-a8ea-1a5d561ef958 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:18.230931 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b8fcb-1e5e-436c-a8ea-1a5d561ef958 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:18.231208 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b8fcb-1e5e-436c-a8ea-1a5d561ef958 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:18.232292 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b8fcb-1e5e-436c-a8ea-1a5d561ef958 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:18.258304 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b8fcb-1e5e-436c-a8ea-1a5d561ef958 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:18.259797 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 26/51] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:48:18 2021] GET /identity/v3/domains/default => generated 199 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:18.265189 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16479085-4357-4f5a-8c9f-e740ba7c1319 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:18.273838 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16479085-4357-4f5a-8c9f-e740ba7c1319 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:18.277810 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee5c47-caf1-4bb0-97f5-b3277d34e5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:18.278397 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee5c47-caf1-4bb0-97f5-b3277d34e5d9 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:18.278694 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee5c47-caf1-4bb0-97f5-b3277d34e5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:18.278983 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee5c47-caf1-4bb0-97f5-b3277d34e5d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:18.279853 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee5c47-caf1-4bb0-97f5-b3277d34e5d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:18.305146 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING py.warnings [None req-2eee5c47-caf1-4bb0-97f5-b3277d34e5d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:48:18.305146 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: warnings.warn(msg) Oct 27 14:48:18.305146 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: Oct 27 14:48:18.306353 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee5c47-caf1-4bb0-97f5-b3277d34e5d9 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:18.333769 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 26/52] 10.222.0.89 () {60 vars in 1162 bytes} [Wed Oct 27 14:48:18 2021] POST /identity/v3/projects => generated 312 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:48:20.278095 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad2ca7-7c7c-4330-b624-826276107db5 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:20.278488 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad2ca7-7c7c-4330-b624-826276107db5 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:20.278663 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad2ca7-7c7c-4330-b624-826276107db5 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:20.280395 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 27/53] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:48:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:48:20.285533 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930ec0f-c779-4e01-ac8b-3a5298276a8c None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:20.285952 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930ec0f-c779-4e01-ac8b-3a5298276a8c None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:20.286110 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e930ec0f-c779-4e01-ac8b-3a5298276a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:20.308321 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-e930ec0f-c779-4e01-ac8b-3a5298276a8c None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:48:20.309449 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-e930ec0f-c779-4e01-ac8b-3a5298276a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:48:20.373995 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 27/54] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:48:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:48:20.396311 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad2ca7-7c7c-4330-b624-826276107db5 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:20.407850 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad2ca7-7c7c-4330-b624-826276107db5 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:20.411622 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4af80a-3355-4a02-a9c7-0a56ecab9200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:20.412330 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4af80a-3355-4a02-a9c7-0a56ecab9200 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:20.412620 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4af80a-3355-4a02-a9c7-0a56ecab9200 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:20.412898 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4af80a-3355-4a02-a9c7-0a56ecab9200 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:20.413952 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4af80a-3355-4a02-a9c7-0a56ecab9200 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:20.440070 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4af80a-3355-4a02-a9c7-0a56ecab9200 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:20.441480 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 28/55] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:48:20 2021] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:20.446510 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930ec0f-c779-4e01-ac8b-3a5298276a8c None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:20.454914 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e930ec0f-c779-4e01-ac8b-3a5298276a8c None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:20.458839 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4a58b-4379-4746-91fd-6a049291122a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:20.459419 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4a58b-4379-4746-91fd-6a049291122a admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:20.459737 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4a58b-4379-4746-91fd-6a049291122a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:20.460022 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4a58b-4379-4746-91fd-6a049291122a admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:20.460676 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4a58b-4379-4746-91fd-6a049291122a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:20.486626 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4a58b-4379-4746-91fd-6a049291122a admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:20.511392 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 28/56] 10.222.0.89 () {60 vars in 1161 bytes} [Wed Oct 27 14:48:20 2021] POST /identity/v3/projects => generated 298 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:48:22.459214 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938c6b3-1d97-48f7-91cf-5e589c462c44 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:22.459772 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938c6b3-1d97-48f7-91cf-5e589c462c44 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:22.459858 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b938c6b3-1d97-48f7-91cf-5e589c462c44 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:22.461553 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 29/57] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:48:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:48:22.466477 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d351f0e-7d24-44de-9f7d-3eb5c2f2ef54 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:22.466892 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d351f0e-7d24-44de-9f7d-3eb5c2f2ef54 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:22.467048 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d351f0e-7d24-44de-9f7d-3eb5c2f2ef54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:22.489042 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-2d351f0e-7d24-44de-9f7d-3eb5c2f2ef54 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:48:22.490183 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-2d351f0e-7d24-44de-9f7d-3eb5c2f2ef54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:48:22.553022 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 29/58] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:48:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:48:22.575490 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938c6b3-1d97-48f7-91cf-5e589c462c44 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:22.587217 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b938c6b3-1d97-48f7-91cf-5e589c462c44 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:22.591010 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02baaa89-61b0-45c6-8695-ff41abc8bbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:22.591751 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02baaa89-61b0-45c6-8695-ff41abc8bbbc admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:22.592040 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02baaa89-61b0-45c6-8695-ff41abc8bbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:22.592319 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02baaa89-61b0-45c6-8695-ff41abc8bbbc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:22.593379 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02baaa89-61b0-45c6-8695-ff41abc8bbbc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:22.618428 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02baaa89-61b0-45c6-8695-ff41abc8bbbc admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:22.619858 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 30/59] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:48:22 2021] GET /identity/v3/domains/default => generated 199 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:22.624866 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d351f0e-7d24-44de-9f7d-3eb5c2f2ef54 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:22.633178 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d351f0e-7d24-44de-9f7d-3eb5c2f2ef54 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:22.637036 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37d2b5-f8fe-43bb-8164-77e1595ae6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:22.637626 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37d2b5-f8fe-43bb-8164-77e1595ae6f3 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:22.637918 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37d2b5-f8fe-43bb-8164-77e1595ae6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:22.638201 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37d2b5-f8fe-43bb-8164-77e1595ae6f3 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:22.638850 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37d2b5-f8fe-43bb-8164-77e1595ae6f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:22.663906 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING py.warnings [None req-7e37d2b5-f8fe-43bb-8164-77e1595ae6f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:48:22.663906 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: warnings.warn(msg) Oct 27 14:48:22.663906 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: Oct 27 14:48:22.665398 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37d2b5-f8fe-43bb-8164-77e1595ae6f3 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:22.687802 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 30/60] 10.222.0.89 () {60 vars in 1153 bytes} [Wed Oct 27 14:48:22 2021] POST /identity/v3/users => generated 275 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:48:24.638941 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8de07b-cfe9-4894-953e-d7ed271c2c9f None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:24.639426 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8de07b-cfe9-4894-953e-d7ed271c2c9f None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:24.639426 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8de07b-cfe9-4894-953e-d7ed271c2c9f None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:24.641654 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 31/61] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:48:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:48:24.646582 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c292fc-c168-45b5-93fd-4a2ddfc5d125 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:24.646978 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c292fc-c168-45b5-93fd-4a2ddfc5d125 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:24.647156 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c292fc-c168-45b5-93fd-4a2ddfc5d125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:24.669839 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-53c292fc-c168-45b5-93fd-4a2ddfc5d125 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:48:24.670963 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-53c292fc-c168-45b5-93fd-4a2ddfc5d125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:48:24.677565 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 31/62] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:48:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:48:24.698640 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8de07b-cfe9-4894-953e-d7ed271c2c9f None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:24.710606 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8de07b-cfe9-4894-953e-d7ed271c2c9f None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:24.714412 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d52cd1-11f2-4000-9589-d748a8b1f3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:24.715117 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d52cd1-11f2-4000-9589-d748a8b1f3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:24.715410 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d52cd1-11f2-4000-9589-d748a8b1f3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:24.715725 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d52cd1-11f2-4000-9589-d748a8b1f3d3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:24.727357 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d52cd1-11f2-4000-9589-d748a8b1f3d3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:48:24.733663 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-81d52cd1-11f2-4000-9589-d748a8b1f3d3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 14:48:24.734740 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 32/63] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:48:24 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:48:24.740086 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c292fc-c168-45b5-93fd-4a2ddfc5d125 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:24.748342 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c292fc-c168-45b5-93fd-4a2ddfc5d125 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:24.752279 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895aee22-96eb-4e73-a169-41ceb747aebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:24.752898 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895aee22-96eb-4e73-a169-41ceb747aebf admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:24.753236 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895aee22-96eb-4e73-a169-41ceb747aebf admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:24.753519 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895aee22-96eb-4e73-a169-41ceb747aebf admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:24.754222 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895aee22-96eb-4e73-a169-41ceb747aebf admin admin] RBAC: Adding query filter params (name=member) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:48:24.754520 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895aee22-96eb-4e73-a169-41ceb747aebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:24.780515 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895aee22-96eb-4e73-a169-41ceb747aebf admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:24.789633 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 32/64] 10.222.0.89 () {56 vars in 1122 bytes} [Wed Oct 27 14:48:24 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:24.795337 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d52cd1-11f2-4000-9589-d748a8b1f3d3 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:24.805393 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d52cd1-11f2-4000-9589-d748a8b1f3d3 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:24.809359 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54389b40-32c7-4a50-964d-72264cf9c0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:24.810141 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54389b40-32c7-4a50-964d-72264cf9c0ef admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:24.810436 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54389b40-32c7-4a50-964d-72264cf9c0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:24.810722 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54389b40-32c7-4a50-964d-72264cf9c0ef admin admin] PATH_INFO: `/v3/users/7a0c9dc56e154415a03704cd0f1b81e6` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:24.829411 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54389b40-32c7-4a50-964d-72264cf9c0ef admin admin] RBAC: Authorizing `identity:get_user(user_id=7a0c9dc56e154415a03704cd0f1b81e6)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:24.855784 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54389b40-32c7-4a50-964d-72264cf9c0ef admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:24.857249 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 33/65] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:48:24 2021] GET /identity/v3/users/7a0c9dc56e154415a03704cd0f1b81e6 => generated 275 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:24.862659 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895aee22-96eb-4e73-a169-41ceb747aebf admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:24.871857 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895aee22-96eb-4e73-a169-41ceb747aebf admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:24.875744 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd860d-d1fd-4e93-a531-e7632ddc5e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:24.876310 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd860d-d1fd-4e93-a531-e7632ddc5e6a admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:24.876598 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd860d-d1fd-4e93-a531-e7632ddc5e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:24.876878 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfd860d-d1fd-4e93-a531-e7632ddc5e6a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:24.884266 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd860d-d1fd-4e93-a531-e7632ddc5e6a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:24.910015 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfd860d-d1fd-4e93-a531-e7632ddc5e6a admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:24.918405 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 33/66] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:48:24 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:48:24.923371 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54389b40-32c7-4a50-964d-72264cf9c0ef admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:24.932417 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54389b40-32c7-4a50-964d-72264cf9c0ef admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:24.936348 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ce9ae-4624-4e12-942f-ba7f38cd309d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:24.937110 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ce9ae-4624-4e12-942f-ba7f38cd309d admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:24.937426 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ce9ae-4624-4e12-942f-ba7f38cd309d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:24.937712 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ce9ae-4624-4e12-942f-ba7f38cd309d admin admin] PATH_INFO: `/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:24.938784 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ce9ae-4624-4e12-942f-ba7f38cd309d admin admin] RBAC: Authorizing `identity:get_project(project_id=055ce8b96eed43db9c8ea4bb1307f9ad)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:24.964659 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ce9ae-4624-4e12-942f-ba7f38cd309d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:24.966139 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 34/67] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:48:24 2021] GET /identity/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:48:24.971870 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd860d-d1fd-4e93-a531-e7632ddc5e6a admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:24.979894 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfd860d-d1fd-4e93-a531-e7632ddc5e6a admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:24.983788 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a537a-b5cf-4678-861c-a2c935466930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:24.984341 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a537a-b5cf-4678-861c-a2c935466930 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:24.984624 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a537a-b5cf-4678-861c-a2c935466930 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:24.984901 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a537a-b5cf-4678-861c-a2c935466930 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:24.985656 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a537a-b5cf-4678-861c-a2c935466930 admin admin] RBAC: Adding query filter params (role.id=cb40c4204c4e49d8b874875a1a860a9c, scope.project.id=055ce8b96eed43db9c8ea4bb1307f9ad, user.id=7a0c9dc56e154415a03704cd0f1b81e6) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:48:24.985957 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a537a-b5cf-4678-861c-a2c935466930 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:25.011025 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a537a-b5cf-4678-861c-a2c935466930 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:25.016726 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 34/68] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:48:24 2021] GET /identity/v3/role_assignments?user.id=7a0c9dc56e154415a03704cd0f1b81e6&scope.project.id=055ce8b96eed43db9c8ea4bb1307f9ad&role.id=cb40c4204c4e49d8b874875a1a860a9c => generated 259 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:26.943805 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3e4a2-0d1a-4a92-8f44-a082a00686b7 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:26.944344 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3e4a2-0d1a-4a92-8f44-a082a00686b7 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:26.944433 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c3e4a2-0d1a-4a92-8f44-a082a00686b7 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:26.946058 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 35/69] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:48:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:48:26.951399 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5c033-bf99-4a95-8a62-c48ea86f82d2 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:26.951842 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5c033-bf99-4a95-8a62-c48ea86f82d2 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:26.951992 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad5c033-bf99-4a95-8a62-c48ea86f82d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:26.974917 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-9ad5c033-bf99-4a95-8a62-c48ea86f82d2 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:48:26.976070 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-9ad5c033-bf99-4a95-8a62-c48ea86f82d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:48:26.982588 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 35/70] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:48:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:48:27.003683 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3e4a2-0d1a-4a92-8f44-a082a00686b7 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:27.015009 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c3e4a2-0d1a-4a92-8f44-a082a00686b7 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:27.019358 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3ec3f-a76c-4894-9e32-5dab2be7e228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:27.020094 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3ec3f-a76c-4894-9e32-5dab2be7e228 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:27.020389 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3ec3f-a76c-4894-9e32-5dab2be7e228 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:27.020673 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3ec3f-a76c-4894-9e32-5dab2be7e228 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:27.032362 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3ec3f-a76c-4894-9e32-5dab2be7e228 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:48:27.038621 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-ffc3ec3f-a76c-4894-9e32-5dab2be7e228 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 14:48:27.039705 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 36/71] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:48:27 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:48:27.045207 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5c033-bf99-4a95-8a62-c48ea86f82d2 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:27.054002 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad5c033-bf99-4a95-8a62-c48ea86f82d2 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:27.057930 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73dcb9-98b3-4286-a721-cdd5d9a507ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:27.058516 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73dcb9-98b3-4286-a721-cdd5d9a507ce admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:27.058807 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73dcb9-98b3-4286-a721-cdd5d9a507ce admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:27.059089 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd73dcb9-98b3-4286-a721-cdd5d9a507ce admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:27.059834 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd73dcb9-98b3-4286-a721-cdd5d9a507ce admin admin] RBAC: Adding query filter params (name=member) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:48:27.060138 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd73dcb9-98b3-4286-a721-cdd5d9a507ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:27.085791 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd73dcb9-98b3-4286-a721-cdd5d9a507ce admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:27.094652 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 36/72] 10.222.0.89 () {56 vars in 1122 bytes} [Wed Oct 27 14:48:27 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:48:27.099607 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3ec3f-a76c-4894-9e32-5dab2be7e228 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:27.111348 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3ec3f-a76c-4894-9e32-5dab2be7e228 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:27.115308 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831370bb-61ca-4cd5-ae3d-0e9bed66a2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:27.116109 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831370bb-61ca-4cd5-ae3d-0e9bed66a2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:27.116401 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831370bb-61ca-4cd5-ae3d-0e9bed66a2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:27.116683 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831370bb-61ca-4cd5-ae3d-0e9bed66a2f6 admin admin] PATH_INFO: `/v3/users/7a0c9dc56e154415a03704cd0f1b81e6` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:27.117759 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831370bb-61ca-4cd5-ae3d-0e9bed66a2f6 admin admin] RBAC: Authorizing `identity:get_user(user_id=7a0c9dc56e154415a03704cd0f1b81e6)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:27.143970 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831370bb-61ca-4cd5-ae3d-0e9bed66a2f6 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:27.145390 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 37/73] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:48:27 2021] GET /identity/v3/users/7a0c9dc56e154415a03704cd0f1b81e6 => generated 275 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:27.150204 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73dcb9-98b3-4286-a721-cdd5d9a507ce admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:27.159604 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd73dcb9-98b3-4286-a721-cdd5d9a507ce admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:27.163463 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec3a8bb-1257-4c13-a831-f682d3244333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:27.164240 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3a8bb-1257-4c13-a831-f682d3244333 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:27.164533 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3a8bb-1257-4c13-a831-f682d3244333 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:27.164817 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec3a8bb-1257-4c13-a831-f682d3244333 admin admin] PATH_INFO: `/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:27.166157 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec3a8bb-1257-4c13-a831-f682d3244333 admin admin] RBAC: Authorizing `identity:get_project(project_id=055ce8b96eed43db9c8ea4bb1307f9ad)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:27.191291 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec3a8bb-1257-4c13-a831-f682d3244333 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:27.192779 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 37/74] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:48:27 2021] GET /identity/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:27.197724 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831370bb-61ca-4cd5-ae3d-0e9bed66a2f6 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:27.206991 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831370bb-61ca-4cd5-ae3d-0e9bed66a2f6 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:27.210814 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bb346-92c2-4565-b046-788ba35e4cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:27.211628 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bb346-92c2-4565-b046-788ba35e4cca admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:27.211916 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bb346-92c2-4565-b046-788ba35e4cca admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:27.212196 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bb346-92c2-4565-b046-788ba35e4cca admin admin] PATH_INFO: `/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad/users/7a0c9dc56e154415a03704cd0f1b81e6/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:27.213935 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913bb346-92c2-4565-b046-788ba35e4cca admin admin] RBAC: Authorizing `identity:create_grant(project_id=055ce8b96eed43db9c8ea4bb1307f9ad, user_id=7a0c9dc56e154415a03704cd0f1b81e6, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:27.240177 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913bb346-92c2-4565-b046-788ba35e4cca admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:27.252376 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 38/75] 10.222.0.89 () {58 vars in 1460 bytes} [Wed Oct 27 14:48:27 2021] PUT /identity/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad/users/7a0c9dc56e154415a03704cd0f1b81e6/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:48:29.169668 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd68f1-6b6c-49c8-bcff-73aa99ddabf2 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:29.170276 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd68f1-6b6c-49c8-bcff-73aa99ddabf2 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:29.170276 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cd68f1-6b6c-49c8-bcff-73aa99ddabf2 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:29.171953 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 38/76] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:48:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:48:29.176836 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb08260-123d-4ca2-b421-2d9911144d43 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:29.177253 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb08260-123d-4ca2-b421-2d9911144d43 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:29.177402 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb08260-123d-4ca2-b421-2d9911144d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:29.199288 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-2cb08260-123d-4ca2-b421-2d9911144d43 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:48:29.200448 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-2cb08260-123d-4ca2-b421-2d9911144d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:48:29.262491 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 39/77] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:48:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:48:29.285191 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd68f1-6b6c-49c8-bcff-73aa99ddabf2 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:29.297319 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cd68f1-6b6c-49c8-bcff-73aa99ddabf2 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:29.301082 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4f946-f70c-4f4e-abf8-5b962bd6f2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:29.301796 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4f946-f70c-4f4e-abf8-5b962bd6f2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:29.302087 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4f946-f70c-4f4e-abf8-5b962bd6f2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:29.302369 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4f946-f70c-4f4e-abf8-5b962bd6f2f5 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:29.313966 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4f946-f70c-4f4e-abf8-5b962bd6f2f5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:48:29.320310 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-a0c4f946-f70c-4f4e-abf8-5b962bd6f2f5 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 14:48:29.321386 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 39/78] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:48:29 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:48:29.326584 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb08260-123d-4ca2-b421-2d9911144d43 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:29.335452 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb08260-123d-4ca2-b421-2d9911144d43 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:29.339322 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4a698-1445-4206-86e3-5a6b7d612c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:29.339935 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4a698-1445-4206-86e3-5a6b7d612c4c admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:29.340230 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4a698-1445-4206-86e3-5a6b7d612c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:29.340515 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede4a698-1445-4206-86e3-5a6b7d612c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:29.341221 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede4a698-1445-4206-86e3-5a6b7d612c4c admin admin] RBAC: Adding query filter params (name=member) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:48:29.341520 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede4a698-1445-4206-86e3-5a6b7d612c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:29.367326 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede4a698-1445-4206-86e3-5a6b7d612c4c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:29.376278 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 40/79] 10.222.0.89 () {56 vars in 1122 bytes} [Wed Oct 27 14:48:29 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:29.381399 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4f946-f70c-4f4e-abf8-5b962bd6f2f5 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:29.390329 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4f946-f70c-4f4e-abf8-5b962bd6f2f5 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:29.394215 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0e6a2-809e-42cd-90a5-3b13f4c7c794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:29.394981 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0e6a2-809e-42cd-90a5-3b13f4c7c794 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:29.395271 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0e6a2-809e-42cd-90a5-3b13f4c7c794 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:29.395595 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0e6a2-809e-42cd-90a5-3b13f4c7c794 admin admin] PATH_INFO: `/v3/users/7a0c9dc56e154415a03704cd0f1b81e6` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:29.396888 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0e6a2-809e-42cd-90a5-3b13f4c7c794 admin admin] RBAC: Authorizing `identity:get_user(user_id=7a0c9dc56e154415a03704cd0f1b81e6)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:29.422971 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0e6a2-809e-42cd-90a5-3b13f4c7c794 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:29.424369 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 40/80] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:48:29 2021] GET /identity/v3/users/7a0c9dc56e154415a03704cd0f1b81e6 => generated 275 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:29.429178 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4a698-1445-4206-86e3-5a6b7d612c4c admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:29.438603 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede4a698-1445-4206-86e3-5a6b7d612c4c admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:29.442438 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e75cc9-51c0-4e0d-8886-50f91f521865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:29.442989 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e75cc9-51c0-4e0d-8886-50f91f521865 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:29.443275 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e75cc9-51c0-4e0d-8886-50f91f521865 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:29.443591 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e75cc9-51c0-4e0d-8886-50f91f521865 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:29.450994 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e75cc9-51c0-4e0d-8886-50f91f521865 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:29.476446 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e75cc9-51c0-4e0d-8886-50f91f521865 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:29.485192 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 41/81] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:48:29 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:48:29.489985 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0e6a2-809e-42cd-90a5-3b13f4c7c794 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:29.498816 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0e6a2-809e-42cd-90a5-3b13f4c7c794 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:29.502663 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af564e-8cde-4cf7-8775-8843842b0a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:29.503416 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af564e-8cde-4cf7-8775-8843842b0a5d admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:29.503737 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af564e-8cde-4cf7-8775-8843842b0a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:29.504016 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af564e-8cde-4cf7-8775-8843842b0a5d admin admin] PATH_INFO: `/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:29.505065 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af564e-8cde-4cf7-8775-8843842b0a5d admin admin] RBAC: Authorizing `identity:get_project(project_id=055ce8b96eed43db9c8ea4bb1307f9ad)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:29.530072 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af564e-8cde-4cf7-8775-8843842b0a5d admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:29.532085 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 41/82] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:48:29 2021] GET /identity/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad => generated 298 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:29.537179 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e75cc9-51c0-4e0d-8886-50f91f521865 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:29.545436 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e75cc9-51c0-4e0d-8886-50f91f521865 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:29.549949 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0491457-7a35-46f1-aaf6-4a0a89cf1860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:29.550493 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0491457-7a35-46f1-aaf6-4a0a89cf1860 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:29.550779 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0491457-7a35-46f1-aaf6-4a0a89cf1860 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:29.551057 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0491457-7a35-46f1-aaf6-4a0a89cf1860 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:29.551848 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0491457-7a35-46f1-aaf6-4a0a89cf1860 admin admin] RBAC: Adding query filter params (role.id=cb40c4204c4e49d8b874875a1a860a9c, scope.project.id=055ce8b96eed43db9c8ea4bb1307f9ad, user.id=7a0c9dc56e154415a03704cd0f1b81e6) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:48:29.552147 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0491457-7a35-46f1-aaf6-4a0a89cf1860 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:29.575989 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING py.warnings [None req-d0491457-7a35-46f1-aaf6-4a0a89cf1860 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:48:29.575989 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: warnings.warn(msg) Oct 27 14:48:29.575989 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: Oct 27 14:48:29.577107 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0491457-7a35-46f1-aaf6-4a0a89cf1860 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:29.582670 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 42/83] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:48:29 2021] GET /identity/v3/role_assignments?user.id=7a0c9dc56e154415a03704cd0f1b81e6&scope.project.id=055ce8b96eed43db9c8ea4bb1307f9ad&role.id=cb40c4204c4e49d8b874875a1a860a9c => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:31.565797 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424fee3-2b5d-4911-946b-2c4d0f4b4e40 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:31.566294 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424fee3-2b5d-4911-946b-2c4d0f4b4e40 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:31.566294 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e424fee3-2b5d-4911-946b-2c4d0f4b4e40 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:31.567992 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 42/84] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:48:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:48:31.572956 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddec83a-8eeb-4c88-977c-e474a30f2800 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:31.573376 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddec83a-8eeb-4c88-977c-e474a30f2800 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:31.573536 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddec83a-8eeb-4c88-977c-e474a30f2800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:31.596536 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-9ddec83a-8eeb-4c88-977c-e474a30f2800 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:48:31.597656 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-9ddec83a-8eeb-4c88-977c-e474a30f2800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:48:31.604224 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 43/85] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:48:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:48:31.625822 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424fee3-2b5d-4911-946b-2c4d0f4b4e40 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:31.637049 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e424fee3-2b5d-4911-946b-2c4d0f4b4e40 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:31.641313 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca974db-3062-4d99-99cf-a65d5619da5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:31.642012 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca974db-3062-4d99-99cf-a65d5619da5d admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:31.642303 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca974db-3062-4d99-99cf-a65d5619da5d admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:31.642585 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca974db-3062-4d99-99cf-a65d5619da5d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:31.656459 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca974db-3062-4d99-99cf-a65d5619da5d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:48:31.662698 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-fca974db-3062-4d99-99cf-a65d5619da5d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 14:48:31.663771 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 43/86] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:48:31 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:48:31.669301 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddec83a-8eeb-4c88-977c-e474a30f2800 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:31.677731 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddec83a-8eeb-4c88-977c-e474a30f2800 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:31.681745 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953c029-9c46-4146-893b-3783ed76e5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:31.682333 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953c029-9c46-4146-893b-3783ed76e5f6 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:31.682629 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953c029-9c46-4146-893b-3783ed76e5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:31.682916 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953c029-9c46-4146-893b-3783ed76e5f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:31.683661 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953c029-9c46-4146-893b-3783ed76e5f6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:48:31.683966 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953c029-9c46-4146-893b-3783ed76e5f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:31.709115 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953c029-9c46-4146-893b-3783ed76e5f6 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:31.717438 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 44/87] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:48:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:31.723106 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca974db-3062-4d99-99cf-a65d5619da5d admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:31.731984 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca974db-3062-4d99-99cf-a65d5619da5d admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:31.735874 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c3649-893f-4510-b0f1-08a16726af09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:31.736632 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c3649-893f-4510-b0f1-08a16726af09 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:31.736922 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c3649-893f-4510-b0f1-08a16726af09 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:31.737203 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1c3649-893f-4510-b0f1-08a16726af09 admin admin] PATH_INFO: `/v3/users/99b1f8461d2e454c9cd6d6d3c9dc623c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:31.738271 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c3649-893f-4510-b0f1-08a16726af09 admin admin] RBAC: Authorizing `identity:get_user(user_id=99b1f8461d2e454c9cd6d6d3c9dc623c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:31.763700 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1c3649-893f-4510-b0f1-08a16726af09 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:31.765106 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 44/88] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:48:31 2021] GET /identity/v3/users/99b1f8461d2e454c9cd6d6d3c9dc623c => generated 247 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:48:31.770359 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953c029-9c46-4146-893b-3783ed76e5f6 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:31.779193 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953c029-9c46-4146-893b-3783ed76e5f6 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:31.783112 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7decb23-efba-466e-8999-2363f94fd246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:31.783698 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7decb23-efba-466e-8999-2363f94fd246 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:31.783993 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7decb23-efba-466e-8999-2363f94fd246 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:31.784281 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7decb23-efba-466e-8999-2363f94fd246 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:31.792095 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7decb23-efba-466e-8999-2363f94fd246 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:31.817290 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7decb23-efba-466e-8999-2363f94fd246 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:31.825496 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 45/89] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:48:31 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:48:31.831118 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c3649-893f-4510-b0f1-08a16726af09 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:31.839834 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1c3649-893f-4510-b0f1-08a16726af09 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:31.843645 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5428ad-2514-4276-88a0-73736cc3563c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:31.844381 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5428ad-2514-4276-88a0-73736cc3563c admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:31.844670 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5428ad-2514-4276-88a0-73736cc3563c admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:31.844950 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5428ad-2514-4276-88a0-73736cc3563c admin admin] PATH_INFO: `/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:31.846002 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5428ad-2514-4276-88a0-73736cc3563c admin admin] RBAC: Authorizing `identity:get_project(project_id=055ce8b96eed43db9c8ea4bb1307f9ad)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:31.870965 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5428ad-2514-4276-88a0-73736cc3563c admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:31.872481 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 45/90] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:48:31 2021] GET /identity/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad => generated 298 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:48:31.877950 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7decb23-efba-466e-8999-2363f94fd246 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:31.886070 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7decb23-efba-466e-8999-2363f94fd246 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:31.889999 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a0fc2-287a-4088-8899-cbfa25e08d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:31.891197 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a0fc2-287a-4088-8899-cbfa25e08d14 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:31.891517 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a0fc2-287a-4088-8899-cbfa25e08d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:31.891809 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a0fc2-287a-4088-8899-cbfa25e08d14 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:31.892579 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a0fc2-287a-4088-8899-cbfa25e08d14 admin admin] RBAC: Adding query filter params (role.id=c243fbeb99ae4f51910f72ddc1773778, scope.project.id=055ce8b96eed43db9c8ea4bb1307f9ad, user.id=99b1f8461d2e454c9cd6d6d3c9dc623c) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:48:31.892886 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a0fc2-287a-4088-8899-cbfa25e08d14 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:31.918015 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a0fc2-287a-4088-8899-cbfa25e08d14 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:31.923303 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 46/91] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:48:31 2021] GET /identity/v3/role_assignments?user.id=99b1f8461d2e454c9cd6d6d3c9dc623c&scope.project.id=055ce8b96eed43db9c8ea4bb1307f9ad&role.id=c243fbeb99ae4f51910f72ddc1773778 => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:33.848892 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624ea8a-67b1-4199-91c8-72f545315f47 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:33.849428 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624ea8a-67b1-4199-91c8-72f545315f47 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:33.849530 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624ea8a-67b1-4199-91c8-72f545315f47 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:33.851104 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 46/92] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:48:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:48:33.856291 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732c898-c499-4ea6-b4ce-91a388f58bc6 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:33.856731 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732c898-c499-4ea6-b4ce-91a388f58bc6 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:33.856874 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732c898-c499-4ea6-b4ce-91a388f58bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:33.878869 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-1732c898-c499-4ea6-b4ce-91a388f58bc6 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:48:33.880025 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-1732c898-c499-4ea6-b4ce-91a388f58bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:48:33.886570 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 47/93] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:48:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:48:33.908279 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624ea8a-67b1-4199-91c8-72f545315f47 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:33.919765 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624ea8a-67b1-4199-91c8-72f545315f47 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:33.923637 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2a745-532b-4326-beb1-f9d19cb4110e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:33.924336 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2a745-532b-4326-beb1-f9d19cb4110e admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:33.924622 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2a745-532b-4326-beb1-f9d19cb4110e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:33.924901 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd2a745-532b-4326-beb1-f9d19cb4110e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:33.935688 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd2a745-532b-4326-beb1-f9d19cb4110e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:48:33.941878 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-3cd2a745-532b-4326-beb1-f9d19cb4110e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 14:48:33.942924 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 47/94] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:48:33 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:48:33.948166 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732c898-c499-4ea6-b4ce-91a388f58bc6 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:33.957003 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732c898-c499-4ea6-b4ce-91a388f58bc6 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:33.960931 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba070777-6309-4c96-8d19-9a58dbcc0dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:33.961519 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba070777-6309-4c96-8d19-9a58dbcc0dfa admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:33.961813 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba070777-6309-4c96-8d19-9a58dbcc0dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:33.962098 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba070777-6309-4c96-8d19-9a58dbcc0dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:33.962808 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba070777-6309-4c96-8d19-9a58dbcc0dfa admin admin] RBAC: Adding query filter params (name=admin) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:48:33.963111 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba070777-6309-4c96-8d19-9a58dbcc0dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:33.988540 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba070777-6309-4c96-8d19-9a58dbcc0dfa admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:33.996839 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 48/95] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:48:33 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:48:34.002278 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2a745-532b-4326-beb1-f9d19cb4110e admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:34.012150 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd2a745-532b-4326-beb1-f9d19cb4110e admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:34.016577 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3580260-0efd-4dac-89e5-b64ca1164187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:34.017339 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3580260-0efd-4dac-89e5-b64ca1164187 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:34.017626 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3580260-0efd-4dac-89e5-b64ca1164187 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:34.017902 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3580260-0efd-4dac-89e5-b64ca1164187 admin admin] PATH_INFO: `/v3/users/99b1f8461d2e454c9cd6d6d3c9dc623c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:34.018972 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3580260-0efd-4dac-89e5-b64ca1164187 admin admin] RBAC: Authorizing `identity:get_user(user_id=99b1f8461d2e454c9cd6d6d3c9dc623c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:34.044005 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3580260-0efd-4dac-89e5-b64ca1164187 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:34.045419 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 48/96] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:48:34 2021] GET /identity/v3/users/99b1f8461d2e454c9cd6d6d3c9dc623c => generated 247 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:34.050226 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba070777-6309-4c96-8d19-9a58dbcc0dfa admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:34.059116 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba070777-6309-4c96-8d19-9a58dbcc0dfa admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:34.063609 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec65e7-2ea7-4750-aef9-b708a72c2d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:34.064364 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec65e7-2ea7-4750-aef9-b708a72c2d08 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:34.064656 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec65e7-2ea7-4750-aef9-b708a72c2d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:34.064940 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec65e7-2ea7-4750-aef9-b708a72c2d08 admin admin] PATH_INFO: `/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:34.066001 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec65e7-2ea7-4750-aef9-b708a72c2d08 admin admin] RBAC: Authorizing `identity:get_project(project_id=055ce8b96eed43db9c8ea4bb1307f9ad)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:34.091514 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec65e7-2ea7-4750-aef9-b708a72c2d08 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:34.093093 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 49/97] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:48:34 2021] GET /identity/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:34.098058 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3580260-0efd-4dac-89e5-b64ca1164187 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:34.107227 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3580260-0efd-4dac-89e5-b64ca1164187 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:34.111062 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058a60e-05aa-4535-a8ff-ab02a23b8e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:34.111900 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058a60e-05aa-4535-a8ff-ab02a23b8e98 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:34.112193 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058a60e-05aa-4535-a8ff-ab02a23b8e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:34.112478 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058a60e-05aa-4535-a8ff-ab02a23b8e98 admin admin] PATH_INFO: `/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad/users/99b1f8461d2e454c9cd6d6d3c9dc623c/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:34.114200 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058a60e-05aa-4535-a8ff-ab02a23b8e98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=055ce8b96eed43db9c8ea4bb1307f9ad, user_id=99b1f8461d2e454c9cd6d6d3c9dc623c, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:34.138874 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING py.warnings [None req-8058a60e-05aa-4535-a8ff-ab02a23b8e98 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:48:34.138874 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: warnings.warn(msg) Oct 27 14:48:34.138874 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: Oct 27 14:48:34.141481 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058a60e-05aa-4535-a8ff-ab02a23b8e98 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:34.154316 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 49/98] 10.222.0.89 () {58 vars in 1460 bytes} [Wed Oct 27 14:48:34 2021] PUT /identity/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad/users/99b1f8461d2e454c9cd6d6d3c9dc623c/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:48:36.067705 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b371f-4cd4-4994-ab19-9de69d693d7f None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:36.068250 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b371f-4cd4-4994-ab19-9de69d693d7f None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:36.068355 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b371f-4cd4-4994-ab19-9de69d693d7f None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:36.069964 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 50/99] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:48:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:48:36.074881 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70a160-7e3f-422c-bb02-71ae33066558 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:36.075271 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70a160-7e3f-422c-bb02-71ae33066558 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:36.075467 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70a160-7e3f-422c-bb02-71ae33066558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:36.097294 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-ed70a160-7e3f-422c-bb02-71ae33066558 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:48:36.098429 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-ed70a160-7e3f-422c-bb02-71ae33066558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:48:36.159693 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 50/100] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:48:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:48:36.182060 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b371f-4cd4-4994-ab19-9de69d693d7f None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:36.194307 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b371f-4cd4-4994-ab19-9de69d693d7f None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:36.198130 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40fc67d-b914-4648-982c-e8c527fc7662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:36.198844 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40fc67d-b914-4648-982c-e8c527fc7662 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:36.199140 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40fc67d-b914-4648-982c-e8c527fc7662 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:36.199422 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40fc67d-b914-4648-982c-e8c527fc7662 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:36.211056 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40fc67d-b914-4648-982c-e8c527fc7662 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:48:36.217397 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-b40fc67d-b914-4648-982c-e8c527fc7662 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 14:48:36.218965 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 51/101] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:48:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:48:36.224414 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70a160-7e3f-422c-bb02-71ae33066558 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:36.232952 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70a160-7e3f-422c-bb02-71ae33066558 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:36.237418 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb794cd-dff8-44fb-9818-ef22398fcafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:36.238015 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb794cd-dff8-44fb-9818-ef22398fcafe admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:36.238308 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb794cd-dff8-44fb-9818-ef22398fcafe admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:36.238590 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb794cd-dff8-44fb-9818-ef22398fcafe admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:36.239299 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb794cd-dff8-44fb-9818-ef22398fcafe admin admin] RBAC: Adding query filter params (name=admin) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:48:36.239623 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb794cd-dff8-44fb-9818-ef22398fcafe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:36.264256 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb794cd-dff8-44fb-9818-ef22398fcafe admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:36.272723 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 51/102] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:48:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:36.278048 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40fc67d-b914-4648-982c-e8c527fc7662 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:36.288458 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40fc67d-b914-4648-982c-e8c527fc7662 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:36.292671 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58f266-4cac-4309-9077-14cb3a8eff6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:36.293457 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58f266-4cac-4309-9077-14cb3a8eff6a admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:36.293752 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58f266-4cac-4309-9077-14cb3a8eff6a admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:36.294038 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58f266-4cac-4309-9077-14cb3a8eff6a admin admin] PATH_INFO: `/v3/users/99b1f8461d2e454c9cd6d6d3c9dc623c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:36.295116 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e58f266-4cac-4309-9077-14cb3a8eff6a admin admin] RBAC: Authorizing `identity:get_user(user_id=99b1f8461d2e454c9cd6d6d3c9dc623c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:36.320645 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e58f266-4cac-4309-9077-14cb3a8eff6a admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:36.322016 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 52/103] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:48:36 2021] GET /identity/v3/users/99b1f8461d2e454c9cd6d6d3c9dc623c => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:36.327067 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb794cd-dff8-44fb-9818-ef22398fcafe admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:36.335944 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb794cd-dff8-44fb-9818-ef22398fcafe admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:36.339701 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2de2a1-e869-4e38-9e04-91def1e92df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:36.340269 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2de2a1-e869-4e38-9e04-91def1e92df4 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:36.340554 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2de2a1-e869-4e38-9e04-91def1e92df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:36.340833 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2de2a1-e869-4e38-9e04-91def1e92df4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:36.348727 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2de2a1-e869-4e38-9e04-91def1e92df4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:36.374091 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2de2a1-e869-4e38-9e04-91def1e92df4 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:36.382156 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 52/104] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:48:36 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:48:36.387121 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58f266-4cac-4309-9077-14cb3a8eff6a admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:36.396083 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58f266-4cac-4309-9077-14cb3a8eff6a admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:36.399919 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8539e-b134-436c-8978-6373b2790a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:36.400668 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8539e-b134-436c-8978-6373b2790a2b admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:36.400965 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8539e-b134-436c-8978-6373b2790a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:36.401247 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8539e-b134-436c-8978-6373b2790a2b admin admin] PATH_INFO: `/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:36.402303 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8539e-b134-436c-8978-6373b2790a2b admin admin] RBAC: Authorizing `identity:get_project(project_id=055ce8b96eed43db9c8ea4bb1307f9ad)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:36.428728 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8539e-b134-436c-8978-6373b2790a2b admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:36.430201 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 53/105] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:48:36 2021] GET /identity/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:36.435284 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2de2a1-e869-4e38-9e04-91def1e92df4 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:36.443219 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2de2a1-e869-4e38-9e04-91def1e92df4 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:36.446975 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403252e-e395-4dbb-886d-e67b5943561f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:36.447547 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403252e-e395-4dbb-886d-e67b5943561f admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:36.447838 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403252e-e395-4dbb-886d-e67b5943561f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:36.448118 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403252e-e395-4dbb-886d-e67b5943561f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:36.448874 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403252e-e395-4dbb-886d-e67b5943561f admin admin] RBAC: Adding query filter params (role.id=c243fbeb99ae4f51910f72ddc1773778, scope.project.id=055ce8b96eed43db9c8ea4bb1307f9ad, user.id=99b1f8461d2e454c9cd6d6d3c9dc623c) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:48:36.449179 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403252e-e395-4dbb-886d-e67b5943561f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:36.474266 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c403252e-e395-4dbb-886d-e67b5943561f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:36.479751 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 53/106] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:48:36 2021] GET /identity/v3/role_assignments?user.id=99b1f8461d2e454c9cd6d6d3c9dc623c&scope.project.id=055ce8b96eed43db9c8ea4bb1307f9ad&role.id=c243fbeb99ae4f51910f72ddc1773778 => generated 608 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:38.455123 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a89b96-cf18-4ad7-b049-9f0f87421b15 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:38.455654 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a89b96-cf18-4ad7-b049-9f0f87421b15 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:38.455756 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a89b96-cf18-4ad7-b049-9f0f87421b15 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:38.457377 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 54/107] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:48:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:48:38.462366 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6ef70-a89f-4abf-a951-86cdd66d4764 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:38.462746 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6ef70-a89f-4abf-a951-86cdd66d4764 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:38.462945 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6ef70-a89f-4abf-a951-86cdd66d4764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:38.485394 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-99b6ef70-a89f-4abf-a951-86cdd66d4764 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:48:38.486524 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-99b6ef70-a89f-4abf-a951-86cdd66d4764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:48:38.493070 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 54/108] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:48:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:48:38.515176 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a89b96-cf18-4ad7-b049-9f0f87421b15 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:38.527111 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a89b96-cf18-4ad7-b049-9f0f87421b15 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:38.530868 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab61fb3-2721-40ba-83ad-8513e693c155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:38.531620 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab61fb3-2721-40ba-83ad-8513e693c155 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:38.531910 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab61fb3-2721-40ba-83ad-8513e693c155 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:38.532188 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab61fb3-2721-40ba-83ad-8513e693c155 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:38.543151 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab61fb3-2721-40ba-83ad-8513e693c155 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:48:38.549698 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-4ab61fb3-2721-40ba-83ad-8513e693c155 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 14:48:38.550750 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 55/109] 10.222.0.89 () {56 vars in 1135 bytes} [Wed Oct 27 14:48:38 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:48:38.556066 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6ef70-a89f-4abf-a951-86cdd66d4764 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:38.564988 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6ef70-a89f-4abf-a951-86cdd66d4764 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:38.568919 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ce8da-a060-4541-9f45-1bcb1f25ef34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:38.569509 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ce8da-a060-4541-9f45-1bcb1f25ef34 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:38.569802 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ce8da-a060-4541-9f45-1bcb1f25ef34 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:38.570093 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258ce8da-a060-4541-9f45-1bcb1f25ef34 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:38.570803 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ce8da-a060-4541-9f45-1bcb1f25ef34 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:48:38.571108 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ce8da-a060-4541-9f45-1bcb1f25ef34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:38.596507 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258ce8da-a060-4541-9f45-1bcb1f25ef34 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:38.604669 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 55/110] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:48:38 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:38.609819 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab61fb3-2721-40ba-83ad-8513e693c155 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:38.619573 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab61fb3-2721-40ba-83ad-8513e693c155 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:38.623319 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e703d56-2e77-4eb0-a922-a53907b8599b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:38.624106 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e703d56-2e77-4eb0-a922-a53907b8599b admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:38.624881 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e703d56-2e77-4eb0-a922-a53907b8599b admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:38.625158 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e703d56-2e77-4eb0-a922-a53907b8599b admin admin] PATH_INFO: `/v3/users/7a0c9dc56e154415a03704cd0f1b81e6` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:38.626222 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e703d56-2e77-4eb0-a922-a53907b8599b admin admin] RBAC: Authorizing `identity:get_user(user_id=7a0c9dc56e154415a03704cd0f1b81e6)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:38.651668 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e703d56-2e77-4eb0-a922-a53907b8599b admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:38.653060 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 56/111] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:48:38 2021] GET /identity/v3/users/7a0c9dc56e154415a03704cd0f1b81e6 => generated 275 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:38.657871 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ce8da-a060-4541-9f45-1bcb1f25ef34 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:38.666986 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258ce8da-a060-4541-9f45-1bcb1f25ef34 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:38.670839 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340f738-8ded-4d24-a1c9-6173c6f4a2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:38.671397 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340f738-8ded-4d24-a1c9-6173c6f4a2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:38.671717 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340f738-8ded-4d24-a1c9-6173c6f4a2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:38.672004 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340f738-8ded-4d24-a1c9-6173c6f4a2a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:38.679417 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340f738-8ded-4d24-a1c9-6173c6f4a2a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:38.705195 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340f738-8ded-4d24-a1c9-6173c6f4a2a1 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:38.713359 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 56/112] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:48:38 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:48:38.718364 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e703d56-2e77-4eb0-a922-a53907b8599b admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:38.727254 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e703d56-2e77-4eb0-a922-a53907b8599b admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:38.731083 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2038cb2-43b9-4671-950e-abb27a38aea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:38.731856 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2038cb2-43b9-4671-950e-abb27a38aea4 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:38.732147 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2038cb2-43b9-4671-950e-abb27a38aea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:38.732424 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2038cb2-43b9-4671-950e-abb27a38aea4 admin admin] PATH_INFO: `/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:38.733476 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2038cb2-43b9-4671-950e-abb27a38aea4 admin admin] RBAC: Authorizing `identity:get_project(project_id=055ce8b96eed43db9c8ea4bb1307f9ad)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:38.759067 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2038cb2-43b9-4671-950e-abb27a38aea4 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:38.760556 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 57/113] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:48:38 2021] GET /identity/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:38.766155 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340f738-8ded-4d24-a1c9-6173c6f4a2a1 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:38.774060 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340f738-8ded-4d24-a1c9-6173c6f4a2a1 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:38.777879 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4755f8-adeb-4058-a86a-5a3584ad2300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:38.778429 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4755f8-adeb-4058-a86a-5a3584ad2300 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:38.778714 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4755f8-adeb-4058-a86a-5a3584ad2300 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:38.778994 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4755f8-adeb-4058-a86a-5a3584ad2300 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:38.779790 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4755f8-adeb-4058-a86a-5a3584ad2300 admin admin] RBAC: Adding query filter params (role.id=f98faade9eb9460b9aa1049aef51b342, scope.project.id=055ce8b96eed43db9c8ea4bb1307f9ad, user.id=7a0c9dc56e154415a03704cd0f1b81e6) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:48:38.780091 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4755f8-adeb-4058-a86a-5a3584ad2300 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:38.805313 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4755f8-adeb-4058-a86a-5a3584ad2300 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:38.810386 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 57/114] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:48:38 2021] GET /identity/v3/role_assignments?user.id=7a0c9dc56e154415a03704cd0f1b81e6&scope.project.id=055ce8b96eed43db9c8ea4bb1307f9ad&role.id=f98faade9eb9460b9aa1049aef51b342 => generated 259 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:40.712747 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42df42-fdeb-465d-bede-15262985b05c None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:40.713275 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42df42-fdeb-465d-bede-15262985b05c None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:40.713365 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42df42-fdeb-465d-bede-15262985b05c None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:40.714988 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 58/115] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:48:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:48:40.720732 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0498b50-2481-459e-a6eb-aa6feb68c53b None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:40.721107 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0498b50-2481-459e-a6eb-aa6feb68c53b None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:40.721297 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0498b50-2481-459e-a6eb-aa6feb68c53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:40.743198 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-c0498b50-2481-459e-a6eb-aa6feb68c53b None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:48:40.744363 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-c0498b50-2481-459e-a6eb-aa6feb68c53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:48:40.751337 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 58/116] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:48:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:48:40.772387 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42df42-fdeb-465d-bede-15262985b05c None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:40.783632 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a42df42-fdeb-465d-bede-15262985b05c None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:40.787353 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2658c-c746-4a8f-8859-0c61db1ac838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:40.788100 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2658c-c746-4a8f-8859-0c61db1ac838 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:40.788391 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2658c-c746-4a8f-8859-0c61db1ac838 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:40.788673 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2658c-c746-4a8f-8859-0c61db1ac838 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:40.799867 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a2658c-c746-4a8f-8859-0c61db1ac838 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:48:40.806439 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-a5a2658c-c746-4a8f-8859-0c61db1ac838 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 14:48:40.807631 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 59/117] 10.222.0.89 () {56 vars in 1135 bytes} [Wed Oct 27 14:48:40 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 14:48:40.813160 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0498b50-2481-459e-a6eb-aa6feb68c53b None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:40.821468 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0498b50-2481-459e-a6eb-aa6feb68c53b None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:40.825384 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fc192-7bd1-468d-90ce-f8455f150c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:40.825975 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fc192-7bd1-468d-90ce-f8455f150c14 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:40.826267 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fc192-7bd1-468d-90ce-f8455f150c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:40.826550 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fc192-7bd1-468d-90ce-f8455f150c14 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:40.827257 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33fc192-7bd1-468d-90ce-f8455f150c14 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:48:40.828231 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33fc192-7bd1-468d-90ce-f8455f150c14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:40.852898 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33fc192-7bd1-468d-90ce-f8455f150c14 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:40.861065 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 59/118] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:48:40 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:40.865895 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2658c-c746-4a8f-8859-0c61db1ac838 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:40.876236 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2658c-c746-4a8f-8859-0c61db1ac838 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:40.880070 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c478943-e0bf-4888-9c17-dcba374286ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:40.880827 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c478943-e0bf-4888-9c17-dcba374286ed admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:40.881118 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c478943-e0bf-4888-9c17-dcba374286ed admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:40.881400 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c478943-e0bf-4888-9c17-dcba374286ed admin admin] PATH_INFO: `/v3/users/7a0c9dc56e154415a03704cd0f1b81e6` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:40.882473 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c478943-e0bf-4888-9c17-dcba374286ed admin admin] RBAC: Authorizing `identity:get_user(user_id=7a0c9dc56e154415a03704cd0f1b81e6)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:40.908078 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c478943-e0bf-4888-9c17-dcba374286ed admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:40.909491 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 60/119] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:48:40 2021] GET /identity/v3/users/7a0c9dc56e154415a03704cd0f1b81e6 => generated 275 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:40.914434 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fc192-7bd1-468d-90ce-f8455f150c14 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:40.923594 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fc192-7bd1-468d-90ce-f8455f150c14 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:40.927424 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7950e7a1-d7f2-4969-a85d-6396d55e1f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:40.928207 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950e7a1-d7f2-4969-a85d-6396d55e1f62 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:40.928499 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950e7a1-d7f2-4969-a85d-6396d55e1f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:40.928781 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7950e7a1-d7f2-4969-a85d-6396d55e1f62 admin admin] PATH_INFO: `/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:40.929848 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950e7a1-d7f2-4969-a85d-6396d55e1f62 admin admin] RBAC: Authorizing `identity:get_project(project_id=055ce8b96eed43db9c8ea4bb1307f9ad)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:40.956130 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7950e7a1-d7f2-4969-a85d-6396d55e1f62 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:40.957588 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 60/120] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:48:40 2021] GET /identity/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:40.962435 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c478943-e0bf-4888-9c17-dcba374286ed admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:40.971582 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c478943-e0bf-4888-9c17-dcba374286ed admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:40.975433 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc6abf-c5b1-4f8a-888a-a027cbf16bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:40.976249 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc6abf-c5b1-4f8a-888a-a027cbf16bbd admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:40.976542 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc6abf-c5b1-4f8a-888a-a027cbf16bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:40.976831 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc6abf-c5b1-4f8a-888a-a027cbf16bbd admin admin] PATH_INFO: `/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad/users/7a0c9dc56e154415a03704cd0f1b81e6/roles/f98faade9eb9460b9aa1049aef51b342` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:40.978762 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc6abf-c5b1-4f8a-888a-a027cbf16bbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=055ce8b96eed43db9c8ea4bb1307f9ad, user_id=7a0c9dc56e154415a03704cd0f1b81e6, role_id=f98faade9eb9460b9aa1049aef51b342)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:41.005166 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc6abf-c5b1-4f8a-888a-a027cbf16bbd admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:41.017528 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 61/121] 10.222.0.89 () {58 vars in 1460 bytes} [Wed Oct 27 14:48:40 2021] PUT /identity/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad/users/7a0c9dc56e154415a03704cd0f1b81e6/roles/f98faade9eb9460b9aa1049aef51b342 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:48:42.942688 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2cd91-ce11-4ff5-8c26-39b78306fd05 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:42.943206 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2cd91-ce11-4ff5-8c26-39b78306fd05 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:42.943314 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2cd91-ce11-4ff5-8c26-39b78306fd05 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:42.945013 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 61/122] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:48:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:48:42.950266 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d60c31-8eb4-4896-868e-05bacca1a7e8 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:42.950661 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d60c31-8eb4-4896-868e-05bacca1a7e8 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:42.950839 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d60c31-8eb4-4896-868e-05bacca1a7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:42.973723 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-25d60c31-8eb4-4896-868e-05bacca1a7e8 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:48:42.974849 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-25d60c31-8eb4-4896-868e-05bacca1a7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:48:43.036683 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 62/123] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:48:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:48:43.058252 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2cd91-ce11-4ff5-8c26-39b78306fd05 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:43.069915 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2cd91-ce11-4ff5-8c26-39b78306fd05 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:43.073689 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea417eda-92a5-4794-b3ef-eb8f859f8a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:43.074405 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea417eda-92a5-4794-b3ef-eb8f859f8a75 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:43.074694 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea417eda-92a5-4794-b3ef-eb8f859f8a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:43.074982 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea417eda-92a5-4794-b3ef-eb8f859f8a75 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:43.087147 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea417eda-92a5-4794-b3ef-eb8f859f8a75 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:48:43.094221 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-ea417eda-92a5-4794-b3ef-eb8f859f8a75 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 14:48:43.095268 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 62/124] 10.222.0.89 () {56 vars in 1135 bytes} [Wed Oct 27 14:48:43 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:48:43.100526 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d60c31-8eb4-4896-868e-05bacca1a7e8 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:43.109164 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d60c31-8eb4-4896-868e-05bacca1a7e8 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:43.113652 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88685dca-1d4a-4997-8e6b-b2239e3caf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:43.114245 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88685dca-1d4a-4997-8e6b-b2239e3caf50 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:43.114535 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88685dca-1d4a-4997-8e6b-b2239e3caf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:43.114819 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88685dca-1d4a-4997-8e6b-b2239e3caf50 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:43.115571 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88685dca-1d4a-4997-8e6b-b2239e3caf50 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:48:43.115875 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88685dca-1d4a-4997-8e6b-b2239e3caf50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:43.141177 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88685dca-1d4a-4997-8e6b-b2239e3caf50 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:43.149467 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 63/125] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:48:43 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:43.155048 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea417eda-92a5-4794-b3ef-eb8f859f8a75 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:43.164701 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea417eda-92a5-4794-b3ef-eb8f859f8a75 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:43.168849 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef2978-190d-4c32-a73f-6a33d2f889d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:43.169634 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef2978-190d-4c32-a73f-6a33d2f889d9 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:43.169925 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef2978-190d-4c32-a73f-6a33d2f889d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:43.170210 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fef2978-190d-4c32-a73f-6a33d2f889d9 admin admin] PATH_INFO: `/v3/users/7a0c9dc56e154415a03704cd0f1b81e6` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:43.171959 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef2978-190d-4c32-a73f-6a33d2f889d9 admin admin] RBAC: Authorizing `identity:get_user(user_id=7a0c9dc56e154415a03704cd0f1b81e6)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:43.197810 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fef2978-190d-4c32-a73f-6a33d2f889d9 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:43.199182 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 63/126] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:48:43 2021] GET /identity/v3/users/7a0c9dc56e154415a03704cd0f1b81e6 => generated 275 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:43.204665 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88685dca-1d4a-4997-8e6b-b2239e3caf50 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:43.213629 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88685dca-1d4a-4997-8e6b-b2239e3caf50 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:43.217549 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b49e3e-d3d0-47fd-bcc6-27a5318f3312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:43.218165 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b49e3e-d3d0-47fd-bcc6-27a5318f3312 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:43.218457 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b49e3e-d3d0-47fd-bcc6-27a5318f3312 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:43.218740 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b49e3e-d3d0-47fd-bcc6-27a5318f3312 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:43.226245 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b49e3e-d3d0-47fd-bcc6-27a5318f3312 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:43.251942 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b49e3e-d3d0-47fd-bcc6-27a5318f3312 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:43.260275 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 64/127] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:48:43 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:48:43.266166 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef2978-190d-4c32-a73f-6a33d2f889d9 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:43.275205 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fef2978-190d-4c32-a73f-6a33d2f889d9 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:43.279083 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2e890-0da3-457a-b4b8-86a9a6c38ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:43.279887 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2e890-0da3-457a-b4b8-86a9a6c38ffa admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:43.280180 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2e890-0da3-457a-b4b8-86a9a6c38ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:43.280465 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2e890-0da3-457a-b4b8-86a9a6c38ffa admin admin] PATH_INFO: `/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:43.281526 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2e890-0da3-457a-b4b8-86a9a6c38ffa admin admin] RBAC: Authorizing `identity:get_project(project_id=055ce8b96eed43db9c8ea4bb1307f9ad)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:43.306879 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2e890-0da3-457a-b4b8-86a9a6c38ffa admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:43.308382 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 64/128] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:48:43 2021] GET /identity/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:48:43.313947 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b49e3e-d3d0-47fd-bcc6-27a5318f3312 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:43.322098 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b49e3e-d3d0-47fd-bcc6-27a5318f3312 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:43.326012 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd87d37-dd94-4ee9-b59c-9134b589602c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:43.326575 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd87d37-dd94-4ee9-b59c-9134b589602c admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:43.326867 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd87d37-dd94-4ee9-b59c-9134b589602c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:43.327151 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd87d37-dd94-4ee9-b59c-9134b589602c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:43.328519 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd87d37-dd94-4ee9-b59c-9134b589602c admin admin] RBAC: Adding query filter params (role.id=f98faade9eb9460b9aa1049aef51b342, scope.project.id=055ce8b96eed43db9c8ea4bb1307f9ad, user.id=7a0c9dc56e154415a03704cd0f1b81e6) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:48:43.328822 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd87d37-dd94-4ee9-b59c-9134b589602c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:43.354088 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd87d37-dd94-4ee9-b59c-9134b589602c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:43.360239 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 65/129] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:48:43 2021] GET /identity/v3/role_assignments?user.id=7a0c9dc56e154415a03704cd0f1b81e6&scope.project.id=055ce8b96eed43db9c8ea4bb1307f9ad&role.id=f98faade9eb9460b9aa1049aef51b342 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:45.351846 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff091abe-4995-429a-9ab5-a35f2560a370 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:45.352302 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff091abe-4995-429a-9ab5-a35f2560a370 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:45.352421 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff091abe-4995-429a-9ab5-a35f2560a370 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:45.354096 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 65/130] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:48:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:48:45.359278 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86a2b8-e12b-4624-b70b-756a10f2d217 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:45.359664 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86a2b8-e12b-4624-b70b-756a10f2d217 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:45.359891 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86a2b8-e12b-4624-b70b-756a10f2d217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:45.383674 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-7f86a2b8-e12b-4624-b70b-756a10f2d217 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:48:45.384794 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-7f86a2b8-e12b-4624-b70b-756a10f2d217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:48:45.391318 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 66/131] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:48:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:48:45.413431 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff091abe-4995-429a-9ab5-a35f2560a370 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:45.424954 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff091abe-4995-429a-9ab5-a35f2560a370 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:45.428741 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7aa91-bcb7-4fc5-be76-c92eaa55b428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:45.429454 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7aa91-bcb7-4fc5-be76-c92eaa55b428 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:45.429746 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7aa91-bcb7-4fc5-be76-c92eaa55b428 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:45.430033 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7aa91-bcb7-4fc5-be76-c92eaa55b428 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:45.441497 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7aa91-bcb7-4fc5-be76-c92eaa55b428 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:48:45.447806 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-6be7aa91-bcb7-4fc5-be76-c92eaa55b428 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 14:48:45.448859 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 66/132] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:48:45 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:48:45.454923 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86a2b8-e12b-4624-b70b-756a10f2d217 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:45.463676 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86a2b8-e12b-4624-b70b-756a10f2d217 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:45.467607 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eedc07c-3094-4de1-960f-3feaefe3184f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:45.468226 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedc07c-3094-4de1-960f-3feaefe3184f admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:45.468521 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedc07c-3094-4de1-960f-3feaefe3184f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:45.468799 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eedc07c-3094-4de1-960f-3feaefe3184f admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:45.469507 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eedc07c-3094-4de1-960f-3feaefe3184f admin admin] RBAC: Adding query filter params (name=member) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:48:45.469807 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eedc07c-3094-4de1-960f-3feaefe3184f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:45.497161 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eedc07c-3094-4de1-960f-3feaefe3184f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:45.506093 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 67/133] 10.222.0.89 () {56 vars in 1122 bytes} [Wed Oct 27 14:48:45 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:45.511738 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7aa91-bcb7-4fc5-be76-c92eaa55b428 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:45.522365 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7aa91-bcb7-4fc5-be76-c92eaa55b428 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:45.526294 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1726c22-e701-46c8-839c-6b5e198a8b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:45.527077 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1726c22-e701-46c8-839c-6b5e198a8b95 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:45.527373 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1726c22-e701-46c8-839c-6b5e198a8b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:45.527690 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1726c22-e701-46c8-839c-6b5e198a8b95 admin admin] PATH_INFO: `/v3/users/7a0c9dc56e154415a03704cd0f1b81e6` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:45.528786 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1726c22-e701-46c8-839c-6b5e198a8b95 admin admin] RBAC: Authorizing `identity:get_user(user_id=7a0c9dc56e154415a03704cd0f1b81e6)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:45.554341 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1726c22-e701-46c8-839c-6b5e198a8b95 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:45.555866 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 67/134] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:48:45 2021] GET /identity/v3/users/7a0c9dc56e154415a03704cd0f1b81e6 => generated 275 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:45.560733 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eedc07c-3094-4de1-960f-3feaefe3184f admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:45.570153 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eedc07c-3094-4de1-960f-3feaefe3184f admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:45.574002 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727211d-a358-472e-a430-312d3149e603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:45.574561 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727211d-a358-472e-a430-312d3149e603 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:45.574849 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727211d-a358-472e-a430-312d3149e603 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:45.575129 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727211d-a358-472e-a430-312d3149e603 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:45.583171 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727211d-a358-472e-a430-312d3149e603 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:45.607936 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727211d-a358-472e-a430-312d3149e603 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:45.616665 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 68/135] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:48:45 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:48:45.621746 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1726c22-e701-46c8-839c-6b5e198a8b95 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:45.631400 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1726c22-e701-46c8-839c-6b5e198a8b95 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:45.635287 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b85a4-9cdb-4ee0-8573-3abedb54c81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:45.636075 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b85a4-9cdb-4ee0-8573-3abedb54c81d admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:45.636364 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b85a4-9cdb-4ee0-8573-3abedb54c81d admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:45.636643 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b85a4-9cdb-4ee0-8573-3abedb54c81d admin admin] PATH_INFO: `/v3/projects/da81f6b96b55426c97bf64a1a3847193` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:45.637697 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b85a4-9cdb-4ee0-8573-3abedb54c81d admin admin] RBAC: Authorizing `identity:get_project(project_id=da81f6b96b55426c97bf64a1a3847193)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:45.662651 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b85a4-9cdb-4ee0-8573-3abedb54c81d admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:45.664142 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 68/136] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:48:45 2021] GET /identity/v3/projects/da81f6b96b55426c97bf64a1a3847193 => generated 312 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:45.669506 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727211d-a358-472e-a430-312d3149e603 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:45.678183 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727211d-a358-472e-a430-312d3149e603 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:45.682192 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb20c2-b0d3-417f-9def-2c39bdb0075d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:45.682749 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb20c2-b0d3-417f-9def-2c39bdb0075d admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:45.683034 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb20c2-b0d3-417f-9def-2c39bdb0075d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:45.683314 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb20c2-b0d3-417f-9def-2c39bdb0075d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:45.684112 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb20c2-b0d3-417f-9def-2c39bdb0075d admin admin] RBAC: Adding query filter params (role.id=cb40c4204c4e49d8b874875a1a860a9c, scope.project.id=da81f6b96b55426c97bf64a1a3847193, user.id=7a0c9dc56e154415a03704cd0f1b81e6) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:48:45.684416 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb20c2-b0d3-417f-9def-2c39bdb0075d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:45.709816 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb20c2-b0d3-417f-9def-2c39bdb0075d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:45.714887 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 69/137] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:48:45 2021] GET /identity/v3/role_assignments?user.id=7a0c9dc56e154415a03704cd0f1b81e6&scope.project.id=da81f6b96b55426c97bf64a1a3847193&role.id=cb40c4204c4e49d8b874875a1a860a9c => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:47.641217 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab930d6a-8087-403c-99fa-e89593ada181 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:47.641742 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab930d6a-8087-403c-99fa-e89593ada181 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:47.641742 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab930d6a-8087-403c-99fa-e89593ada181 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:47.643372 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 69/138] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:48:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:48:47.648650 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2867d-c292-4a5c-9dea-89dc385872ad None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:47.649058 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2867d-c292-4a5c-9dea-89dc385872ad None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:47.649227 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2867d-c292-4a5c-9dea-89dc385872ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:47.672403 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-caf2867d-c292-4a5c-9dea-89dc385872ad None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:48:47.673522 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-caf2867d-c292-4a5c-9dea-89dc385872ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:48:47.680367 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 70/139] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:48:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:48:47.701978 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab930d6a-8087-403c-99fa-e89593ada181 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:47.713832 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab930d6a-8087-403c-99fa-e89593ada181 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:47.717656 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07470264-ae53-48ba-bc4f-e0ec0cec0320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:47.718388 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07470264-ae53-48ba-bc4f-e0ec0cec0320 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:47.718681 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07470264-ae53-48ba-bc4f-e0ec0cec0320 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:47.718968 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07470264-ae53-48ba-bc4f-e0ec0cec0320 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:47.729873 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07470264-ae53-48ba-bc4f-e0ec0cec0320 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:48:47.736195 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-07470264-ae53-48ba-bc4f-e0ec0cec0320 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 14:48:47.737253 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 70/140] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:48:47 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:48:47.742429 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2867d-c292-4a5c-9dea-89dc385872ad None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:47.751234 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2867d-c292-4a5c-9dea-89dc385872ad None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:47.755101 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4952c-c302-4691-8b5a-244f0ab054e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:47.755724 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4952c-c302-4691-8b5a-244f0ab054e7 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:47.756018 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4952c-c302-4691-8b5a-244f0ab054e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:47.756303 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4952c-c302-4691-8b5a-244f0ab054e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:47.757007 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4952c-c302-4691-8b5a-244f0ab054e7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:48:47.757308 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4952c-c302-4691-8b5a-244f0ab054e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:47.782976 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4952c-c302-4691-8b5a-244f0ab054e7 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:47.791505 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 71/141] 10.222.0.89 () {56 vars in 1122 bytes} [Wed Oct 27 14:48:47 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:48:47.796538 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07470264-ae53-48ba-bc4f-e0ec0cec0320 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:47.806360 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07470264-ae53-48ba-bc4f-e0ec0cec0320 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:47.810894 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a37cfb-0384-41e0-bc0b-57b8451d67dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:47.812198 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a37cfb-0384-41e0-bc0b-57b8451d67dd admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:47.812491 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a37cfb-0384-41e0-bc0b-57b8451d67dd admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:47.812773 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a37cfb-0384-41e0-bc0b-57b8451d67dd admin admin] PATH_INFO: `/v3/users/7a0c9dc56e154415a03704cd0f1b81e6` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:47.813864 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a37cfb-0384-41e0-bc0b-57b8451d67dd admin admin] RBAC: Authorizing `identity:get_user(user_id=7a0c9dc56e154415a03704cd0f1b81e6)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:47.839699 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a37cfb-0384-41e0-bc0b-57b8451d67dd admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:47.841147 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 71/142] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:48:47 2021] GET /identity/v3/users/7a0c9dc56e154415a03704cd0f1b81e6 => generated 275 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:47.846396 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4952c-c302-4691-8b5a-244f0ab054e7 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:47.855555 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4952c-c302-4691-8b5a-244f0ab054e7 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:47.859916 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6676f28-6f78-4f98-8e47-4d9f13d51e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:47.860687 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6676f28-6f78-4f98-8e47-4d9f13d51e4b admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:47.860977 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6676f28-6f78-4f98-8e47-4d9f13d51e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:47.861259 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6676f28-6f78-4f98-8e47-4d9f13d51e4b admin admin] PATH_INFO: `/v3/projects/da81f6b96b55426c97bf64a1a3847193` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:47.862317 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6676f28-6f78-4f98-8e47-4d9f13d51e4b admin admin] RBAC: Authorizing `identity:get_project(project_id=da81f6b96b55426c97bf64a1a3847193)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:47.888146 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6676f28-6f78-4f98-8e47-4d9f13d51e4b admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:47.889631 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 72/143] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:48:47 2021] GET /identity/v3/projects/da81f6b96b55426c97bf64a1a3847193 => generated 312 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:47.894670 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a37cfb-0384-41e0-bc0b-57b8451d67dd admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:47.903627 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a37cfb-0384-41e0-bc0b-57b8451d67dd admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:47.907577 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35f5eb-43f6-4f1d-8722-ba117fe0e4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:47.908371 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35f5eb-43f6-4f1d-8722-ba117fe0e4d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:47.908664 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35f5eb-43f6-4f1d-8722-ba117fe0e4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:47.908950 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35f5eb-43f6-4f1d-8722-ba117fe0e4d6 admin admin] PATH_INFO: `/v3/projects/da81f6b96b55426c97bf64a1a3847193/users/7a0c9dc56e154415a03704cd0f1b81e6/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:47.910686 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e35f5eb-43f6-4f1d-8722-ba117fe0e4d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da81f6b96b55426c97bf64a1a3847193, user_id=7a0c9dc56e154415a03704cd0f1b81e6, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:47.938081 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e35f5eb-43f6-4f1d-8722-ba117fe0e4d6 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:47.950241 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 72/144] 10.222.0.89 () {58 vars in 1460 bytes} [Wed Oct 27 14:48:47 2021] PUT /identity/v3/projects/da81f6b96b55426c97bf64a1a3847193/users/7a0c9dc56e154415a03704cd0f1b81e6/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:48:49.888386 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5a3a3-50a7-4c34-b5b0-648585f4de12 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:49.888904 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5a3a3-50a7-4c34-b5b0-648585f4de12 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:49.889023 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5a3a3-50a7-4c34-b5b0-648585f4de12 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:49.891286 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 73/145] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:48:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:48:49.896421 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7087861-8813-4e2a-8f73-7a846c2160a2 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:49.896784 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7087861-8813-4e2a-8f73-7a846c2160a2 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:49.896996 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7087861-8813-4e2a-8f73-7a846c2160a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:49.919160 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-f7087861-8813-4e2a-8f73-7a846c2160a2 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:48:49.920396 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-f7087861-8813-4e2a-8f73-7a846c2160a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:48:49.983568 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 73/146] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:48:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:48:50.005574 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5a3a3-50a7-4c34-b5b0-648585f4de12 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:50.017561 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5a3a3-50a7-4c34-b5b0-648585f4de12 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:50.021382 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cb120-204b-4a7e-86a0-713f89d2b7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:50.022105 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cb120-204b-4a7e-86a0-713f89d2b7ec admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:50.022398 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cb120-204b-4a7e-86a0-713f89d2b7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:50.022685 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cb120-204b-4a7e-86a0-713f89d2b7ec admin admin] PATH_INFO: `/v3/roles/member` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:50.034400 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6cb120-204b-4a7e-86a0-713f89d2b7ec admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:48:50.041062 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-2a6cb120-204b-4a7e-86a0-713f89d2b7ec admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 14:48:50.042123 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 74/147] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:48:50 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:48:50.047229 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7087861-8813-4e2a-8f73-7a846c2160a2 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:50.055505 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7087861-8813-4e2a-8f73-7a846c2160a2 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:50.059291 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7815d-7825-438a-ba5a-19254a075697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:50.059913 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7815d-7825-438a-ba5a-19254a075697 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:50.060201 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7815d-7825-438a-ba5a-19254a075697 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:50.060479 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7815d-7825-438a-ba5a-19254a075697 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:50.061181 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b7815d-7825-438a-ba5a-19254a075697 admin admin] RBAC: Adding query filter params (name=member) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:48:50.061478 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b7815d-7825-438a-ba5a-19254a075697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:50.087340 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b7815d-7825-438a-ba5a-19254a075697 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:50.096096 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 74/148] 10.222.0.89 () {56 vars in 1122 bytes} [Wed Oct 27 14:48:50 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:50.101247 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cb120-204b-4a7e-86a0-713f89d2b7ec admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:50.110692 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cb120-204b-4a7e-86a0-713f89d2b7ec admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:50.114547 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ef277-2355-43f5-aa08-7afa9fdf2de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:50.115310 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ef277-2355-43f5-aa08-7afa9fdf2de6 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:50.115630 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ef277-2355-43f5-aa08-7afa9fdf2de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:50.115912 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ef277-2355-43f5-aa08-7afa9fdf2de6 admin admin] PATH_INFO: `/v3/users/7a0c9dc56e154415a03704cd0f1b81e6` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:50.116985 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ef277-2355-43f5-aa08-7afa9fdf2de6 admin admin] RBAC: Authorizing `identity:get_user(user_id=7a0c9dc56e154415a03704cd0f1b81e6)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:50.142813 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ef277-2355-43f5-aa08-7afa9fdf2de6 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:50.144191 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 75/149] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:48:50 2021] GET /identity/v3/users/7a0c9dc56e154415a03704cd0f1b81e6 => generated 275 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:50.149081 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7815d-7825-438a-ba5a-19254a075697 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:50.158378 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7815d-7825-438a-ba5a-19254a075697 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:50.162158 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5f9f8-f4b8-47ac-ba50-8b9ff12ea3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:50.162710 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5f9f8-f4b8-47ac-ba50-8b9ff12ea3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:50.162998 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5f9f8-f4b8-47ac-ba50-8b9ff12ea3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:50.163282 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5f9f8-f4b8-47ac-ba50-8b9ff12ea3e7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:50.170967 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5f9f8-f4b8-47ac-ba50-8b9ff12ea3e7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:50.195693 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5f9f8-f4b8-47ac-ba50-8b9ff12ea3e7 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:50.204328 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 75/150] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:48:50 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:48:50.209200 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ef277-2355-43f5-aa08-7afa9fdf2de6 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:50.218698 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ef277-2355-43f5-aa08-7afa9fdf2de6 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:50.222573 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad18c73-9fb4-428f-b8e1-3337238d6b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:50.223324 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad18c73-9fb4-428f-b8e1-3337238d6b9e admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:50.223654 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad18c73-9fb4-428f-b8e1-3337238d6b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:50.223940 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad18c73-9fb4-428f-b8e1-3337238d6b9e admin admin] PATH_INFO: `/v3/projects/da81f6b96b55426c97bf64a1a3847193` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:50.225003 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad18c73-9fb4-428f-b8e1-3337238d6b9e admin admin] RBAC: Authorizing `identity:get_project(project_id=da81f6b96b55426c97bf64a1a3847193)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:50.250140 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad18c73-9fb4-428f-b8e1-3337238d6b9e admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:50.251786 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 76/151] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:48:50 2021] GET /identity/v3/projects/da81f6b96b55426c97bf64a1a3847193 => generated 312 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:50.256854 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5f9f8-f4b8-47ac-ba50-8b9ff12ea3e7 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:50.265687 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5f9f8-f4b8-47ac-ba50-8b9ff12ea3e7 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:50.269574 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d2fb0-2b66-4b7e-86c8-01d813e487c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:50.270136 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d2fb0-2b66-4b7e-86c8-01d813e487c8 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:50.270428 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d2fb0-2b66-4b7e-86c8-01d813e487c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:50.270712 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d2fb0-2b66-4b7e-86c8-01d813e487c8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:50.271512 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d2fb0-2b66-4b7e-86c8-01d813e487c8 admin admin] RBAC: Adding query filter params (role.id=cb40c4204c4e49d8b874875a1a860a9c, scope.project.id=da81f6b96b55426c97bf64a1a3847193, user.id=7a0c9dc56e154415a03704cd0f1b81e6) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:48:50.271820 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d2fb0-2b66-4b7e-86c8-01d813e487c8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:50.297558 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d2fb0-2b66-4b7e-86c8-01d813e487c8 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:50.303076 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 76/152] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:48:50 2021] GET /identity/v3/role_assignments?user.id=7a0c9dc56e154415a03704cd0f1b81e6&scope.project.id=da81f6b96b55426c97bf64a1a3847193&role.id=cb40c4204c4e49d8b874875a1a860a9c => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:52.265533 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd096b-d4d7-4b89-b085-7ac12457b84e None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:52.265959 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd096b-d4d7-4b89-b085-7ac12457b84e None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:52.266100 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd096b-d4d7-4b89-b085-7ac12457b84e None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:52.267811 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 77/153] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:48:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:48:52.272892 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005df5b2-5cce-453a-b872-2715ce424ab3 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:52.273265 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005df5b2-5cce-453a-b872-2715ce424ab3 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:52.273462 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005df5b2-5cce-453a-b872-2715ce424ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:52.295889 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-005df5b2-5cce-453a-b872-2715ce424ab3 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:48:52.297568 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-005df5b2-5cce-453a-b872-2715ce424ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:48:52.303986 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 77/154] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:48:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:48:52.325166 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd096b-d4d7-4b89-b085-7ac12457b84e None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:52.336410 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd096b-d4d7-4b89-b085-7ac12457b84e None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:52.340155 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264c2f7-799b-45ab-8c59-3a2c5e82b199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:52.340848 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264c2f7-799b-45ab-8c59-3a2c5e82b199 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:52.341137 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264c2f7-799b-45ab-8c59-3a2c5e82b199 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:52.341415 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264c2f7-799b-45ab-8c59-3a2c5e82b199 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:52.342462 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9264c2f7-799b-45ab-8c59-3a2c5e82b199 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:52.368251 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9264c2f7-799b-45ab-8c59-3a2c5e82b199 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:52.369653 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 78/155] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:48:52 2021] GET /identity/v3/domains/default => generated 199 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:52.374632 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005df5b2-5cce-453a-b872-2715ce424ab3 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:52.382907 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005df5b2-5cce-453a-b872-2715ce424ab3 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:52.386747 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4a256-6a4d-4121-b8cd-49c8348362e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:52.387321 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4a256-6a4d-4121-b8cd-49c8348362e9 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:52.387634 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4a256-6a4d-4121-b8cd-49c8348362e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:52.387921 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4a256-6a4d-4121-b8cd-49c8348362e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:52.388572 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4a256-6a4d-4121-b8cd-49c8348362e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:52.414574 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4a256-6a4d-4121-b8cd-49c8348362e9 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:52.439409 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 78/156] 10.222.0.89 () {60 vars in 1162 bytes} [Wed Oct 27 14:48:52 2021] POST /identity/v3/projects => generated 302 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:48:54.388940 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acca480-7dea-4a55-9b39-88f9870f7076 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:54.389418 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acca480-7dea-4a55-9b39-88f9870f7076 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:54.389502 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acca480-7dea-4a55-9b39-88f9870f7076 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:54.391798 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 79/157] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:48:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:48:54.396794 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859e798-c54a-459b-afab-e24ed533df3f None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:54.397157 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859e798-c54a-459b-afab-e24ed533df3f None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:54.397369 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2859e798-c54a-459b-afab-e24ed533df3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:54.418970 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-2859e798-c54a-459b-afab-e24ed533df3f None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:48:54.420140 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-2859e798-c54a-459b-afab-e24ed533df3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:48:54.482181 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 79/158] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:48:54 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:48:54.505213 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acca480-7dea-4a55-9b39-88f9870f7076 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:54.516526 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acca480-7dea-4a55-9b39-88f9870f7076 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:54.520240 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d32f5d7-3933-4077-bfaa-84eb63516e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:54.520940 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32f5d7-3933-4077-bfaa-84eb63516e60 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:54.521230 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32f5d7-3933-4077-bfaa-84eb63516e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:54.521513 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d32f5d7-3933-4077-bfaa-84eb63516e60 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:54.522553 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d32f5d7-3933-4077-bfaa-84eb63516e60 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:54.548912 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d32f5d7-3933-4077-bfaa-84eb63516e60 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:54.550315 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 80/159] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:48:54 2021] GET /identity/v3/domains/default => generated 199 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:54.555281 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859e798-c54a-459b-afab-e24ed533df3f None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:54.563565 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2859e798-c54a-459b-afab-e24ed533df3f None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:54.567390 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ff821-9043-4e0b-8370-97c6f2d0f450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:54.567999 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ff821-9043-4e0b-8370-97c6f2d0f450 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:54.568284 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ff821-9043-4e0b-8370-97c6f2d0f450 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:54.568559 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ff821-9043-4e0b-8370-97c6f2d0f450 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:54.569205 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ff821-9043-4e0b-8370-97c6f2d0f450 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:54.594533 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ff821-9043-4e0b-8370-97c6f2d0f450 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:54.612828 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 80/160] 10.222.0.89 () {60 vars in 1153 bytes} [Wed Oct 27 14:48:54 2021] POST /identity/v3/users => generated 283 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:48:56.568680 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed70bfc-8d60-4d37-b9e4-6017d8f715b1 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:56.569166 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed70bfc-8d60-4d37-b9e4-6017d8f715b1 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:56.569166 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed70bfc-8d60-4d37-b9e4-6017d8f715b1 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:56.570818 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 81/161] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:48:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:48:56.575978 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfa088-29cc-492e-908e-d7d1b1bb9f3e None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:56.576382 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfa088-29cc-492e-908e-d7d1b1bb9f3e None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:56.576546 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cfa088-29cc-492e-908e-d7d1b1bb9f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:56.599006 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-42cfa088-29cc-492e-908e-d7d1b1bb9f3e None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:48:56.600161 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-42cfa088-29cc-492e-908e-d7d1b1bb9f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:48:56.606615 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 81/162] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:48:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:48:56.628471 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed70bfc-8d60-4d37-b9e4-6017d8f715b1 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:56.639631 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed70bfc-8d60-4d37-b9e4-6017d8f715b1 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:56.643361 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0aaeb-ba6d-4ad1-be11-ccfac408bc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:56.644079 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0aaeb-ba6d-4ad1-be11-ccfac408bc30 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:56.644359 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0aaeb-ba6d-4ad1-be11-ccfac408bc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:56.644634 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0aaeb-ba6d-4ad1-be11-ccfac408bc30 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:56.656654 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce0aaeb-ba6d-4ad1-be11-ccfac408bc30 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:48:56.662791 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-5ce0aaeb-ba6d-4ad1-be11-ccfac408bc30 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 14:48:56.663866 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 82/163] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:48:56 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:48:56.669267 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfa088-29cc-492e-908e-d7d1b1bb9f3e None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:56.678195 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cfa088-29cc-492e-908e-d7d1b1bb9f3e None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:56.682101 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f1d1e-e960-41e1-ab9d-dc8abd587f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:56.682691 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f1d1e-e960-41e1-ab9d-dc8abd587f1f admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:56.682980 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f1d1e-e960-41e1-ab9d-dc8abd587f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:56.683260 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f1d1e-e960-41e1-ab9d-dc8abd587f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:56.684007 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f1d1e-e960-41e1-ab9d-dc8abd587f1f admin admin] RBAC: Adding query filter params (name=member) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:48:56.684308 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f1d1e-e960-41e1-ab9d-dc8abd587f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:56.709049 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f1d1e-e960-41e1-ab9d-dc8abd587f1f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:56.717350 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 82/164] 10.222.0.89 () {56 vars in 1122 bytes} [Wed Oct 27 14:48:56 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:56.723024 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0aaeb-ba6d-4ad1-be11-ccfac408bc30 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:56.731995 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0aaeb-ba6d-4ad1-be11-ccfac408bc30 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:56.736453 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16eabb-b07b-4693-a97a-9c500aac60a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:56.737212 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16eabb-b07b-4693-a97a-9c500aac60a1 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:56.737497 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16eabb-b07b-4693-a97a-9c500aac60a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:56.737781 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16eabb-b07b-4693-a97a-9c500aac60a1 admin admin] PATH_INFO: `/v3/users/3d6d5c3a153c45f19a677d9902ebcf2a` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:56.755426 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16eabb-b07b-4693-a97a-9c500aac60a1 admin admin] RBAC: Authorizing `identity:get_user(user_id=3d6d5c3a153c45f19a677d9902ebcf2a)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:56.781442 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e16eabb-b07b-4693-a97a-9c500aac60a1 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:56.782877 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 83/165] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:48:56 2021] GET /identity/v3/users/3d6d5c3a153c45f19a677d9902ebcf2a => generated 283 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:56.788180 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f1d1e-e960-41e1-ab9d-dc8abd587f1f admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:56.797485 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f1d1e-e960-41e1-ab9d-dc8abd587f1f admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:56.801358 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb7257-dbd9-46bc-892e-c589194dc102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:56.801918 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb7257-dbd9-46bc-892e-c589194dc102 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:56.802206 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb7257-dbd9-46bc-892e-c589194dc102 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:56.802488 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb7257-dbd9-46bc-892e-c589194dc102 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:56.809949 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb7257-dbd9-46bc-892e-c589194dc102 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:56.835834 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfb7257-dbd9-46bc-892e-c589194dc102 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:56.844104 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 83/166] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:48:56 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:48:56.849389 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16eabb-b07b-4693-a97a-9c500aac60a1 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:56.858874 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16eabb-b07b-4693-a97a-9c500aac60a1 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:56.862727 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6e0d3-478f-49f6-884b-0d1ee6da879e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:56.863523 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6e0d3-478f-49f6-884b-0d1ee6da879e admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:56.863808 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6e0d3-478f-49f6-884b-0d1ee6da879e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:56.864087 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6e0d3-478f-49f6-884b-0d1ee6da879e admin admin] PATH_INFO: `/v3/projects/cdc84d93949743579c8913af0813494a` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:56.865142 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6e0d3-478f-49f6-884b-0d1ee6da879e admin admin] RBAC: Authorizing `identity:get_project(project_id=cdc84d93949743579c8913af0813494a)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:56.891197 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6e0d3-478f-49f6-884b-0d1ee6da879e admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:56.892701 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 84/167] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:48:56 2021] GET /identity/v3/projects/cdc84d93949743579c8913af0813494a => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:56.897808 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb7257-dbd9-46bc-892e-c589194dc102 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:56.905995 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb7257-dbd9-46bc-892e-c589194dc102 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:56.909882 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb27a1-52f2-4b94-b5f5-de99b012c459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:56.910445 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb27a1-52f2-4b94-b5f5-de99b012c459 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:56.910733 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb27a1-52f2-4b94-b5f5-de99b012c459 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:56.911012 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb27a1-52f2-4b94-b5f5-de99b012c459 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:56.911823 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fb27a1-52f2-4b94-b5f5-de99b012c459 admin admin] RBAC: Adding query filter params (role.id=cb40c4204c4e49d8b874875a1a860a9c, scope.project.id=cdc84d93949743579c8913af0813494a, user.id=3d6d5c3a153c45f19a677d9902ebcf2a) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:48:56.912127 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fb27a1-52f2-4b94-b5f5-de99b012c459 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:56.938372 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fb27a1-52f2-4b94-b5f5-de99b012c459 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:56.943539 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 84/168] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:48:56 2021] GET /identity/v3/role_assignments?user.id=3d6d5c3a153c45f19a677d9902ebcf2a&scope.project.id=cdc84d93949743579c8913af0813494a&role.id=cb40c4204c4e49d8b874875a1a860a9c => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:58.861722 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fe4b7-6fdf-4865-95a6-d80cb70d0635 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:58.862236 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fe4b7-6fdf-4865-95a6-d80cb70d0635 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:58.862322 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fe4b7-6fdf-4865-95a6-d80cb70d0635 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:58.864003 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 85/169] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:48:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:48:58.869109 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b819651-4eea-4965-aaab-b3289409b8a2 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:58.869527 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b819651-4eea-4965-aaab-b3289409b8a2 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:58.869665 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b819651-4eea-4965-aaab-b3289409b8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:58.892189 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-1b819651-4eea-4965-aaab-b3289409b8a2 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:48:58.893309 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-1b819651-4eea-4965-aaab-b3289409b8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:48:58.899729 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 85/170] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:48:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:48:58.921694 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fe4b7-6fdf-4865-95a6-d80cb70d0635 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:58.933078 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fe4b7-6fdf-4865-95a6-d80cb70d0635 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:58.936932 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9aa3e1-b60a-4b94-b034-e786a51103a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:58.937640 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9aa3e1-b60a-4b94-b034-e786a51103a3 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:58.937933 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9aa3e1-b60a-4b94-b034-e786a51103a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:58.938213 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9aa3e1-b60a-4b94-b034-e786a51103a3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:58.949079 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9aa3e1-b60a-4b94-b034-e786a51103a3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:48:58.955352 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-0f9aa3e1-b60a-4b94-b034-e786a51103a3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 14:48:58.956438 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 86/171] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:48:58 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:48:58.961814 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b819651-4eea-4965-aaab-b3289409b8a2 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:58.970583 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b819651-4eea-4965-aaab-b3289409b8a2 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:58.974406 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca1134-4bfd-477b-ac87-14433caf29ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:58.974986 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca1134-4bfd-477b-ac87-14433caf29ea admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:58.975271 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca1134-4bfd-477b-ac87-14433caf29ea admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:58.975579 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca1134-4bfd-477b-ac87-14433caf29ea admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:58.976280 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca1134-4bfd-477b-ac87-14433caf29ea admin admin] RBAC: Adding query filter params (name=member) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:48:58.976574 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca1134-4bfd-477b-ac87-14433caf29ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:59.001928 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca1134-4bfd-477b-ac87-14433caf29ea admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:59.010266 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 86/172] 10.222.0.89 () {56 vars in 1122 bytes} [Wed Oct 27 14:48:58 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:59.015275 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9aa3e1-b60a-4b94-b034-e786a51103a3 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:59.025097 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9aa3e1-b60a-4b94-b034-e786a51103a3 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:59.028972 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5df626-a7be-42ac-9904-1fb4e2478673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:59.029729 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5df626-a7be-42ac-9904-1fb4e2478673 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:59.030016 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5df626-a7be-42ac-9904-1fb4e2478673 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:59.030796 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5df626-a7be-42ac-9904-1fb4e2478673 admin admin] PATH_INFO: `/v3/users/3d6d5c3a153c45f19a677d9902ebcf2a` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:59.031912 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5df626-a7be-42ac-9904-1fb4e2478673 admin admin] RBAC: Authorizing `identity:get_user(user_id=3d6d5c3a153c45f19a677d9902ebcf2a)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:59.057349 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5df626-a7be-42ac-9904-1fb4e2478673 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:59.058768 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 87/173] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:48:59 2021] GET /identity/v3/users/3d6d5c3a153c45f19a677d9902ebcf2a => generated 283 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:59.064207 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca1134-4bfd-477b-ac87-14433caf29ea admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:59.072962 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca1134-4bfd-477b-ac87-14433caf29ea admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:59.076788 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a566cc-5f22-41e4-b35e-ffe64306d1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:59.077626 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a566cc-5f22-41e4-b35e-ffe64306d1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:59.077911 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a566cc-5f22-41e4-b35e-ffe64306d1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:59.078188 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a566cc-5f22-41e4-b35e-ffe64306d1e8 admin admin] PATH_INFO: `/v3/projects/cdc84d93949743579c8913af0813494a` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:59.079244 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a566cc-5f22-41e4-b35e-ffe64306d1e8 admin admin] RBAC: Authorizing `identity:get_project(project_id=cdc84d93949743579c8913af0813494a)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:59.104760 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a566cc-5f22-41e4-b35e-ffe64306d1e8 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:59.106215 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 87/174] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:48:59 2021] GET /identity/v3/projects/cdc84d93949743579c8913af0813494a => generated 302 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:48:59.111662 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5df626-a7be-42ac-9904-1fb4e2478673 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:48:59.120586 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5df626-a7be-42ac-9904-1fb4e2478673 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:48:59.124349 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269502d-7678-4893-8e4f-6a6e25758622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:48:59.125124 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269502d-7678-4893-8e4f-6a6e25758622 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:48:59.125409 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269502d-7678-4893-8e4f-6a6e25758622 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:48:59.125686 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269502d-7678-4893-8e4f-6a6e25758622 admin admin] PATH_INFO: `/v3/projects/cdc84d93949743579c8913af0813494a/users/3d6d5c3a153c45f19a677d9902ebcf2a/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:48:59.127358 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269502d-7678-4893-8e4f-6a6e25758622 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdc84d93949743579c8913af0813494a, user_id=3d6d5c3a153c45f19a677d9902ebcf2a, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:48:59.153570 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269502d-7678-4893-8e4f-6a6e25758622 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:48:59.166392 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 88/175] 10.222.0.89 () {58 vars in 1460 bytes} [Wed Oct 27 14:48:59 2021] PUT /identity/v3/projects/cdc84d93949743579c8913af0813494a/users/3d6d5c3a153c45f19a677d9902ebcf2a/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:49:01.097764 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e82fd-8e3b-4a8d-a9fa-1af84603081d None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:01.098329 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e82fd-8e3b-4a8d-a9fa-1af84603081d None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:01.098329 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e82fd-8e3b-4a8d-a9fa-1af84603081d None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:01.100026 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 88/176] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:49:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:49:01.105106 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40270e-f209-40a8-a89f-d79c473a3fef None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:01.105486 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40270e-f209-40a8-a89f-d79c473a3fef None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:01.105681 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40270e-f209-40a8-a89f-d79c473a3fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:01.128202 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-be40270e-f209-40a8-a89f-d79c473a3fef None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:49:01.129325 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-be40270e-f209-40a8-a89f-d79c473a3fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:49:01.192069 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 89/177] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:49:01 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:49:01.213757 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e82fd-8e3b-4a8d-a9fa-1af84603081d None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:01.225577 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e82fd-8e3b-4a8d-a9fa-1af84603081d None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:01.229388 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a148c9f-cb8c-457d-9b72-0a33fb6711ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:01.230095 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a148c9f-cb8c-457d-9b72-0a33fb6711ef admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:01.230381 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a148c9f-cb8c-457d-9b72-0a33fb6711ef admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:01.230662 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a148c9f-cb8c-457d-9b72-0a33fb6711ef admin admin] PATH_INFO: `/v3/roles/member` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:01.242956 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a148c9f-cb8c-457d-9b72-0a33fb6711ef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:49:01.249754 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-7a148c9f-cb8c-457d-9b72-0a33fb6711ef admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 14:49:01.250818 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 89/178] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:49:01 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:49:01.256201 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40270e-f209-40a8-a89f-d79c473a3fef None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:01.265385 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be40270e-f209-40a8-a89f-d79c473a3fef None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:01.269312 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233307b-f306-43b1-a036-29de8f8f934b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:01.269903 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233307b-f306-43b1-a036-29de8f8f934b admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:01.270191 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233307b-f306-43b1-a036-29de8f8f934b admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:01.270474 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233307b-f306-43b1-a036-29de8f8f934b admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:01.271182 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0233307b-f306-43b1-a036-29de8f8f934b admin admin] RBAC: Adding query filter params (name=member) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:01.271552 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0233307b-f306-43b1-a036-29de8f8f934b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:01.296632 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0233307b-f306-43b1-a036-29de8f8f934b admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:01.304939 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 90/179] 10.222.0.89 () {56 vars in 1122 bytes} [Wed Oct 27 14:49:01 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:01.310351 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a148c9f-cb8c-457d-9b72-0a33fb6711ef admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:01.320046 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a148c9f-cb8c-457d-9b72-0a33fb6711ef admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:01.324264 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d87d90-5f8f-43af-9196-07cdf77be635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:01.325036 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d87d90-5f8f-43af-9196-07cdf77be635 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:01.325320 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d87d90-5f8f-43af-9196-07cdf77be635 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:01.325595 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d87d90-5f8f-43af-9196-07cdf77be635 admin admin] PATH_INFO: `/v3/users/3d6d5c3a153c45f19a677d9902ebcf2a` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:01.326673 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d87d90-5f8f-43af-9196-07cdf77be635 admin admin] RBAC: Authorizing `identity:get_user(user_id=3d6d5c3a153c45f19a677d9902ebcf2a)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:01.352615 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d87d90-5f8f-43af-9196-07cdf77be635 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:01.354016 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 90/180] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:49:01 2021] GET /identity/v3/users/3d6d5c3a153c45f19a677d9902ebcf2a => generated 283 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:01.359570 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233307b-f306-43b1-a036-29de8f8f934b admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:01.368535 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233307b-f306-43b1-a036-29de8f8f934b admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:01.372365 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a5e4c-681b-43dd-8218-547bab02607c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:01.372920 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a5e4c-681b-43dd-8218-547bab02607c admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:01.373209 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a5e4c-681b-43dd-8218-547bab02607c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:01.373493 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a5e4c-681b-43dd-8218-547bab02607c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:01.381596 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a5e4c-681b-43dd-8218-547bab02607c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:01.406375 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a5e4c-681b-43dd-8218-547bab02607c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:01.414606 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 91/181] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:49:01 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:49:01.419817 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d87d90-5f8f-43af-9196-07cdf77be635 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:01.429042 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d87d90-5f8f-43af-9196-07cdf77be635 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:01.432809 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629c2d2-0b09-4bd9-99e9-5f059b2faa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:01.433551 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629c2d2-0b09-4bd9-99e9-5f059b2faa9d admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:01.433838 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629c2d2-0b09-4bd9-99e9-5f059b2faa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:01.434118 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629c2d2-0b09-4bd9-99e9-5f059b2faa9d admin admin] PATH_INFO: `/v3/projects/cdc84d93949743579c8913af0813494a` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:01.435164 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629c2d2-0b09-4bd9-99e9-5f059b2faa9d admin admin] RBAC: Authorizing `identity:get_project(project_id=cdc84d93949743579c8913af0813494a)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:01.460764 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629c2d2-0b09-4bd9-99e9-5f059b2faa9d admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:01.462213 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 91/182] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:49:01 2021] GET /identity/v3/projects/cdc84d93949743579c8913af0813494a => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:01.467180 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a5e4c-681b-43dd-8218-547bab02607c admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:01.475217 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a5e4c-681b-43dd-8218-547bab02607c admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:01.479017 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d3727-daae-409f-b219-440197c11ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:01.479625 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d3727-daae-409f-b219-440197c11ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:01.479910 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d3727-daae-409f-b219-440197c11ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:01.480185 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d3727-daae-409f-b219-440197c11ad0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:01.480935 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d3727-daae-409f-b219-440197c11ad0 admin admin] RBAC: Adding query filter params (role.id=cb40c4204c4e49d8b874875a1a860a9c, scope.project.id=cdc84d93949743579c8913af0813494a, user.id=3d6d5c3a153c45f19a677d9902ebcf2a) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:01.481232 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d3727-daae-409f-b219-440197c11ad0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:01.507093 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d3727-daae-409f-b219-440197c11ad0 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:01.512563 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 92/183] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:49:01 2021] GET /identity/v3/role_assignments?user.id=3d6d5c3a153c45f19a677d9902ebcf2a&scope.project.id=cdc84d93949743579c8913af0813494a&role.id=cb40c4204c4e49d8b874875a1a860a9c => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:03.478339 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c99c7-33ad-4456-b726-c778a4095850 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:03.478868 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c99c7-33ad-4456-b726-c778a4095850 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:03.478868 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c99c7-33ad-4456-b726-c778a4095850 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:03.480567 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 92/184] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:49:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:49:03.486230 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80077d-17d5-4927-aa24-718a11cb4cdc None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:03.486668 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80077d-17d5-4927-aa24-718a11cb4cdc None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:03.486791 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b80077d-17d5-4927-aa24-718a11cb4cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:03.509249 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-9b80077d-17d5-4927-aa24-718a11cb4cdc None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:49:03.510309 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-9b80077d-17d5-4927-aa24-718a11cb4cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:49:03.516925 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 93/185] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:49:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:49:03.538811 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c99c7-33ad-4456-b726-c778a4095850 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:03.550887 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c99c7-33ad-4456-b726-c778a4095850 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:03.554588 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08339a73-4b00-4165-8549-cea364e57701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:03.555286 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08339a73-4b00-4165-8549-cea364e57701 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:03.555605 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08339a73-4b00-4165-8549-cea364e57701 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:03.555885 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08339a73-4b00-4165-8549-cea364e57701 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:03.566663 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08339a73-4b00-4165-8549-cea364e57701 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:49:03.572773 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-08339a73-4b00-4165-8549-cea364e57701 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 14:49:03.573824 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 93/186] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:49:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:49:03.579039 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80077d-17d5-4927-aa24-718a11cb4cdc None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:03.587476 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b80077d-17d5-4927-aa24-718a11cb4cdc None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:03.591335 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b8047-f45d-4bfd-8695-67a504c93685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:03.591954 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b8047-f45d-4bfd-8695-67a504c93685 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:03.592245 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b8047-f45d-4bfd-8695-67a504c93685 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:03.592524 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b8047-f45d-4bfd-8695-67a504c93685 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:03.593739 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b8047-f45d-4bfd-8695-67a504c93685 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:03.594036 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b8047-f45d-4bfd-8695-67a504c93685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:03.619461 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b8047-f45d-4bfd-8695-67a504c93685 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:03.627954 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 94/187] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:49:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:03.633465 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08339a73-4b00-4165-8549-cea364e57701 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:03.643906 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08339a73-4b00-4165-8549-cea364e57701 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:03.647638 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c9843-228e-40cc-83a0-e7ab773b917a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:03.648407 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c9843-228e-40cc-83a0-e7ab773b917a admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:03.648687 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c9843-228e-40cc-83a0-e7ab773b917a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:03.648958 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c9843-228e-40cc-83a0-e7ab773b917a admin admin] PATH_INFO: `/v3/users/99b1f8461d2e454c9cd6d6d3c9dc623c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:03.650009 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c9843-228e-40cc-83a0-e7ab773b917a admin admin] RBAC: Authorizing `identity:get_user(user_id=99b1f8461d2e454c9cd6d6d3c9dc623c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:03.676075 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c9843-228e-40cc-83a0-e7ab773b917a admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:03.677480 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 94/188] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:49:03 2021] GET /identity/v3/users/99b1f8461d2e454c9cd6d6d3c9dc623c => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:03.682320 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b8047-f45d-4bfd-8695-67a504c93685 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:03.691855 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b8047-f45d-4bfd-8695-67a504c93685 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:03.695714 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4c5fa-f9f8-4fda-b6f6-f9377a85d66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:03.696278 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4c5fa-f9f8-4fda-b6f6-f9377a85d66d admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:03.696567 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4c5fa-f9f8-4fda-b6f6-f9377a85d66d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:03.696849 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4c5fa-f9f8-4fda-b6f6-f9377a85d66d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:03.704366 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4c5fa-f9f8-4fda-b6f6-f9377a85d66d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:03.729162 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4c5fa-f9f8-4fda-b6f6-f9377a85d66d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:03.737894 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 95/189] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:49:03 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:49:03.742871 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c9843-228e-40cc-83a0-e7ab773b917a admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:03.752196 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c9843-228e-40cc-83a0-e7ab773b917a admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:03.755918 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96208566-9b3b-4c6a-a91e-a6f13c91c28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:03.756659 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96208566-9b3b-4c6a-a91e-a6f13c91c28a admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:03.756943 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96208566-9b3b-4c6a-a91e-a6f13c91c28a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:03.757215 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96208566-9b3b-4c6a-a91e-a6f13c91c28a admin admin] PATH_INFO: `/v3/projects/cdc84d93949743579c8913af0813494a` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:03.758249 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96208566-9b3b-4c6a-a91e-a6f13c91c28a admin admin] RBAC: Authorizing `identity:get_project(project_id=cdc84d93949743579c8913af0813494a)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:03.783123 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96208566-9b3b-4c6a-a91e-a6f13c91c28a admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:03.784549 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 95/190] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:49:03 2021] GET /identity/v3/projects/cdc84d93949743579c8913af0813494a => generated 302 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:03.789544 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4c5fa-f9f8-4fda-b6f6-f9377a85d66d admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:03.798353 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4c5fa-f9f8-4fda-b6f6-f9377a85d66d admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:03.802193 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a904f4-874e-4444-b574-5409307eabbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:03.802739 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a904f4-874e-4444-b574-5409307eabbf admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:03.803028 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a904f4-874e-4444-b574-5409307eabbf admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:03.803308 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a904f4-874e-4444-b574-5409307eabbf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:03.804107 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a904f4-874e-4444-b574-5409307eabbf admin admin] RBAC: Adding query filter params (role.id=c243fbeb99ae4f51910f72ddc1773778, scope.project.id=cdc84d93949743579c8913af0813494a, user.id=99b1f8461d2e454c9cd6d6d3c9dc623c) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:03.804411 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a904f4-874e-4444-b574-5409307eabbf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:03.829898 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a904f4-874e-4444-b574-5409307eabbf admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:03.835080 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 96/191] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:49:03 2021] GET /identity/v3/role_assignments?user.id=99b1f8461d2e454c9cd6d6d3c9dc623c&scope.project.id=cdc84d93949743579c8913af0813494a&role.id=c243fbeb99ae4f51910f72ddc1773778 => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:05.742405 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54ff96-f661-4cb0-a129-f4b776a1274f None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:05.742940 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54ff96-f661-4cb0-a129-f4b776a1274f None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:05.743027 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a54ff96-f661-4cb0-a129-f4b776a1274f None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:05.744780 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 96/192] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:49:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:49:05.750253 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1da0c3-672f-4380-9692-ad2b80762b00 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:05.750680 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1da0c3-672f-4380-9692-ad2b80762b00 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:05.750805 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1da0c3-672f-4380-9692-ad2b80762b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:05.773086 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-1e1da0c3-672f-4380-9692-ad2b80762b00 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:49:05.774185 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-1e1da0c3-672f-4380-9692-ad2b80762b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:49:05.780606 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 97/193] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:49:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:49:05.801421 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54ff96-f661-4cb0-a129-f4b776a1274f None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:05.813188 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a54ff96-f661-4cb0-a129-f4b776a1274f None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:05.817003 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3477929-da17-4159-9ec0-d4ead57f8841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:05.817705 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3477929-da17-4159-9ec0-d4ead57f8841 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:05.817994 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3477929-da17-4159-9ec0-d4ead57f8841 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:05.818274 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3477929-da17-4159-9ec0-d4ead57f8841 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:05.829758 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3477929-da17-4159-9ec0-d4ead57f8841 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:49:05.835961 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-a3477929-da17-4159-9ec0-d4ead57f8841 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 14:49:05.837023 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 97/194] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:49:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:49:05.842149 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1da0c3-672f-4380-9692-ad2b80762b00 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:05.850903 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1da0c3-672f-4380-9692-ad2b80762b00 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:05.854869 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f67d4c-6f42-4da3-9184-0869de8345dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:05.855482 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f67d4c-6f42-4da3-9184-0869de8345dd admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:05.855774 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f67d4c-6f42-4da3-9184-0869de8345dd admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:05.856052 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f67d4c-6f42-4da3-9184-0869de8345dd admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:05.856757 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f67d4c-6f42-4da3-9184-0869de8345dd admin admin] RBAC: Adding query filter params (name=admin) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:05.857053 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f67d4c-6f42-4da3-9184-0869de8345dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:05.882835 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f67d4c-6f42-4da3-9184-0869de8345dd admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:05.891795 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 98/195] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:49:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:05.896587 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3477929-da17-4159-9ec0-d4ead57f8841 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:05.906894 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3477929-da17-4159-9ec0-d4ead57f8841 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:05.910661 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea25e2-0f4a-4b18-8aac-e90ab05dd9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:05.911419 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea25e2-0f4a-4b18-8aac-e90ab05dd9db admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:05.911734 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea25e2-0f4a-4b18-8aac-e90ab05dd9db admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:05.912015 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea25e2-0f4a-4b18-8aac-e90ab05dd9db admin admin] PATH_INFO: `/v3/users/99b1f8461d2e454c9cd6d6d3c9dc623c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:05.913079 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea25e2-0f4a-4b18-8aac-e90ab05dd9db admin admin] RBAC: Authorizing `identity:get_user(user_id=99b1f8461d2e454c9cd6d6d3c9dc623c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:05.938258 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea25e2-0f4a-4b18-8aac-e90ab05dd9db admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:05.939774 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 98/196] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:49:05 2021] GET /identity/v3/users/99b1f8461d2e454c9cd6d6d3c9dc623c => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:49:05.944849 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f67d4c-6f42-4da3-9184-0869de8345dd admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:05.954974 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f67d4c-6f42-4da3-9184-0869de8345dd admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:05.958972 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebf3fa-b791-4d3e-8bae-d6c420c711b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:05.959815 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebf3fa-b791-4d3e-8bae-d6c420c711b4 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:05.960105 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebf3fa-b791-4d3e-8bae-d6c420c711b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:05.960419 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebf3fa-b791-4d3e-8bae-d6c420c711b4 admin admin] PATH_INFO: `/v3/projects/cdc84d93949743579c8913af0813494a` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:05.961517 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebf3fa-b791-4d3e-8bae-d6c420c711b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=cdc84d93949743579c8913af0813494a)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:05.987908 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ebf3fa-b791-4d3e-8bae-d6c420c711b4 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:05.989424 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 99/197] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:49:05 2021] GET /identity/v3/projects/cdc84d93949743579c8913af0813494a => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:05.994433 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea25e2-0f4a-4b18-8aac-e90ab05dd9db admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:06.003356 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea25e2-0f4a-4b18-8aac-e90ab05dd9db admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:06.007137 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641e322-5cd6-43ce-8bd0-d462713bbb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:06.007953 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641e322-5cd6-43ce-8bd0-d462713bbb21 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:06.008244 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641e322-5cd6-43ce-8bd0-d462713bbb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:06.008523 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641e322-5cd6-43ce-8bd0-d462713bbb21 admin admin] PATH_INFO: `/v3/projects/cdc84d93949743579c8913af0813494a/users/99b1f8461d2e454c9cd6d6d3c9dc623c/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:06.010211 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641e322-5cd6-43ce-8bd0-d462713bbb21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdc84d93949743579c8913af0813494a, user_id=99b1f8461d2e454c9cd6d6d3c9dc623c, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:06.037183 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641e322-5cd6-43ce-8bd0-d462713bbb21 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:06.049450 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 99/198] 10.222.0.89 () {58 vars in 1460 bytes} [Wed Oct 27 14:49:05 2021] PUT /identity/v3/projects/cdc84d93949743579c8913af0813494a/users/99b1f8461d2e454c9cd6d6d3c9dc623c/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:49:07.993641 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f2f0b-65b8-4dfa-9310-22058c5008d6 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:07.994159 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f2f0b-65b8-4dfa-9310-22058c5008d6 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:07.994267 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f2f0b-65b8-4dfa-9310-22058c5008d6 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:07.995908 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 100/199] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:49:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:49:08.001564 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd2abf-2926-4069-9eb2-604d5538861e None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:08.001972 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd2abf-2926-4069-9eb2-604d5538861e None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:08.002125 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd2abf-2926-4069-9eb2-604d5538861e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:08.024484 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-cebd2abf-2926-4069-9eb2-604d5538861e None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:49:08.025595 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-cebd2abf-2926-4069-9eb2-604d5538861e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:49:08.088814 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 100/200] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:49:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:49:08.110992 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f2f0b-65b8-4dfa-9310-22058c5008d6 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:08.122312 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f2f0b-65b8-4dfa-9310-22058c5008d6 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:08.126699 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056f571-cc8f-469e-a20d-a1f452404849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:08.127402 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056f571-cc8f-469e-a20d-a1f452404849 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:08.127737 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056f571-cc8f-469e-a20d-a1f452404849 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:08.128016 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056f571-cc8f-469e-a20d-a1f452404849 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:08.139664 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1056f571-cc8f-469e-a20d-a1f452404849 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:49:08.145829 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-1056f571-cc8f-469e-a20d-a1f452404849 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 14:49:08.146884 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 101/201] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:49:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:49:08.152037 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd2abf-2926-4069-9eb2-604d5538861e None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:08.160270 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebd2abf-2926-4069-9eb2-604d5538861e None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:08.164090 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678fa14-e54a-4085-9d0c-1e1d3eb8e488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:08.164927 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678fa14-e54a-4085-9d0c-1e1d3eb8e488 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:08.165219 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678fa14-e54a-4085-9d0c-1e1d3eb8e488 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:08.165497 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678fa14-e54a-4085-9d0c-1e1d3eb8e488 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:08.166196 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678fa14-e54a-4085-9d0c-1e1d3eb8e488 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:08.166492 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678fa14-e54a-4085-9d0c-1e1d3eb8e488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:08.192286 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678fa14-e54a-4085-9d0c-1e1d3eb8e488 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:08.200512 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 101/202] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:49:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:08.205649 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056f571-cc8f-469e-a20d-a1f452404849 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:08.214559 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056f571-cc8f-469e-a20d-a1f452404849 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:08.218340 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5828bd-533e-4029-8987-292492c54dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:08.219105 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5828bd-533e-4029-8987-292492c54dbc admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:08.219390 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5828bd-533e-4029-8987-292492c54dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:08.219705 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5828bd-533e-4029-8987-292492c54dbc admin admin] PATH_INFO: `/v3/users/99b1f8461d2e454c9cd6d6d3c9dc623c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:08.220790 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5828bd-533e-4029-8987-292492c54dbc admin admin] RBAC: Authorizing `identity:get_user(user_id=99b1f8461d2e454c9cd6d6d3c9dc623c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:08.246285 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5828bd-533e-4029-8987-292492c54dbc admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:08.247679 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 102/203] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:49:08 2021] GET /identity/v3/users/99b1f8461d2e454c9cd6d6d3c9dc623c => generated 247 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:08.253305 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678fa14-e54a-4085-9d0c-1e1d3eb8e488 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:08.262404 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678fa14-e54a-4085-9d0c-1e1d3eb8e488 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:08.266177 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b83b7e-27f8-4b52-a8b8-190552813a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:08.266741 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b83b7e-27f8-4b52-a8b8-190552813a79 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:08.267027 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b83b7e-27f8-4b52-a8b8-190552813a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:08.267307 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b83b7e-27f8-4b52-a8b8-190552813a79 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:08.274728 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b83b7e-27f8-4b52-a8b8-190552813a79 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:08.300508 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b83b7e-27f8-4b52-a8b8-190552813a79 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:08.308972 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 102/204] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:49:08 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:49:08.314098 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5828bd-533e-4029-8987-292492c54dbc admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:08.323161 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5828bd-533e-4029-8987-292492c54dbc admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:08.327521 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6105e-b635-4ecc-9c7e-486d793fbd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:08.328286 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6105e-b635-4ecc-9c7e-486d793fbd3e admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:08.328572 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6105e-b635-4ecc-9c7e-486d793fbd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:08.328850 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6105e-b635-4ecc-9c7e-486d793fbd3e admin admin] PATH_INFO: `/v3/projects/cdc84d93949743579c8913af0813494a` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:08.329909 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6105e-b635-4ecc-9c7e-486d793fbd3e admin admin] RBAC: Authorizing `identity:get_project(project_id=cdc84d93949743579c8913af0813494a)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:08.355761 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6105e-b635-4ecc-9c7e-486d793fbd3e admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:08.357245 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 103/205] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:49:08 2021] GET /identity/v3/projects/cdc84d93949743579c8913af0813494a => generated 302 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:08.362811 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b83b7e-27f8-4b52-a8b8-190552813a79 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:08.371093 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b83b7e-27f8-4b52-a8b8-190552813a79 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:08.375553 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c98ac1-c54d-477e-9083-daeb0040547f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:08.376112 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c98ac1-c54d-477e-9083-daeb0040547f admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:08.376401 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c98ac1-c54d-477e-9083-daeb0040547f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:08.376679 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c98ac1-c54d-477e-9083-daeb0040547f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:08.377441 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c98ac1-c54d-477e-9083-daeb0040547f admin admin] RBAC: Adding query filter params (role.id=c243fbeb99ae4f51910f72ddc1773778, scope.project.id=cdc84d93949743579c8913af0813494a, user.id=99b1f8461d2e454c9cd6d6d3c9dc623c) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:08.377740 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c98ac1-c54d-477e-9083-daeb0040547f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:08.402646 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c98ac1-c54d-477e-9083-daeb0040547f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:08.408226 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 103/206] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:49:08 2021] GET /identity/v3/role_assignments?user.id=99b1f8461d2e454c9cd6d6d3c9dc623c&scope.project.id=cdc84d93949743579c8913af0813494a&role.id=c243fbeb99ae4f51910f72ddc1773778 => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:10.381972 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c932a6-e11b-4009-b6a2-648fdd4d9dcb None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:10.382443 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c932a6-e11b-4009-b6a2-648fdd4d9dcb None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:10.382526 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c932a6-e11b-4009-b6a2-648fdd4d9dcb None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:10.384216 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 104/207] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:49:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:49:10.389257 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93477b5c-7e93-47ab-82f7-c9513ea85806 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:10.390172 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93477b5c-7e93-47ab-82f7-c9513ea85806 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:10.390317 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93477b5c-7e93-47ab-82f7-c9513ea85806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:10.412724 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-93477b5c-7e93-47ab-82f7-c9513ea85806 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:49:10.413851 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-93477b5c-7e93-47ab-82f7-c9513ea85806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:49:10.420650 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 104/208] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:49:10 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:49:10.442074 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c932a6-e11b-4009-b6a2-648fdd4d9dcb None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:10.453748 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c932a6-e11b-4009-b6a2-648fdd4d9dcb None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:10.457420 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7986886-8398-4842-8815-c476ed964ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:10.458155 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7986886-8398-4842-8815-c476ed964ddb admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:10.458438 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7986886-8398-4842-8815-c476ed964ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:10.458710 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7986886-8398-4842-8815-c476ed964ddb admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:10.470337 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7986886-8398-4842-8815-c476ed964ddb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:49:10.476875 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-e7986886-8398-4842-8815-c476ed964ddb admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 14:49:10.477957 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 105/209] 10.222.0.89 () {56 vars in 1135 bytes} [Wed Oct 27 14:49:10 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:49:10.483126 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93477b5c-7e93-47ab-82f7-c9513ea85806 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:10.491392 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93477b5c-7e93-47ab-82f7-c9513ea85806 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:10.495206 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09502ec6-7b0d-4349-97ac-b59bf8fc1328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:10.495896 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09502ec6-7b0d-4349-97ac-b59bf8fc1328 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:10.496186 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09502ec6-7b0d-4349-97ac-b59bf8fc1328 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:10.496465 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09502ec6-7b0d-4349-97ac-b59bf8fc1328 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:10.497174 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09502ec6-7b0d-4349-97ac-b59bf8fc1328 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:10.497471 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09502ec6-7b0d-4349-97ac-b59bf8fc1328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:10.522738 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09502ec6-7b0d-4349-97ac-b59bf8fc1328 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:10.531452 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 105/210] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:49:10 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:10.536527 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7986886-8398-4842-8815-c476ed964ddb admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:10.548064 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7986886-8398-4842-8815-c476ed964ddb admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:10.551831 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d369cc4-c839-499d-9654-9e0faa0df7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:10.552592 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d369cc4-c839-499d-9654-9e0faa0df7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:10.552877 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d369cc4-c839-499d-9654-9e0faa0df7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:10.553150 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d369cc4-c839-499d-9654-9e0faa0df7a0 admin admin] PATH_INFO: `/v3/users/3d6d5c3a153c45f19a677d9902ebcf2a` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:10.554208 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d369cc4-c839-499d-9654-9e0faa0df7a0 admin admin] RBAC: Authorizing `identity:get_user(user_id=3d6d5c3a153c45f19a677d9902ebcf2a)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:10.579704 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d369cc4-c839-499d-9654-9e0faa0df7a0 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:10.581118 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 106/211] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:49:10 2021] GET /identity/v3/users/3d6d5c3a153c45f19a677d9902ebcf2a => generated 283 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:10.585888 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09502ec6-7b0d-4349-97ac-b59bf8fc1328 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:10.595272 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09502ec6-7b0d-4349-97ac-b59bf8fc1328 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:10.599098 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe103f4-a056-4ed7-9964-199c808c4ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:10.599694 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe103f4-a056-4ed7-9964-199c808c4ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:10.600011 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe103f4-a056-4ed7-9964-199c808c4ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:10.600292 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe103f4-a056-4ed7-9964-199c808c4ff0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:10.607743 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe103f4-a056-4ed7-9964-199c808c4ff0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:10.632390 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe103f4-a056-4ed7-9964-199c808c4ff0 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:10.641097 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 106/212] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:49:10 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:49:10.645890 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d369cc4-c839-499d-9654-9e0faa0df7a0 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:10.654637 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d369cc4-c839-499d-9654-9e0faa0df7a0 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:10.658996 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9f51ca-514d-4d2d-a0e8-3f2a4ee10549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:10.659775 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f51ca-514d-4d2d-a0e8-3f2a4ee10549 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:10.660061 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f51ca-514d-4d2d-a0e8-3f2a4ee10549 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:10.660334 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f51ca-514d-4d2d-a0e8-3f2a4ee10549 admin admin] PATH_INFO: `/v3/projects/cdc84d93949743579c8913af0813494a` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:10.661376 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f51ca-514d-4d2d-a0e8-3f2a4ee10549 admin admin] RBAC: Authorizing `identity:get_project(project_id=cdc84d93949743579c8913af0813494a)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:10.686619 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9f51ca-514d-4d2d-a0e8-3f2a4ee10549 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:10.688134 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 107/213] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:49:10 2021] GET /identity/v3/projects/cdc84d93949743579c8913af0813494a => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:10.693060 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe103f4-a056-4ed7-9964-199c808c4ff0 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:10.701405 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe103f4-a056-4ed7-9964-199c808c4ff0 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:10.705736 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4e405-d268-437a-b86b-bc79cde2f229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:10.706287 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4e405-d268-437a-b86b-bc79cde2f229 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:10.706575 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4e405-d268-437a-b86b-bc79cde2f229 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:10.706856 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4e405-d268-437a-b86b-bc79cde2f229 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:10.707653 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4e405-d268-437a-b86b-bc79cde2f229 admin admin] RBAC: Adding query filter params (role.id=f98faade9eb9460b9aa1049aef51b342, scope.project.id=cdc84d93949743579c8913af0813494a, user.id=3d6d5c3a153c45f19a677d9902ebcf2a) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:10.707957 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4e405-d268-437a-b86b-bc79cde2f229 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:10.733375 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4e405-d268-437a-b86b-bc79cde2f229 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:10.738504 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 107/214] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:49:10 2021] GET /identity/v3/role_assignments?user.id=3d6d5c3a153c45f19a677d9902ebcf2a&scope.project.id=cdc84d93949743579c8913af0813494a&role.id=f98faade9eb9460b9aa1049aef51b342 => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:12.674636 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e00ee7-991d-4861-9af3-76517917920d None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:12.675136 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e00ee7-991d-4861-9af3-76517917920d None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:12.675235 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e00ee7-991d-4861-9af3-76517917920d None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:12.676906 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 108/215] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:49:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:49:12.682027 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f2881-8165-4f0d-a2e3-792e3a0cbaeb None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:12.682441 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f2881-8165-4f0d-a2e3-792e3a0cbaeb None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:12.682592 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f2881-8165-4f0d-a2e3-792e3a0cbaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:12.705132 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-831f2881-8165-4f0d-a2e3-792e3a0cbaeb None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:49:12.706257 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-831f2881-8165-4f0d-a2e3-792e3a0cbaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:49:12.712799 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 108/216] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:49:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:49:12.734672 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e00ee7-991d-4861-9af3-76517917920d None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:12.745952 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e00ee7-991d-4861-9af3-76517917920d None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:12.750327 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fbe8d-6816-43a1-b0cd-6e14ca3684dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:12.751040 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fbe8d-6816-43a1-b0cd-6e14ca3684dc admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:12.751328 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fbe8d-6816-43a1-b0cd-6e14ca3684dc admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:12.751645 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fbe8d-6816-43a1-b0cd-6e14ca3684dc admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:12.762635 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fbe8d-6816-43a1-b0cd-6e14ca3684dc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:49:12.769456 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-bd0fbe8d-6816-43a1-b0cd-6e14ca3684dc admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 14:49:12.770517 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 109/217] 10.222.0.89 () {56 vars in 1135 bytes} [Wed Oct 27 14:49:12 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 14:49:12.775959 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f2881-8165-4f0d-a2e3-792e3a0cbaeb None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:12.784389 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f2881-8165-4f0d-a2e3-792e3a0cbaeb None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:12.788291 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b45095-198d-42d6-846f-2acd507b3545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:12.788876 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b45095-198d-42d6-846f-2acd507b3545 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:12.789162 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b45095-198d-42d6-846f-2acd507b3545 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:12.789440 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b45095-198d-42d6-846f-2acd507b3545 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:12.790408 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b45095-198d-42d6-846f-2acd507b3545 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:12.790707 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b45095-198d-42d6-846f-2acd507b3545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:12.816487 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b45095-198d-42d6-846f-2acd507b3545 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:12.824725 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 109/218] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:49:12 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:12.829640 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fbe8d-6816-43a1-b0cd-6e14ca3684dc admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:12.839467 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fbe8d-6816-43a1-b0cd-6e14ca3684dc admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:12.843275 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71253ce-582a-48ee-8e8e-98c764a322b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:12.844065 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71253ce-582a-48ee-8e8e-98c764a322b4 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:12.844352 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71253ce-582a-48ee-8e8e-98c764a322b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:12.844631 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71253ce-582a-48ee-8e8e-98c764a322b4 admin admin] PATH_INFO: `/v3/users/3d6d5c3a153c45f19a677d9902ebcf2a` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:12.845698 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71253ce-582a-48ee-8e8e-98c764a322b4 admin admin] RBAC: Authorizing `identity:get_user(user_id=3d6d5c3a153c45f19a677d9902ebcf2a)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:12.871225 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71253ce-582a-48ee-8e8e-98c764a322b4 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:12.872693 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 110/219] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:49:12 2021] GET /identity/v3/users/3d6d5c3a153c45f19a677d9902ebcf2a => generated 283 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:49:12.878235 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b45095-198d-42d6-846f-2acd507b3545 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:12.886964 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b45095-198d-42d6-846f-2acd507b3545 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:12.890693 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a441b-4028-4640-bc0f-dc079eaf6606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:12.891464 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a441b-4028-4640-bc0f-dc079eaf6606 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:12.891760 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a441b-4028-4640-bc0f-dc079eaf6606 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:12.892038 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a441b-4028-4640-bc0f-dc079eaf6606 admin admin] PATH_INFO: `/v3/projects/cdc84d93949743579c8913af0813494a` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:12.893095 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a441b-4028-4640-bc0f-dc079eaf6606 admin admin] RBAC: Authorizing `identity:get_project(project_id=cdc84d93949743579c8913af0813494a)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:12.918356 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a441b-4028-4640-bc0f-dc079eaf6606 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:12.919850 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 110/220] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:49:12 2021] GET /identity/v3/projects/cdc84d93949743579c8913af0813494a => generated 302 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:12.925266 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71253ce-582a-48ee-8e8e-98c764a322b4 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:12.934053 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71253ce-582a-48ee-8e8e-98c764a322b4 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:12.938510 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad479c8-5519-4be4-b34a-b6936929c39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:12.939288 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad479c8-5519-4be4-b34a-b6936929c39d admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:12.939608 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad479c8-5519-4be4-b34a-b6936929c39d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:12.939892 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad479c8-5519-4be4-b34a-b6936929c39d admin admin] PATH_INFO: `/v3/projects/cdc84d93949743579c8913af0813494a/users/3d6d5c3a153c45f19a677d9902ebcf2a/roles/f98faade9eb9460b9aa1049aef51b342` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:12.941821 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad479c8-5519-4be4-b34a-b6936929c39d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdc84d93949743579c8913af0813494a, user_id=3d6d5c3a153c45f19a677d9902ebcf2a, role_id=f98faade9eb9460b9aa1049aef51b342)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:12.968867 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad479c8-5519-4be4-b34a-b6936929c39d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:12.980373 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 111/221] 10.222.0.89 () {58 vars in 1460 bytes} [Wed Oct 27 14:49:12 2021] PUT /identity/v3/projects/cdc84d93949743579c8913af0813494a/users/3d6d5c3a153c45f19a677d9902ebcf2a/roles/f98faade9eb9460b9aa1049aef51b342 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:49:14.917058 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2f350-964d-49c0-a694-3ff07fcabfff None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:14.917572 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2f350-964d-49c0-a694-3ff07fcabfff None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:14.917673 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2f350-964d-49c0-a694-3ff07fcabfff None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:14.919270 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 111/222] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:49:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 14:49:14.924951 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91948508-76af-400e-804d-bf1c6c89f27b None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:14.925364 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91948508-76af-400e-804d-bf1c6c89f27b None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:14.925506 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91948508-76af-400e-804d-bf1c6c89f27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:14.947718 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-91948508-76af-400e-804d-bf1c6c89f27b None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:49:14.948825 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-91948508-76af-400e-804d-bf1c6c89f27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:49:15.010020 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 112/223] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:49:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:49:15.032246 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2f350-964d-49c0-a694-3ff07fcabfff None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:15.044028 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2f350-964d-49c0-a694-3ff07fcabfff None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:15.048354 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9478b36-07ef-431b-ad1e-dade2b4f7c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:15.049072 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9478b36-07ef-431b-ad1e-dade2b4f7c44 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:15.049364 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9478b36-07ef-431b-ad1e-dade2b4f7c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:15.049647 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9478b36-07ef-431b-ad1e-dade2b4f7c44 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:15.062198 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9478b36-07ef-431b-ad1e-dade2b4f7c44 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:49:15.068787 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-c9478b36-07ef-431b-ad1e-dade2b4f7c44 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 14:49:15.069854 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 112/224] 10.222.0.89 () {56 vars in 1135 bytes} [Wed Oct 27 14:49:15 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:49:15.075323 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91948508-76af-400e-804d-bf1c6c89f27b None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:15.083849 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91948508-76af-400e-804d-bf1c6c89f27b None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:15.087668 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1569fb8-3526-4583-8505-7c81d2b7eddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:15.088252 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1569fb8-3526-4583-8505-7c81d2b7eddf admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:15.088536 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1569fb8-3526-4583-8505-7c81d2b7eddf admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:15.088811 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1569fb8-3526-4583-8505-7c81d2b7eddf admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:15.089520 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1569fb8-3526-4583-8505-7c81d2b7eddf admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:15.089812 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1569fb8-3526-4583-8505-7c81d2b7eddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:15.114882 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1569fb8-3526-4583-8505-7c81d2b7eddf admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:15.123009 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 113/225] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:49:15 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:15.128742 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9478b36-07ef-431b-ad1e-dade2b4f7c44 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:15.137665 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9478b36-07ef-431b-ad1e-dade2b4f7c44 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:15.141977 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679302df-5203-4f99-bc42-41e66205e197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:15.142737 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679302df-5203-4f99-bc42-41e66205e197 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:15.143022 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679302df-5203-4f99-bc42-41e66205e197 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:15.143298 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679302df-5203-4f99-bc42-41e66205e197 admin admin] PATH_INFO: `/v3/users/3d6d5c3a153c45f19a677d9902ebcf2a` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:15.144407 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679302df-5203-4f99-bc42-41e66205e197 admin admin] RBAC: Authorizing `identity:get_user(user_id=3d6d5c3a153c45f19a677d9902ebcf2a)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:15.170906 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679302df-5203-4f99-bc42-41e66205e197 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:15.172296 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 113/226] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:49:15 2021] GET /identity/v3/users/3d6d5c3a153c45f19a677d9902ebcf2a => generated 283 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:15.177116 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1569fb8-3526-4583-8505-7c81d2b7eddf admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:15.186035 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1569fb8-3526-4583-8505-7c81d2b7eddf admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:15.189787 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3a19b-5088-497d-ac0c-a07230ed4260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:15.190336 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3a19b-5088-497d-ac0c-a07230ed4260 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:15.190618 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3a19b-5088-497d-ac0c-a07230ed4260 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:15.190891 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3a19b-5088-497d-ac0c-a07230ed4260 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:15.198292 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3a19b-5088-497d-ac0c-a07230ed4260 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:15.224017 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3a19b-5088-497d-ac0c-a07230ed4260 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:15.232238 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 114/227] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:49:15 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:49:15.237305 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679302df-5203-4f99-bc42-41e66205e197 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:15.246149 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679302df-5203-4f99-bc42-41e66205e197 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:15.250459 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0a072-2f78-4da1-916b-8f089a4a2554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:15.251211 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0a072-2f78-4da1-916b-8f089a4a2554 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:15.251526 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0a072-2f78-4da1-916b-8f089a4a2554 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:15.251804 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0a072-2f78-4da1-916b-8f089a4a2554 admin admin] PATH_INFO: `/v3/projects/cdc84d93949743579c8913af0813494a` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:15.252850 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0a072-2f78-4da1-916b-8f089a4a2554 admin admin] RBAC: Authorizing `identity:get_project(project_id=cdc84d93949743579c8913af0813494a)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:15.278394 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0a072-2f78-4da1-916b-8f089a4a2554 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:15.279920 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 114/228] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:49:15 2021] GET /identity/v3/projects/cdc84d93949743579c8913af0813494a => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:15.285230 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3a19b-5088-497d-ac0c-a07230ed4260 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:15.294054 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3a19b-5088-497d-ac0c-a07230ed4260 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:15.298047 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17350150-de96-41b8-8a3e-a08533477dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:15.298619 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17350150-de96-41b8-8a3e-a08533477dcf admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:15.298909 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17350150-de96-41b8-8a3e-a08533477dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:15.299190 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17350150-de96-41b8-8a3e-a08533477dcf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:15.300001 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17350150-de96-41b8-8a3e-a08533477dcf admin admin] RBAC: Adding query filter params (role.id=f98faade9eb9460b9aa1049aef51b342, scope.project.id=cdc84d93949743579c8913af0813494a, user.id=3d6d5c3a153c45f19a677d9902ebcf2a) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:15.300304 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17350150-de96-41b8-8a3e-a08533477dcf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:15.325973 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17350150-de96-41b8-8a3e-a08533477dcf admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:15.332239 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 115/229] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:49:15 2021] GET /identity/v3/role_assignments?user.id=3d6d5c3a153c45f19a677d9902ebcf2a&scope.project.id=cdc84d93949743579c8913af0813494a&role.id=f98faade9eb9460b9aa1049aef51b342 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:17.267049 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fef78-5b64-4cf4-af74-1273ba08cb2c None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:17.267488 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fef78-5b64-4cf4-af74-1273ba08cb2c None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:17.267633 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75fef78-5b64-4cf4-af74-1273ba08cb2c None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:17.269297 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 115/230] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:49:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:49:17.274636 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af21d5-a3f1-4f9d-80ed-ee702ff4bfa5 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:17.275023 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af21d5-a3f1-4f9d-80ed-ee702ff4bfa5 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:17.275248 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39af21d5-a3f1-4f9d-80ed-ee702ff4bfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:17.298177 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-39af21d5-a3f1-4f9d-80ed-ee702ff4bfa5 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:49:17.299304 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-39af21d5-a3f1-4f9d-80ed-ee702ff4bfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:49:17.306136 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 116/231] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:49:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:49:17.328451 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fef78-5b64-4cf4-af74-1273ba08cb2c None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:17.339597 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75fef78-5b64-4cf4-af74-1273ba08cb2c None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:17.343315 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45496eda-245b-4aa1-a099-4aa127473e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:17.344030 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45496eda-245b-4aa1-a099-4aa127473e82 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:17.344310 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45496eda-245b-4aa1-a099-4aa127473e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:17.344580 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45496eda-245b-4aa1-a099-4aa127473e82 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:17.345609 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45496eda-245b-4aa1-a099-4aa127473e82 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:17.370624 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45496eda-245b-4aa1-a099-4aa127473e82 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:17.372044 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 116/232] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:49:17 2021] GET /identity/v3/domains/default => generated 199 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:49:17.377830 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af21d5-a3f1-4f9d-80ed-ee702ff4bfa5 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:17.386305 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39af21d5-a3f1-4f9d-80ed-ee702ff4bfa5 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:17.390194 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7ab8b-4f14-41c5-a60e-88988f330d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:17.390772 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7ab8b-4f14-41c5-a60e-88988f330d27 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:17.391060 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7ab8b-4f14-41c5-a60e-88988f330d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:17.391339 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7ab8b-4f14-41c5-a60e-88988f330d27 admin admin] PATH_INFO: `/v3/groups` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:17.392023 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7ab8b-4f14-41c5-a60e-88988f330d27 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:17.416744 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING py.warnings [None req-42c7ab8b-4f14-41c5-a60e-88988f330d27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:49:17.416744 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: warnings.warn(msg) Oct 27 14:49:17.416744 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: Oct 27 14:49:17.417945 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7ab8b-4f14-41c5-a60e-88988f330d27 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:17.431459 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 117/233] 10.222.0.89 () {60 vars in 1155 bytes} [Wed Oct 27 14:49:17 2021] POST /identity/v3/groups => generated 229 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:49:19.395878 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7e1bf-e31e-4b5b-b1f9-5364a8a54946 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:19.396369 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7e1bf-e31e-4b5b-b1f9-5364a8a54946 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:19.396488 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d7e1bf-e31e-4b5b-b1f9-5364a8a54946 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:19.398169 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 117/234] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:49:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:49:19.403354 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b0ba0-00bf-4dd8-b9f3-7ddcb58c0136 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:19.403786 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b0ba0-00bf-4dd8-b9f3-7ddcb58c0136 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:19.403940 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b0ba0-00bf-4dd8-b9f3-7ddcb58c0136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:19.426719 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-6c5b0ba0-00bf-4dd8-b9f3-7ddcb58c0136 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:49:19.427862 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-6c5b0ba0-00bf-4dd8-b9f3-7ddcb58c0136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:49:19.434267 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 118/235] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:49:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:49:19.455937 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7e1bf-e31e-4b5b-b1f9-5364a8a54946 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:19.467142 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d7e1bf-e31e-4b5b-b1f9-5364a8a54946 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:19.470922 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f61883-aee9-404d-9ad1-826563d8587e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:19.471646 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f61883-aee9-404d-9ad1-826563d8587e admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:19.471934 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f61883-aee9-404d-9ad1-826563d8587e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:19.472211 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f61883-aee9-404d-9ad1-826563d8587e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:19.473256 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f61883-aee9-404d-9ad1-826563d8587e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:19.498339 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f61883-aee9-404d-9ad1-826563d8587e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:19.500386 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 118/236] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:49:19 2021] GET /identity/v3/domains/default => generated 199 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:19.505418 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b0ba0-00bf-4dd8-b9f3-7ddcb58c0136 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:19.513833 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b0ba0-00bf-4dd8-b9f3-7ddcb58c0136 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:19.517657 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfb55d-00e0-4436-af5e-78bf6fbe0a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:19.518240 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfb55d-00e0-4436-af5e-78bf6fbe0a02 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:19.518528 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfb55d-00e0-4436-af5e-78bf6fbe0a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:19.518808 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfb55d-00e0-4436-af5e-78bf6fbe0a02 admin admin] PATH_INFO: `/v3/groups` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:19.519429 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abfb55d-00e0-4436-af5e-78bf6fbe0a02 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:19.544676 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abfb55d-00e0-4436-af5e-78bf6fbe0a02 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:19.557100 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 119/237] 10.222.0.89 () {60 vars in 1155 bytes} [Wed Oct 27 14:49:19 2021] POST /identity/v3/groups => generated 226 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:49:21.521207 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d4e47-8c60-4af2-b763-1328a100f635 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:21.521711 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d4e47-8c60-4af2-b763-1328a100f635 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:21.521711 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d4e47-8c60-4af2-b763-1328a100f635 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:21.523314 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 119/238] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:49:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:49:21.528697 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c97cbd-b746-4249-8e0b-568765bf483e None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:21.529117 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c97cbd-b746-4249-8e0b-568765bf483e None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:21.529268 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c97cbd-b746-4249-8e0b-568765bf483e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:21.552431 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-d7c97cbd-b746-4249-8e0b-568765bf483e None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:49:21.553556 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-d7c97cbd-b746-4249-8e0b-568765bf483e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:49:21.560185 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 120/239] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:49:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:49:21.583329 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d4e47-8c60-4af2-b763-1328a100f635 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:21.594994 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d4e47-8c60-4af2-b763-1328a100f635 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:21.598744 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89eb6e8-d6db-4f3f-89aa-6b9326ba9317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:21.599433 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89eb6e8-d6db-4f3f-89aa-6b9326ba9317 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:21.599756 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89eb6e8-d6db-4f3f-89aa-6b9326ba9317 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:21.600026 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89eb6e8-d6db-4f3f-89aa-6b9326ba9317 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:21.612228 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89eb6e8-d6db-4f3f-89aa-6b9326ba9317 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:49:21.618336 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-d89eb6e8-d6db-4f3f-89aa-6b9326ba9317 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 14:49:21.619377 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 120/240] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:49:21 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:49:21.624557 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c97cbd-b746-4249-8e0b-568765bf483e None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:21.632823 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c97cbd-b746-4249-8e0b-568765bf483e None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:21.636611 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315e234-6b30-4728-97fd-e61638f3e2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:21.637186 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315e234-6b30-4728-97fd-e61638f3e2cc admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:21.637469 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315e234-6b30-4728-97fd-e61638f3e2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:21.637746 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315e234-6b30-4728-97fd-e61638f3e2cc admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:21.638441 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315e234-6b30-4728-97fd-e61638f3e2cc admin admin] RBAC: Adding query filter params (name=member) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:21.638739 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315e234-6b30-4728-97fd-e61638f3e2cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:21.664412 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315e234-6b30-4728-97fd-e61638f3e2cc admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:21.672857 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 121/241] 10.222.0.89 () {56 vars in 1122 bytes} [Wed Oct 27 14:49:21 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:21.677860 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89eb6e8-d6db-4f3f-89aa-6b9326ba9317 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:21.686768 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89eb6e8-d6db-4f3f-89aa-6b9326ba9317 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:21.690502 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8c932-119d-4ba0-ab34-d1178e45c318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:21.691046 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8c932-119d-4ba0-ab34-d1178e45c318 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:21.691326 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8c932-119d-4ba0-ab34-d1178e45c318 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:21.691630 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8c932-119d-4ba0-ab34-d1178e45c318 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:21.698995 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8c932-119d-4ba0-ab34-d1178e45c318 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:21.724692 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8c932-119d-4ba0-ab34-d1178e45c318 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:21.732756 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 121/242] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:49:21 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:49:21.737759 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315e234-6b30-4728-97fd-e61638f3e2cc admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:21.746682 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315e234-6b30-4728-97fd-e61638f3e2cc admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:21.750473 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bce85-f7b2-4080-82fd-4903c1cb15ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:21.751230 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bce85-f7b2-4080-82fd-4903c1cb15ad admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:21.751557 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bce85-f7b2-4080-82fd-4903c1cb15ad admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:21.751838 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bce85-f7b2-4080-82fd-4903c1cb15ad admin admin] PATH_INFO: `/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:21.752889 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662bce85-f7b2-4080-82fd-4903c1cb15ad admin admin] RBAC: Authorizing `identity:get_project(project_id=055ce8b96eed43db9c8ea4bb1307f9ad)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:21.778502 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662bce85-f7b2-4080-82fd-4903c1cb15ad admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:21.780571 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 122/243] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:49:21 2021] GET /identity/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:21.785288 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8c932-119d-4ba0-ab34-d1178e45c318 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:21.793517 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8c932-119d-4ba0-ab34-d1178e45c318 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:21.797288 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eb31a2-e7e3-402e-acd7-809971cabd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:21.798021 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb31a2-e7e3-402e-acd7-809971cabd85 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:21.798301 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb31a2-e7e3-402e-acd7-809971cabd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:21.798574 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eb31a2-e7e3-402e-acd7-809971cabd85 admin admin] PATH_INFO: `/v3/groups/6cac8542a56d41669279354570b9ac7a` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:21.803197 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb31a2-e7e3-402e-acd7-809971cabd85 admin admin] RBAC: Authorizing `identity:get_group(group_id=6cac8542a56d41669279354570b9ac7a)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:21.827458 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING py.warnings [None req-e5eb31a2-e7e3-402e-acd7-809971cabd85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:49:21.827458 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: warnings.warn(msg) Oct 27 14:49:21.827458 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: Oct 27 14:49:21.828603 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eb31a2-e7e3-402e-acd7-809971cabd85 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:21.830003 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 122/244] 10.222.0.89 () {56 vars in 1201 bytes} [Wed Oct 27 14:49:21 2021] GET /identity/v3/groups/6cac8542a56d41669279354570b9ac7a => generated 226 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:21.834934 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bce85-f7b2-4080-82fd-4903c1cb15ad admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:21.844313 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662bce85-f7b2-4080-82fd-4903c1cb15ad admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:21.848124 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4fc739-ff5a-4544-8d04-215bc2a145c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:21.848673 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fc739-ff5a-4544-8d04-215bc2a145c9 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:21.848961 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fc739-ff5a-4544-8d04-215bc2a145c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:21.849243 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fc739-ff5a-4544-8d04-215bc2a145c9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:21.850005 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4fc739-ff5a-4544-8d04-215bc2a145c9 admin admin] RBAC: Adding query filter params (group.id=6cac8542a56d41669279354570b9ac7a, role.id=cb40c4204c4e49d8b874875a1a860a9c, scope.project.id=055ce8b96eed43db9c8ea4bb1307f9ad) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:21.850307 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4fc739-ff5a-4544-8d04-215bc2a145c9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:21.875224 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4fc739-ff5a-4544-8d04-215bc2a145c9 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:21.880366 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 123/245] 10.222.0.89 () {56 vars in 1397 bytes} [Wed Oct 27 14:49:21 2021] GET /identity/v3/role_assignments?group.id=6cac8542a56d41669279354570b9ac7a&scope.project.id=055ce8b96eed43db9c8ea4bb1307f9ad&role.id=cb40c4204c4e49d8b874875a1a860a9c => generated 260 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:23.769618 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573c46c-ef83-4ac6-b9dd-5309736292d8 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:23.770134 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573c46c-ef83-4ac6-b9dd-5309736292d8 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:23.770235 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4573c46c-ef83-4ac6-b9dd-5309736292d8 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:23.771840 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 123/246] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:49:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:49:23.776916 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe8612-f22c-4290-aed5-126f28ece2a1 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:23.777338 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe8612-f22c-4290-aed5-126f28ece2a1 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:23.777473 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe8612-f22c-4290-aed5-126f28ece2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:23.799338 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-fefe8612-f22c-4290-aed5-126f28ece2a1 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:49:23.800471 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-fefe8612-f22c-4290-aed5-126f28ece2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:49:23.806817 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 124/247] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:49:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:49:23.828620 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573c46c-ef83-4ac6-b9dd-5309736292d8 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:23.839731 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4573c46c-ef83-4ac6-b9dd-5309736292d8 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:23.843926 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdbfe8-0d4f-480f-95bd-fe62db343172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:23.844618 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdbfe8-0d4f-480f-95bd-fe62db343172 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:23.844898 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdbfe8-0d4f-480f-95bd-fe62db343172 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:23.845171 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cdbfe8-0d4f-480f-95bd-fe62db343172 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:23.855895 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cdbfe8-0d4f-480f-95bd-fe62db343172 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:49:23.862638 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-62cdbfe8-0d4f-480f-95bd-fe62db343172 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 14:49:23.863708 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 124/248] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:49:23 2021] GET /identity/v3/roles/member => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:49:23.868882 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe8612-f22c-4290-aed5-126f28ece2a1 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:23.877260 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe8612-f22c-4290-aed5-126f28ece2a1 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:23.881144 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c1f1b-3b49-4027-9cde-ca77adbfecd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:23.881728 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c1f1b-3b49-4027-9cde-ca77adbfecd1 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:23.882015 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c1f1b-3b49-4027-9cde-ca77adbfecd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:23.882297 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c1f1b-3b49-4027-9cde-ca77adbfecd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:23.883003 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c1f1b-3b49-4027-9cde-ca77adbfecd1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:23.883301 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c1f1b-3b49-4027-9cde-ca77adbfecd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:23.909831 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c1f1b-3b49-4027-9cde-ca77adbfecd1 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:23.918446 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 125/249] 10.222.0.89 () {56 vars in 1122 bytes} [Wed Oct 27 14:49:23 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:23.923573 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdbfe8-0d4f-480f-95bd-fe62db343172 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:23.933490 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cdbfe8-0d4f-480f-95bd-fe62db343172 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:23.937341 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f7e90-5836-48ea-a2c5-81b16fb7dd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:23.938104 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f7e90-5836-48ea-a2c5-81b16fb7dd0a admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:23.938388 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f7e90-5836-48ea-a2c5-81b16fb7dd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:23.938665 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f7e90-5836-48ea-a2c5-81b16fb7dd0a admin admin] PATH_INFO: `/v3/groups/6cac8542a56d41669279354570b9ac7a` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:23.939730 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f7e90-5836-48ea-a2c5-81b16fb7dd0a admin admin] RBAC: Authorizing `identity:get_group(group_id=6cac8542a56d41669279354570b9ac7a)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:23.964826 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2f7e90-5836-48ea-a2c5-81b16fb7dd0a admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:23.966227 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 125/250] 10.222.0.89 () {56 vars in 1201 bytes} [Wed Oct 27 14:49:23 2021] GET /identity/v3/groups/6cac8542a56d41669279354570b9ac7a => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:23.971604 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c1f1b-3b49-4027-9cde-ca77adbfecd1 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:23.980571 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c1f1b-3b49-4027-9cde-ca77adbfecd1 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:23.984386 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a0b3a-87c2-4264-b028-fe7143e9ceaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:23.985146 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a0b3a-87c2-4264-b028-fe7143e9ceaf admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:23.985433 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a0b3a-87c2-4264-b028-fe7143e9ceaf admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:23.985710 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a0b3a-87c2-4264-b028-fe7143e9ceaf admin admin] PATH_INFO: `/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:23.986790 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a0b3a-87c2-4264-b028-fe7143e9ceaf admin admin] RBAC: Authorizing `identity:get_project(project_id=055ce8b96eed43db9c8ea4bb1307f9ad)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:24.011853 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a0b3a-87c2-4264-b028-fe7143e9ceaf admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:24.013324 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 126/251] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:49:23 2021] GET /identity/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad => generated 298 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:24.018696 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f7e90-5836-48ea-a2c5-81b16fb7dd0a admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:24.027569 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f7e90-5836-48ea-a2c5-81b16fb7dd0a admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:24.031899 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29fef9b-ef17-4957-accc-f900af5e35fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:24.032666 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fef9b-ef17-4957-accc-f900af5e35fc admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:24.032952 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fef9b-ef17-4957-accc-f900af5e35fc admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:24.033233 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fef9b-ef17-4957-accc-f900af5e35fc admin admin] PATH_INFO: `/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad/groups/6cac8542a56d41669279354570b9ac7a/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:24.034908 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29fef9b-ef17-4957-accc-f900af5e35fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=055ce8b96eed43db9c8ea4bb1307f9ad, group_id=6cac8542a56d41669279354570b9ac7a, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:24.060912 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29fef9b-ef17-4957-accc-f900af5e35fc admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:24.072482 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 126/252] 10.222.0.89 () {58 vars in 1463 bytes} [Wed Oct 27 14:49:24 2021] PUT /identity/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad/groups/6cac8542a56d41669279354570b9ac7a/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:49:25.982275 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90018a1c-a5a2-460b-9634-e407a5b3c9e1 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:25.982827 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90018a1c-a5a2-460b-9634-e407a5b3c9e1 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:25.982921 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90018a1c-a5a2-460b-9634-e407a5b3c9e1 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:25.984626 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 127/253] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:49:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:49:25.989982 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ad9d9-2771-4670-989c-be6dbf0baba2 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:25.990391 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ad9d9-2771-4670-989c-be6dbf0baba2 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:25.990541 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ad9d9-2771-4670-989c-be6dbf0baba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:26.013132 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-552ad9d9-2771-4670-989c-be6dbf0baba2 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:49:26.014392 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-552ad9d9-2771-4670-989c-be6dbf0baba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:49:26.078728 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 127/254] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:49:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:49:26.101084 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90018a1c-a5a2-460b-9634-e407a5b3c9e1 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:26.113084 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90018a1c-a5a2-460b-9634-e407a5b3c9e1 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:26.116864 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008ecfa-b027-43b9-ac44-4eb270f08345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:26.117572 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008ecfa-b027-43b9-ac44-4eb270f08345 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:26.117860 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008ecfa-b027-43b9-ac44-4eb270f08345 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:26.118139 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008ecfa-b027-43b9-ac44-4eb270f08345 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:26.130425 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008ecfa-b027-43b9-ac44-4eb270f08345 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:49:26.136744 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-f008ecfa-b027-43b9-ac44-4eb270f08345 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 14:49:26.137803 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 128/255] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:49:26 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:49:26.143214 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ad9d9-2771-4670-989c-be6dbf0baba2 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:26.151578 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ad9d9-2771-4670-989c-be6dbf0baba2 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:26.155349 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b61dd-7ec8-450c-9c0e-edbf98146f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:26.155968 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b61dd-7ec8-450c-9c0e-edbf98146f57 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:26.156259 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b61dd-7ec8-450c-9c0e-edbf98146f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:26.156535 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b61dd-7ec8-450c-9c0e-edbf98146f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:26.157236 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b61dd-7ec8-450c-9c0e-edbf98146f57 admin admin] RBAC: Adding query filter params (name=member) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:26.157533 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b61dd-7ec8-450c-9c0e-edbf98146f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:26.183161 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10b61dd-7ec8-450c-9c0e-edbf98146f57 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:26.192037 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 128/256] 10.222.0.89 () {56 vars in 1122 bytes} [Wed Oct 27 14:49:26 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:26.197304 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008ecfa-b027-43b9-ac44-4eb270f08345 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:26.206294 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008ecfa-b027-43b9-ac44-4eb270f08345 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:26.210086 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94858b-d3d9-4134-b58b-9c24ce08cfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:26.210638 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94858b-d3d9-4134-b58b-9c24ce08cfa9 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:26.210921 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94858b-d3d9-4134-b58b-9c24ce08cfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:26.211195 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b94858b-d3d9-4134-b58b-9c24ce08cfa9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:26.218660 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94858b-d3d9-4134-b58b-9c24ce08cfa9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:26.244220 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b94858b-d3d9-4134-b58b-9c24ce08cfa9 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:26.253051 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 129/257] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:49:26 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:49:26.258541 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b61dd-7ec8-450c-9c0e-edbf98146f57 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:26.267565 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10b61dd-7ec8-450c-9c0e-edbf98146f57 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:26.271351 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7f96f-46e1-470f-a2c8-1fc09afbcc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:26.272153 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7f96f-46e1-470f-a2c8-1fc09afbcc55 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:26.272436 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7f96f-46e1-470f-a2c8-1fc09afbcc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:26.272708 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b7f96f-46e1-470f-a2c8-1fc09afbcc55 admin admin] PATH_INFO: `/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:26.273761 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b7f96f-46e1-470f-a2c8-1fc09afbcc55 admin admin] RBAC: Authorizing `identity:get_project(project_id=055ce8b96eed43db9c8ea4bb1307f9ad)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:26.299628 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b7f96f-46e1-470f-a2c8-1fc09afbcc55 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:26.301134 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 129/258] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:49:26 2021] GET /identity/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:49:26.306096 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94858b-d3d9-4134-b58b-9c24ce08cfa9 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:26.315011 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b94858b-d3d9-4134-b58b-9c24ce08cfa9 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:26.318851 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac62142-17fa-42df-8ccb-ab9e96c43463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:26.319646 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac62142-17fa-42df-8ccb-ab9e96c43463 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:26.319930 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac62142-17fa-42df-8ccb-ab9e96c43463 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:26.320207 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac62142-17fa-42df-8ccb-ab9e96c43463 admin admin] PATH_INFO: `/v3/groups/6cac8542a56d41669279354570b9ac7a` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:26.321246 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac62142-17fa-42df-8ccb-ab9e96c43463 admin admin] RBAC: Authorizing `identity:get_group(group_id=6cac8542a56d41669279354570b9ac7a)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:26.345328 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING py.warnings [None req-cac62142-17fa-42df-8ccb-ab9e96c43463 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:49:26.345328 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: warnings.warn(msg) Oct 27 14:49:26.345328 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: Oct 27 14:49:26.346487 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac62142-17fa-42df-8ccb-ab9e96c43463 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:26.347913 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 130/259] 10.222.0.89 () {56 vars in 1201 bytes} [Wed Oct 27 14:49:26 2021] GET /identity/v3/groups/6cac8542a56d41669279354570b9ac7a => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:49:26.352920 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7f96f-46e1-470f-a2c8-1fc09afbcc55 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:26.362232 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b7f96f-46e1-470f-a2c8-1fc09afbcc55 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:26.365994 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d65b2-0fb8-497e-a01a-e1b9a4ad6cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:26.366539 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d65b2-0fb8-497e-a01a-e1b9a4ad6cab admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:26.366822 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d65b2-0fb8-497e-a01a-e1b9a4ad6cab admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:26.367099 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d65b2-0fb8-497e-a01a-e1b9a4ad6cab admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:26.367898 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d65b2-0fb8-497e-a01a-e1b9a4ad6cab admin admin] RBAC: Adding query filter params (group.id=6cac8542a56d41669279354570b9ac7a, role.id=cb40c4204c4e49d8b874875a1a860a9c, scope.project.id=055ce8b96eed43db9c8ea4bb1307f9ad) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:26.368219 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d65b2-0fb8-497e-a01a-e1b9a4ad6cab admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:26.393582 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d65b2-0fb8-497e-a01a-e1b9a4ad6cab admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:26.399055 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 130/260] 10.222.0.89 () {56 vars in 1397 bytes} [Wed Oct 27 14:49:26 2021] GET /identity/v3/role_assignments?group.id=6cac8542a56d41669279354570b9ac7a&scope.project.id=055ce8b96eed43db9c8ea4bb1307f9ad&role.id=cb40c4204c4e49d8b874875a1a860a9c => generated 611 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:49:28.330448 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf1a1d-ceb4-4b9e-875b-61ceb34f175b None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:28.330892 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf1a1d-ceb4-4b9e-875b-61ceb34f175b None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:28.330998 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf1a1d-ceb4-4b9e-875b-61ceb34f175b None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:28.332687 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 131/261] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:49:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:49:28.337804 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd156b2-d500-443c-90f4-23fecf4d443e None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:28.338199 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd156b2-d500-443c-90f4-23fecf4d443e None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:28.338362 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd156b2-d500-443c-90f4-23fecf4d443e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:28.361395 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-9fd156b2-d500-443c-90f4-23fecf4d443e None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:49:28.362524 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-9fd156b2-d500-443c-90f4-23fecf4d443e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:49:28.369017 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 131/262] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:49:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:49:28.390845 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf1a1d-ceb4-4b9e-875b-61ceb34f175b None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:28.402059 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf1a1d-ceb4-4b9e-875b-61ceb34f175b None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:28.406435 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438189e5-34e0-4264-aba8-2c5790b42859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:28.407149 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438189e5-34e0-4264-aba8-2c5790b42859 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:28.407449 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438189e5-34e0-4264-aba8-2c5790b42859 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:28.407737 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438189e5-34e0-4264-aba8-2c5790b42859 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:28.418779 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438189e5-34e0-4264-aba8-2c5790b42859 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:49:28.425386 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-438189e5-34e0-4264-aba8-2c5790b42859 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 14:49:28.426434 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 132/263] 10.222.0.89 () {56 vars in 1135 bytes} [Wed Oct 27 14:49:28 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:49:28.431733 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd156b2-d500-443c-90f4-23fecf4d443e None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:28.440081 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd156b2-d500-443c-90f4-23fecf4d443e None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:28.443939 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366393c-76fe-4846-b20d-1016344b8e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:28.444525 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366393c-76fe-4846-b20d-1016344b8e2a admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:28.444814 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366393c-76fe-4846-b20d-1016344b8e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:28.445098 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366393c-76fe-4846-b20d-1016344b8e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:28.445802 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366393c-76fe-4846-b20d-1016344b8e2a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:28.446103 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366393c-76fe-4846-b20d-1016344b8e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:28.472391 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366393c-76fe-4846-b20d-1016344b8e2a admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:28.480583 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 132/264] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:49:28 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:28.485715 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438189e5-34e0-4264-aba8-2c5790b42859 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:28.495651 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438189e5-34e0-4264-aba8-2c5790b42859 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:28.499398 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba07e35-9b00-4778-885b-397cb49916c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:28.499976 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba07e35-9b00-4778-885b-397cb49916c9 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:28.500261 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba07e35-9b00-4778-885b-397cb49916c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:28.500543 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba07e35-9b00-4778-885b-397cb49916c9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:28.508062 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba07e35-9b00-4778-885b-397cb49916c9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:28.533781 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba07e35-9b00-4778-885b-397cb49916c9 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:28.542264 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 133/265] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:49:28 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:49:28.547302 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366393c-76fe-4846-b20d-1016344b8e2a admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:28.556205 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366393c-76fe-4846-b20d-1016344b8e2a admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:28.560054 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5b410-1946-40b4-8a75-a6108bc69e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:28.560815 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5b410-1946-40b4-8a75-a6108bc69e38 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:28.561104 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5b410-1946-40b4-8a75-a6108bc69e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:28.561386 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5b410-1946-40b4-8a75-a6108bc69e38 admin admin] PATH_INFO: `/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:28.562452 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5b410-1946-40b4-8a75-a6108bc69e38 admin admin] RBAC: Authorizing `identity:get_project(project_id=055ce8b96eed43db9c8ea4bb1307f9ad)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:28.588015 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5b410-1946-40b4-8a75-a6108bc69e38 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:28.589479 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 133/266] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:49:28 2021] GET /identity/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:28.594807 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba07e35-9b00-4778-885b-397cb49916c9 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:28.602887 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba07e35-9b00-4778-885b-397cb49916c9 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:28.606713 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c705f9-5e8a-4713-9ed2-c653f9069865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:28.607551 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c705f9-5e8a-4713-9ed2-c653f9069865 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:28.607882 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c705f9-5e8a-4713-9ed2-c653f9069865 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:28.608162 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c705f9-5e8a-4713-9ed2-c653f9069865 admin admin] PATH_INFO: `/v3/groups/6cac8542a56d41669279354570b9ac7a` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:28.609191 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c705f9-5e8a-4713-9ed2-c653f9069865 admin admin] RBAC: Authorizing `identity:get_group(group_id=6cac8542a56d41669279354570b9ac7a)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:28.634035 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c705f9-5e8a-4713-9ed2-c653f9069865 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:28.635424 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 134/267] 10.222.0.89 () {56 vars in 1201 bytes} [Wed Oct 27 14:49:28 2021] GET /identity/v3/groups/6cac8542a56d41669279354570b9ac7a => generated 226 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:28.640837 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5b410-1946-40b4-8a75-a6108bc69e38 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:28.649658 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5b410-1946-40b4-8a75-a6108bc69e38 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:28.653465 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c81c1-3183-4a58-b67a-4dae68dfbb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:28.654013 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c81c1-3183-4a58-b67a-4dae68dfbb8f admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:28.654302 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c81c1-3183-4a58-b67a-4dae68dfbb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:28.655167 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c81c1-3183-4a58-b67a-4dae68dfbb8f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:28.655966 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c81c1-3183-4a58-b67a-4dae68dfbb8f admin admin] RBAC: Adding query filter params (group.id=6cac8542a56d41669279354570b9ac7a, role.id=f98faade9eb9460b9aa1049aef51b342, scope.project.id=055ce8b96eed43db9c8ea4bb1307f9ad) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:28.656272 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c81c1-3183-4a58-b67a-4dae68dfbb8f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:28.681320 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7c81c1-3183-4a58-b67a-4dae68dfbb8f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:28.686478 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 134/268] 10.222.0.89 () {56 vars in 1397 bytes} [Wed Oct 27 14:49:28 2021] GET /identity/v3/role_assignments?group.id=6cac8542a56d41669279354570b9ac7a&scope.project.id=055ce8b96eed43db9c8ea4bb1307f9ad&role.id=f98faade9eb9460b9aa1049aef51b342 => generated 260 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:30.613235 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68b790-9722-4688-adec-883b1bbe8c25 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:30.613809 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68b790-9722-4688-adec-883b1bbe8c25 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:30.613809 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68b790-9722-4688-adec-883b1bbe8c25 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:30.615376 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 135/269] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:49:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:49:30.620667 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c33ebb-33a5-44dd-ac15-55d27e8bd3c2 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:30.621068 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c33ebb-33a5-44dd-ac15-55d27e8bd3c2 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:30.621236 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c33ebb-33a5-44dd-ac15-55d27e8bd3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:30.643598 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-a0c33ebb-33a5-44dd-ac15-55d27e8bd3c2 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:49:30.644903 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-a0c33ebb-33a5-44dd-ac15-55d27e8bd3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:49:30.651388 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 135/270] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:49:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:49:30.673171 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68b790-9722-4688-adec-883b1bbe8c25 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:30.684498 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af68b790-9722-4688-adec-883b1bbe8c25 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:30.688324 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4a0dc-d8fb-4ced-af2e-fbd98e17af8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:30.689017 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4a0dc-d8fb-4ced-af2e-fbd98e17af8d admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:30.689305 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4a0dc-d8fb-4ced-af2e-fbd98e17af8d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:30.689584 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4a0dc-d8fb-4ced-af2e-fbd98e17af8d admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:30.700513 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4a0dc-d8fb-4ced-af2e-fbd98e17af8d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:49:30.707590 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-f1c4a0dc-d8fb-4ced-af2e-fbd98e17af8d admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 14:49:30.708635 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 136/271] 10.222.0.89 () {56 vars in 1135 bytes} [Wed Oct 27 14:49:30 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:49:30.713995 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c33ebb-33a5-44dd-ac15-55d27e8bd3c2 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:30.723095 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c33ebb-33a5-44dd-ac15-55d27e8bd3c2 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:30.726874 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9cd44-7b93-426f-a9c3-e54c1bff7b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:30.727480 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9cd44-7b93-426f-a9c3-e54c1bff7b02 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:30.727771 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9cd44-7b93-426f-a9c3-e54c1bff7b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:30.728046 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9cd44-7b93-426f-a9c3-e54c1bff7b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:30.728739 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9cd44-7b93-426f-a9c3-e54c1bff7b02 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:30.729032 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9cd44-7b93-426f-a9c3-e54c1bff7b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:30.753584 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9cd44-7b93-426f-a9c3-e54c1bff7b02 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:30.761836 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 136/272] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:49:30 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:30.767661 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4a0dc-d8fb-4ced-af2e-fbd98e17af8d admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:30.777600 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4a0dc-d8fb-4ced-af2e-fbd98e17af8d admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:30.781973 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c6cec-2086-4e9e-988e-d07cdfe08131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:30.782726 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c6cec-2086-4e9e-988e-d07cdfe08131 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:30.783008 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c6cec-2086-4e9e-988e-d07cdfe08131 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:30.783283 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c6cec-2086-4e9e-988e-d07cdfe08131 admin admin] PATH_INFO: `/v3/groups/6cac8542a56d41669279354570b9ac7a` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:30.784361 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c6cec-2086-4e9e-988e-d07cdfe08131 admin admin] RBAC: Authorizing `identity:get_group(group_id=6cac8542a56d41669279354570b9ac7a)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:30.809454 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c6cec-2086-4e9e-988e-d07cdfe08131 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:30.810854 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 137/273] 10.222.0.89 () {56 vars in 1201 bytes} [Wed Oct 27 14:49:30 2021] GET /identity/v3/groups/6cac8542a56d41669279354570b9ac7a => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:30.815699 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9cd44-7b93-426f-a9c3-e54c1bff7b02 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:30.824487 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9cd44-7b93-426f-a9c3-e54c1bff7b02 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:30.828758 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84482a9-28d5-420f-90d1-80584efc4fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:30.829527 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84482a9-28d5-420f-90d1-80584efc4fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:30.829813 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84482a9-28d5-420f-90d1-80584efc4fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:30.830094 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84482a9-28d5-420f-90d1-80584efc4fc2 admin admin] PATH_INFO: `/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:30.831154 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84482a9-28d5-420f-90d1-80584efc4fc2 admin admin] RBAC: Authorizing `identity:get_project(project_id=055ce8b96eed43db9c8ea4bb1307f9ad)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:30.856895 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84482a9-28d5-420f-90d1-80584efc4fc2 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:30.858387 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 137/274] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:49:30 2021] GET /identity/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:30.863361 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c6cec-2086-4e9e-988e-d07cdfe08131 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:30.872321 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c6cec-2086-4e9e-988e-d07cdfe08131 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:30.876146 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd33196-c1d0-4759-a4ea-c408c8f73959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:30.876921 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd33196-c1d0-4759-a4ea-c408c8f73959 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:30.877209 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd33196-c1d0-4759-a4ea-c408c8f73959 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:30.877487 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd33196-c1d0-4759-a4ea-c408c8f73959 admin admin] PATH_INFO: `/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad/groups/6cac8542a56d41669279354570b9ac7a/roles/f98faade9eb9460b9aa1049aef51b342` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:30.879496 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd33196-c1d0-4759-a4ea-c408c8f73959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=055ce8b96eed43db9c8ea4bb1307f9ad, group_id=6cac8542a56d41669279354570b9ac7a, role_id=f98faade9eb9460b9aa1049aef51b342)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:30.906770 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd33196-c1d0-4759-a4ea-c408c8f73959 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:30.919101 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 138/275] 10.222.0.89 () {58 vars in 1463 bytes} [Wed Oct 27 14:49:30 2021] PUT /identity/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad/groups/6cac8542a56d41669279354570b9ac7a/roles/f98faade9eb9460b9aa1049aef51b342 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:49:32.838939 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514aff62-9209-47c2-9c97-1ff780cba5b7 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:32.839505 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514aff62-9209-47c2-9c97-1ff780cba5b7 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:32.839505 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514aff62-9209-47c2-9c97-1ff780cba5b7 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:32.841182 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 138/276] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:49:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:49:32.846968 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40edb3-d726-43e9-a9d6-7a5ad4f65e5a None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:32.847358 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40edb3-d726-43e9-a9d6-7a5ad4f65e5a None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:32.847605 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe40edb3-d726-43e9-a9d6-7a5ad4f65e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:32.871266 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-fe40edb3-d726-43e9-a9d6-7a5ad4f65e5a None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:49:32.872434 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-fe40edb3-d726-43e9-a9d6-7a5ad4f65e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:49:32.934622 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 139/277] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:49:32 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:49:32.957050 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514aff62-9209-47c2-9c97-1ff780cba5b7 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:32.968893 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514aff62-9209-47c2-9c97-1ff780cba5b7 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:32.972653 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908065b-7946-4a26-98ec-5e5c0bc8fa9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:32.973368 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908065b-7946-4a26-98ec-5e5c0bc8fa9a admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:32.973653 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908065b-7946-4a26-98ec-5e5c0bc8fa9a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:32.973925 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8908065b-7946-4a26-98ec-5e5c0bc8fa9a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:32.987101 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8908065b-7946-4a26-98ec-5e5c0bc8fa9a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:49:32.993652 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-8908065b-7946-4a26-98ec-5e5c0bc8fa9a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 14:49:32.994695 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 139/278] 10.222.0.89 () {56 vars in 1135 bytes} [Wed Oct 27 14:49:32 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:49:32.999996 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40edb3-d726-43e9-a9d6-7a5ad4f65e5a None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:33.008424 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe40edb3-d726-43e9-a9d6-7a5ad4f65e5a None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:33.012290 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d5da0-2aa8-43be-8201-db1d386af472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:33.012878 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d5da0-2aa8-43be-8201-db1d386af472 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:33.013167 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d5da0-2aa8-43be-8201-db1d386af472 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:33.013446 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d5da0-2aa8-43be-8201-db1d386af472 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:33.014661 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d5da0-2aa8-43be-8201-db1d386af472 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:33.014960 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d5da0-2aa8-43be-8201-db1d386af472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:33.040686 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d5da0-2aa8-43be-8201-db1d386af472 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:33.048850 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 140/279] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:49:32 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:33.053950 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908065b-7946-4a26-98ec-5e5c0bc8fa9a admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:33.062804 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8908065b-7946-4a26-98ec-5e5c0bc8fa9a admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:33.066590 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a16e8-42e5-4658-ad39-828343003d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:33.067143 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a16e8-42e5-4658-ad39-828343003d7a admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:33.067426 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a16e8-42e5-4658-ad39-828343003d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:33.067726 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a16e8-42e5-4658-ad39-828343003d7a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:33.075118 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a16e8-42e5-4658-ad39-828343003d7a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:33.100921 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a16e8-42e5-4658-ad39-828343003d7a admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:33.109025 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 140/280] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:49:33 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:49:33.114187 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d5da0-2aa8-43be-8201-db1d386af472 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:33.123156 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d5da0-2aa8-43be-8201-db1d386af472 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:33.126976 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f413d-1f0a-41d8-b5a9-abcba4cfb57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:33.127777 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f413d-1f0a-41d8-b5a9-abcba4cfb57c admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:33.128066 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f413d-1f0a-41d8-b5a9-abcba4cfb57c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:33.128347 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f413d-1f0a-41d8-b5a9-abcba4cfb57c admin admin] PATH_INFO: `/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:33.129409 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f413d-1f0a-41d8-b5a9-abcba4cfb57c admin admin] RBAC: Authorizing `identity:get_project(project_id=055ce8b96eed43db9c8ea4bb1307f9ad)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:33.155692 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f413d-1f0a-41d8-b5a9-abcba4cfb57c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:33.157174 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 141/281] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:49:33 2021] GET /identity/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:33.162146 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a16e8-42e5-4658-ad39-828343003d7a admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:33.170668 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a16e8-42e5-4658-ad39-828343003d7a admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:33.174620 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47872a54-6780-4a8f-9dd2-c9137b97e8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:33.175371 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47872a54-6780-4a8f-9dd2-c9137b97e8c9 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:33.175686 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47872a54-6780-4a8f-9dd2-c9137b97e8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:33.175963 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47872a54-6780-4a8f-9dd2-c9137b97e8c9 admin admin] PATH_INFO: `/v3/groups/6cac8542a56d41669279354570b9ac7a` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:33.177013 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47872a54-6780-4a8f-9dd2-c9137b97e8c9 admin admin] RBAC: Authorizing `identity:get_group(group_id=6cac8542a56d41669279354570b9ac7a)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:33.203793 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47872a54-6780-4a8f-9dd2-c9137b97e8c9 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:33.205243 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 141/282] 10.222.0.89 () {56 vars in 1201 bytes} [Wed Oct 27 14:49:33 2021] GET /identity/v3/groups/6cac8542a56d41669279354570b9ac7a => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:33.210556 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f413d-1f0a-41d8-b5a9-abcba4cfb57c admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:33.220246 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f413d-1f0a-41d8-b5a9-abcba4cfb57c admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:33.224052 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d235640d-2e86-442a-9f0f-4614cdff7b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:33.224616 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235640d-2e86-442a-9f0f-4614cdff7b0d admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:33.224901 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235640d-2e86-442a-9f0f-4614cdff7b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:33.225176 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235640d-2e86-442a-9f0f-4614cdff7b0d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:33.225939 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235640d-2e86-442a-9f0f-4614cdff7b0d admin admin] RBAC: Adding query filter params (group.id=6cac8542a56d41669279354570b9ac7a, role.id=f98faade9eb9460b9aa1049aef51b342, scope.project.id=055ce8b96eed43db9c8ea4bb1307f9ad) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:33.226235 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235640d-2e86-442a-9f0f-4614cdff7b0d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:33.251724 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d235640d-2e86-442a-9f0f-4614cdff7b0d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:33.257312 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 142/283] 10.222.0.89 () {56 vars in 1397 bytes} [Wed Oct 27 14:49:33 2021] GET /identity/v3/role_assignments?group.id=6cac8542a56d41669279354570b9ac7a&scope.project.id=055ce8b96eed43db9c8ea4bb1307f9ad&role.id=f98faade9eb9460b9aa1049aef51b342 => generated 611 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:35.204225 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449173c4-8995-41d6-890b-7abfbbe1f7a8 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:35.204756 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449173c4-8995-41d6-890b-7abfbbe1f7a8 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:35.204756 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449173c4-8995-41d6-890b-7abfbbe1f7a8 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:35.206434 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 142/284] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:49:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:49:35.211519 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f867e8-74a2-4985-9a21-ee8d4f0c4476 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:35.211957 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f867e8-74a2-4985-9a21-ee8d4f0c4476 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:35.212086 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f867e8-74a2-4985-9a21-ee8d4f0c4476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:35.234426 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-46f867e8-74a2-4985-9a21-ee8d4f0c4476 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:49:35.235581 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-46f867e8-74a2-4985-9a21-ee8d4f0c4476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:49:35.242057 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 143/285] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:49:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:49:35.264817 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449173c4-8995-41d6-890b-7abfbbe1f7a8 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:35.276240 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449173c4-8995-41d6-890b-7abfbbe1f7a8 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:35.280033 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945cb0e-8213-466d-bd0d-4c46e060105a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:35.280737 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945cb0e-8213-466d-bd0d-4c46e060105a admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:35.281021 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945cb0e-8213-466d-bd0d-4c46e060105a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:35.281300 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945cb0e-8213-466d-bd0d-4c46e060105a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:35.292516 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7945cb0e-8213-466d-bd0d-4c46e060105a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:49:35.299242 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-7945cb0e-8213-466d-bd0d-4c46e060105a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 14:49:35.300336 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 143/286] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:49:35 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:49:35.305733 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f867e8-74a2-4985-9a21-ee8d4f0c4476 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:35.314902 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f867e8-74a2-4985-9a21-ee8d4f0c4476 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:35.318767 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100280f-71ec-4881-89e0-4fb2a37d9a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:35.319357 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100280f-71ec-4881-89e0-4fb2a37d9a27 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:35.319670 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100280f-71ec-4881-89e0-4fb2a37d9a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:35.319953 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100280f-71ec-4881-89e0-4fb2a37d9a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:35.320691 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100280f-71ec-4881-89e0-4fb2a37d9a27 admin admin] RBAC: Adding query filter params (name=member) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:35.320990 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100280f-71ec-4881-89e0-4fb2a37d9a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:35.345720 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100280f-71ec-4881-89e0-4fb2a37d9a27 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:35.354027 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 144/287] 10.222.0.89 () {56 vars in 1122 bytes} [Wed Oct 27 14:49:35 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:35.359810 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945cb0e-8213-466d-bd0d-4c46e060105a admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:35.369658 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945cb0e-8213-466d-bd0d-4c46e060105a admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:35.373994 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ac2f7-ce3a-4faa-b2e8-65441b317fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:35.374543 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ac2f7-ce3a-4faa-b2e8-65441b317fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:35.374819 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ac2f7-ce3a-4faa-b2e8-65441b317fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:35.375084 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ac2f7-ce3a-4faa-b2e8-65441b317fd0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:35.382409 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ac2f7-ce3a-4faa-b2e8-65441b317fd0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:35.406939 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ac2f7-ce3a-4faa-b2e8-65441b317fd0 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:35.415264 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 144/288] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:49:35 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:49:35.420783 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100280f-71ec-4881-89e0-4fb2a37d9a27 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:35.429660 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100280f-71ec-4881-89e0-4fb2a37d9a27 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:35.433452 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357bb30-6683-47cd-9e68-b7c61968e22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:35.434217 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357bb30-6683-47cd-9e68-b7c61968e22c admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:35.434502 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357bb30-6683-47cd-9e68-b7c61968e22c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:35.434782 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357bb30-6683-47cd-9e68-b7c61968e22c admin admin] PATH_INFO: `/v3/projects/cdc84d93949743579c8913af0813494a` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:35.436452 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357bb30-6683-47cd-9e68-b7c61968e22c admin admin] RBAC: Authorizing `identity:get_project(project_id=cdc84d93949743579c8913af0813494a)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:35.461591 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357bb30-6683-47cd-9e68-b7c61968e22c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:35.463002 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 145/289] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:49:35 2021] GET /identity/v3/projects/cdc84d93949743579c8913af0813494a => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:35.468250 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ac2f7-ce3a-4faa-b2e8-65441b317fd0 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:35.476303 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ac2f7-ce3a-4faa-b2e8-65441b317fd0 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:35.480114 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61170d9d-f134-403f-bf43-9ad2ac22ea31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:35.480855 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61170d9d-f134-403f-bf43-9ad2ac22ea31 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:35.481136 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61170d9d-f134-403f-bf43-9ad2ac22ea31 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:35.481410 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61170d9d-f134-403f-bf43-9ad2ac22ea31 admin admin] PATH_INFO: `/v3/groups/6cac8542a56d41669279354570b9ac7a` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:35.482446 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61170d9d-f134-403f-bf43-9ad2ac22ea31 admin admin] RBAC: Authorizing `identity:get_group(group_id=6cac8542a56d41669279354570b9ac7a)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:35.507859 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61170d9d-f134-403f-bf43-9ad2ac22ea31 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:35.509260 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 145/290] 10.222.0.89 () {56 vars in 1201 bytes} [Wed Oct 27 14:49:35 2021] GET /identity/v3/groups/6cac8542a56d41669279354570b9ac7a => generated 226 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:35.514780 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357bb30-6683-47cd-9e68-b7c61968e22c admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:35.523678 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357bb30-6683-47cd-9e68-b7c61968e22c admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:35.527427 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21937c86-2a4a-4ce7-9016-2acd97404719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:35.528001 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21937c86-2a4a-4ce7-9016-2acd97404719 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:35.528285 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21937c86-2a4a-4ce7-9016-2acd97404719 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:35.528561 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21937c86-2a4a-4ce7-9016-2acd97404719 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:35.529317 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21937c86-2a4a-4ce7-9016-2acd97404719 admin admin] RBAC: Adding query filter params (group.id=6cac8542a56d41669279354570b9ac7a, role.id=cb40c4204c4e49d8b874875a1a860a9c, scope.project.id=cdc84d93949743579c8913af0813494a) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:35.529616 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21937c86-2a4a-4ce7-9016-2acd97404719 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:35.554710 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21937c86-2a4a-4ce7-9016-2acd97404719 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:35.559853 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 146/291] 10.222.0.89 () {56 vars in 1397 bytes} [Wed Oct 27 14:49:35 2021] GET /identity/v3/role_assignments?group.id=6cac8542a56d41669279354570b9ac7a&scope.project.id=cdc84d93949743579c8913af0813494a&role.id=cb40c4204c4e49d8b874875a1a860a9c => generated 260 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:37.460740 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dee13-d53f-4391-8bb6-bcddc8c1d779 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:37.461245 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dee13-d53f-4391-8bb6-bcddc8c1d779 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:37.461330 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8dee13-d53f-4391-8bb6-bcddc8c1d779 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:37.462955 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 146/292] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:49:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:49:37.468016 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a4e6a-e8b4-4946-a73b-fbd94e92577c None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:37.468432 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a4e6a-e8b4-4946-a73b-fbd94e92577c None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:37.468574 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a4e6a-e8b4-4946-a73b-fbd94e92577c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:37.490805 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-af3a4e6a-e8b4-4946-a73b-fbd94e92577c None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:49:37.491948 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-af3a4e6a-e8b4-4946-a73b-fbd94e92577c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:49:37.499014 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 147/293] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:49:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:49:37.519691 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8dee13-d53f-4391-8bb6-bcddc8c1d779 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:37.530829 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8dee13-d53f-4391-8bb6-bcddc8c1d779 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:37.534606 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d57ecf-3b59-43b4-9c0e-b621fcba401d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:37.535305 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d57ecf-3b59-43b4-9c0e-b621fcba401d admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:37.535623 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d57ecf-3b59-43b4-9c0e-b621fcba401d admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:37.535901 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d57ecf-3b59-43b4-9c0e-b621fcba401d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:37.547538 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d57ecf-3b59-43b4-9c0e-b621fcba401d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:49:37.553761 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-b2d57ecf-3b59-43b4-9c0e-b621fcba401d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 14:49:37.554809 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 147/294] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:49:37 2021] GET /identity/v3/roles/member => generated 84 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 14:49:37.559913 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a4e6a-e8b4-4946-a73b-fbd94e92577c None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:37.568798 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a4e6a-e8b4-4946-a73b-fbd94e92577c None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:37.572632 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58afd55-9c42-45b2-a8a5-01a440a2112d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:37.573207 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58afd55-9c42-45b2-a8a5-01a440a2112d admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:37.573491 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58afd55-9c42-45b2-a8a5-01a440a2112d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:37.573768 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58afd55-9c42-45b2-a8a5-01a440a2112d admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:37.574467 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58afd55-9c42-45b2-a8a5-01a440a2112d admin admin] RBAC: Adding query filter params (name=member) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:37.574763 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58afd55-9c42-45b2-a8a5-01a440a2112d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:37.600475 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58afd55-9c42-45b2-a8a5-01a440a2112d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:37.608710 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 148/295] 10.222.0.89 () {56 vars in 1122 bytes} [Wed Oct 27 14:49:37 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:37.613662 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d57ecf-3b59-43b4-9c0e-b621fcba401d admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:37.623373 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d57ecf-3b59-43b4-9c0e-b621fcba401d admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:37.627140 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c493b62-cdd1-4f49-bc57-5bfb2112165a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:37.627907 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c493b62-cdd1-4f49-bc57-5bfb2112165a admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:37.628197 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c493b62-cdd1-4f49-bc57-5bfb2112165a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:37.628474 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c493b62-cdd1-4f49-bc57-5bfb2112165a admin admin] PATH_INFO: `/v3/groups/6cac8542a56d41669279354570b9ac7a` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:37.629509 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c493b62-cdd1-4f49-bc57-5bfb2112165a admin admin] RBAC: Authorizing `identity:get_group(group_id=6cac8542a56d41669279354570b9ac7a)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:37.655338 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c493b62-cdd1-4f49-bc57-5bfb2112165a admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:37.656756 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 148/296] 10.222.0.89 () {56 vars in 1201 bytes} [Wed Oct 27 14:49:37 2021] GET /identity/v3/groups/6cac8542a56d41669279354570b9ac7a => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:37.661448 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58afd55-9c42-45b2-a8a5-01a440a2112d admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:37.670443 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58afd55-9c42-45b2-a8a5-01a440a2112d admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:37.674216 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb53c0-6c2d-4401-ae56-4f5b2eefb2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:37.674964 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb53c0-6c2d-4401-ae56-4f5b2eefb2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:37.675249 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb53c0-6c2d-4401-ae56-4f5b2eefb2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:37.675563 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb53c0-6c2d-4401-ae56-4f5b2eefb2f8 admin admin] PATH_INFO: `/v3/projects/cdc84d93949743579c8913af0813494a` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:37.676609 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb53c0-6c2d-4401-ae56-4f5b2eefb2f8 admin admin] RBAC: Authorizing `identity:get_project(project_id=cdc84d93949743579c8913af0813494a)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:37.702252 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb53c0-6c2d-4401-ae56-4f5b2eefb2f8 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:37.703733 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 149/297] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:49:37 2021] GET /identity/v3/projects/cdc84d93949743579c8913af0813494a => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:37.708514 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c493b62-cdd1-4f49-bc57-5bfb2112165a admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:37.718006 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c493b62-cdd1-4f49-bc57-5bfb2112165a admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:37.721797 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54c1299-07c1-4ad6-be8d-19af102215c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:37.722560 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c1299-07c1-4ad6-be8d-19af102215c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:37.722843 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c1299-07c1-4ad6-be8d-19af102215c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:37.723122 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54c1299-07c1-4ad6-be8d-19af102215c1 admin admin] PATH_INFO: `/v3/projects/cdc84d93949743579c8913af0813494a/groups/6cac8542a56d41669279354570b9ac7a/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:37.724841 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c1299-07c1-4ad6-be8d-19af102215c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdc84d93949743579c8913af0813494a, group_id=6cac8542a56d41669279354570b9ac7a, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:37.751028 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54c1299-07c1-4ad6-be8d-19af102215c1 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:37.763147 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 149/298] 10.222.0.89 () {58 vars in 1463 bytes} [Wed Oct 27 14:49:37 2021] PUT /identity/v3/projects/cdc84d93949743579c8913af0813494a/groups/6cac8542a56d41669279354570b9ac7a/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:49:39.675218 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a70f72-24d9-4dae-be38-988ebcb1dfd5 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:39.675776 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a70f72-24d9-4dae-be38-988ebcb1dfd5 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:39.675859 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a70f72-24d9-4dae-be38-988ebcb1dfd5 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:39.677481 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 150/299] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:49:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:49:39.682408 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5a422-0213-4edc-a048-b096caa92125 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:39.682771 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5a422-0213-4edc-a048-b096caa92125 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:39.682969 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5a422-0213-4edc-a048-b096caa92125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:39.705430 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-11a5a422-0213-4edc-a048-b096caa92125 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:49:39.706553 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-11a5a422-0213-4edc-a048-b096caa92125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:49:39.768312 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 150/300] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:49:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:49:39.790215 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a70f72-24d9-4dae-be38-988ebcb1dfd5 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:39.802050 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a70f72-24d9-4dae-be38-988ebcb1dfd5 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:39.805782 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73dc57-47f7-4c4b-b3f1-793991b32961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:39.806488 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73dc57-47f7-4c4b-b3f1-793991b32961 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:39.806776 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73dc57-47f7-4c4b-b3f1-793991b32961 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:39.807056 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73dc57-47f7-4c4b-b3f1-793991b32961 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:39.819232 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73dc57-47f7-4c4b-b3f1-793991b32961 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:49:39.825498 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-8a73dc57-47f7-4c4b-b3f1-793991b32961 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 14:49:39.826550 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 151/301] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:49:39 2021] GET /identity/v3/roles/member => generated 84 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:49:39.831783 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5a422-0213-4edc-a048-b096caa92125 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:39.839974 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5a422-0213-4edc-a048-b096caa92125 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:39.843774 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84ce92-8994-4c9f-b046-7345b1729461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:39.844350 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84ce92-8994-4c9f-b046-7345b1729461 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:39.844632 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84ce92-8994-4c9f-b046-7345b1729461 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:39.844905 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84ce92-8994-4c9f-b046-7345b1729461 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:39.845602 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e84ce92-8994-4c9f-b046-7345b1729461 admin admin] RBAC: Adding query filter params (name=member) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:39.845892 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e84ce92-8994-4c9f-b046-7345b1729461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:39.871004 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e84ce92-8994-4c9f-b046-7345b1729461 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:39.879789 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 151/302] 10.222.0.89 () {56 vars in 1122 bytes} [Wed Oct 27 14:49:39 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:39.884803 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73dc57-47f7-4c4b-b3f1-793991b32961 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:39.893753 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73dc57-47f7-4c4b-b3f1-793991b32961 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:39.897597 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e211f2-bdaf-4211-80fd-3b874831210a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:39.898153 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e211f2-bdaf-4211-80fd-3b874831210a admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:39.898438 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e211f2-bdaf-4211-80fd-3b874831210a admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:39.898716 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e211f2-bdaf-4211-80fd-3b874831210a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:39.906248 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e211f2-bdaf-4211-80fd-3b874831210a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:39.931871 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e211f2-bdaf-4211-80fd-3b874831210a admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:39.940677 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 152/303] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:49:39 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:49:39.946149 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84ce92-8994-4c9f-b046-7345b1729461 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:39.955009 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84ce92-8994-4c9f-b046-7345b1729461 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:39.958816 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1d375-acfa-47e8-8405-b1caf18e5736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:39.959613 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1d375-acfa-47e8-8405-b1caf18e5736 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:39.959900 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1d375-acfa-47e8-8405-b1caf18e5736 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:39.960179 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1d375-acfa-47e8-8405-b1caf18e5736 admin admin] PATH_INFO: `/v3/projects/cdc84d93949743579c8913af0813494a` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:39.961238 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1d375-acfa-47e8-8405-b1caf18e5736 admin admin] RBAC: Authorizing `identity:get_project(project_id=cdc84d93949743579c8913af0813494a)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:39.987475 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1d375-acfa-47e8-8405-b1caf18e5736 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:39.988981 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 152/304] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:49:39 2021] GET /identity/v3/projects/cdc84d93949743579c8913af0813494a => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:39.993763 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e211f2-bdaf-4211-80fd-3b874831210a admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:40.002099 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e211f2-bdaf-4211-80fd-3b874831210a admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:40.005978 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa78635-c91d-4c32-9887-47555ec1e50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:40.006734 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa78635-c91d-4c32-9887-47555ec1e50b admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:40.007020 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa78635-c91d-4c32-9887-47555ec1e50b admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:40.007300 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa78635-c91d-4c32-9887-47555ec1e50b admin admin] PATH_INFO: `/v3/groups/6cac8542a56d41669279354570b9ac7a` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:40.008380 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa78635-c91d-4c32-9887-47555ec1e50b admin admin] RBAC: Authorizing `identity:get_group(group_id=6cac8542a56d41669279354570b9ac7a)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:40.033881 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa78635-c91d-4c32-9887-47555ec1e50b admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:40.035283 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 153/305] 10.222.0.89 () {56 vars in 1201 bytes} [Wed Oct 27 14:49:39 2021] GET /identity/v3/groups/6cac8542a56d41669279354570b9ac7a => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:40.040509 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1d375-acfa-47e8-8405-b1caf18e5736 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:40.049864 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1d375-acfa-47e8-8405-b1caf18e5736 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:40.053636 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da1258-a51e-4acd-a1ca-37fd614c513a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:40.054183 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da1258-a51e-4acd-a1ca-37fd614c513a admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:40.054469 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da1258-a51e-4acd-a1ca-37fd614c513a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:40.054748 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da1258-a51e-4acd-a1ca-37fd614c513a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:40.055542 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da1258-a51e-4acd-a1ca-37fd614c513a admin admin] RBAC: Adding query filter params (group.id=6cac8542a56d41669279354570b9ac7a, role.id=cb40c4204c4e49d8b874875a1a860a9c, scope.project.id=cdc84d93949743579c8913af0813494a) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:40.055843 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da1258-a51e-4acd-a1ca-37fd614c513a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:40.080495 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da1258-a51e-4acd-a1ca-37fd614c513a admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:40.085970 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 153/306] 10.222.0.89 () {56 vars in 1397 bytes} [Wed Oct 27 14:49:40 2021] GET /identity/v3/role_assignments?group.id=6cac8542a56d41669279354570b9ac7a&scope.project.id=cdc84d93949743579c8913af0813494a&role.id=cb40c4204c4e49d8b874875a1a860a9c => generated 611 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:42.027968 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cf7e3-2ad7-41c6-8b84-123b2e18b66e None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:42.028524 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cf7e3-2ad7-41c6-8b84-123b2e18b66e None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:42.028524 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4cf7e3-2ad7-41c6-8b84-123b2e18b66e None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:42.030859 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 154/307] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:49:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:49:42.035889 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac4220-864c-4386-b4a7-13e5f3c8f6bd None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:42.036305 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac4220-864c-4386-b4a7-13e5f3c8f6bd None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:42.036453 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ac4220-864c-4386-b4a7-13e5f3c8f6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:42.059256 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-c2ac4220-864c-4386-b4a7-13e5f3c8f6bd None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:49:42.061059 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-c2ac4220-864c-4386-b4a7-13e5f3c8f6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:49:42.067638 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 154/308] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:49:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:49:42.089308 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4cf7e3-2ad7-41c6-8b84-123b2e18b66e None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:42.100610 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4cf7e3-2ad7-41c6-8b84-123b2e18b66e None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:42.104680 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f299a5-a694-4beb-967c-2fe1564a5d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:42.105404 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f299a5-a694-4beb-967c-2fe1564a5d9c admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:42.105692 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f299a5-a694-4beb-967c-2fe1564a5d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:42.105971 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f299a5-a694-4beb-967c-2fe1564a5d9c admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:42.117582 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f299a5-a694-4beb-967c-2fe1564a5d9c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:49:42.124859 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-55f299a5-a694-4beb-967c-2fe1564a5d9c admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 14:49:42.125920 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 155/309] 10.222.0.89 () {56 vars in 1135 bytes} [Wed Oct 27 14:49:42 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:49:42.131156 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac4220-864c-4386-b4a7-13e5f3c8f6bd None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:42.139432 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ac4220-864c-4386-b4a7-13e5f3c8f6bd None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:42.143287 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d79c3-0265-4dc6-a2a7-bf3b6ea20cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:42.143911 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d79c3-0265-4dc6-a2a7-bf3b6ea20cdc admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:42.144199 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d79c3-0265-4dc6-a2a7-bf3b6ea20cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:42.144478 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d79c3-0265-4dc6-a2a7-bf3b6ea20cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:42.145186 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d79c3-0265-4dc6-a2a7-bf3b6ea20cdc admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:42.145485 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d79c3-0265-4dc6-a2a7-bf3b6ea20cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:42.170972 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d79c3-0265-4dc6-a2a7-bf3b6ea20cdc admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:42.179086 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 155/310] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:49:42 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:42.184135 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f299a5-a694-4beb-967c-2fe1564a5d9c admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:42.194642 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f299a5-a694-4beb-967c-2fe1564a5d9c admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:42.198446 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296b4e7-9e37-4f06-b11a-b878ee602643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:42.198999 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296b4e7-9e37-4f06-b11a-b878ee602643 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:42.199286 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296b4e7-9e37-4f06-b11a-b878ee602643 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:42.199607 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296b4e7-9e37-4f06-b11a-b878ee602643 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:42.207114 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296b4e7-9e37-4f06-b11a-b878ee602643 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:42.233140 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296b4e7-9e37-4f06-b11a-b878ee602643 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:42.241622 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 156/311] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:49:42 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:49:42.247111 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d79c3-0265-4dc6-a2a7-bf3b6ea20cdc admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:42.256231 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d79c3-0265-4dc6-a2a7-bf3b6ea20cdc admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:42.260069 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e75c7-b4d9-48e8-872b-5b35944f0f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:42.260845 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e75c7-b4d9-48e8-872b-5b35944f0f27 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:42.261129 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e75c7-b4d9-48e8-872b-5b35944f0f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:42.261402 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e75c7-b4d9-48e8-872b-5b35944f0f27 admin admin] PATH_INFO: `/v3/projects/cdc84d93949743579c8913af0813494a` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:42.262450 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e75c7-b4d9-48e8-872b-5b35944f0f27 admin admin] RBAC: Authorizing `identity:get_project(project_id=cdc84d93949743579c8913af0813494a)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:42.288334 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e75c7-b4d9-48e8-872b-5b35944f0f27 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:42.290025 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 156/312] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:49:42 2021] GET /identity/v3/projects/cdc84d93949743579c8913af0813494a => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:49:42.295597 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296b4e7-9e37-4f06-b11a-b878ee602643 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:42.303952 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296b4e7-9e37-4f06-b11a-b878ee602643 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:42.307828 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a7aba-e038-4084-af6a-6d186ac91181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:42.308581 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a7aba-e038-4084-af6a-6d186ac91181 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:42.308869 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a7aba-e038-4084-af6a-6d186ac91181 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:42.309147 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a7aba-e038-4084-af6a-6d186ac91181 admin admin] PATH_INFO: `/v3/groups/6cac8542a56d41669279354570b9ac7a` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:42.310184 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a7aba-e038-4084-af6a-6d186ac91181 admin admin] RBAC: Authorizing `identity:get_group(group_id=6cac8542a56d41669279354570b9ac7a)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:42.335085 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a7aba-e038-4084-af6a-6d186ac91181 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:42.336524 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 157/313] 10.222.0.89 () {56 vars in 1201 bytes} [Wed Oct 27 14:49:42 2021] GET /identity/v3/groups/6cac8542a56d41669279354570b9ac7a => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:49:42.341535 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e75c7-b4d9-48e8-872b-5b35944f0f27 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:42.350987 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e75c7-b4d9-48e8-872b-5b35944f0f27 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:42.354804 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d382b52-5053-46e4-b495-3fda60fbdd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:42.355362 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d382b52-5053-46e4-b495-3fda60fbdd7b admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:42.355683 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d382b52-5053-46e4-b495-3fda60fbdd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:42.355966 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d382b52-5053-46e4-b495-3fda60fbdd7b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:42.356764 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d382b52-5053-46e4-b495-3fda60fbdd7b admin admin] RBAC: Adding query filter params (group.id=6cac8542a56d41669279354570b9ac7a, role.id=f98faade9eb9460b9aa1049aef51b342, scope.project.id=cdc84d93949743579c8913af0813494a) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:42.357066 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d382b52-5053-46e4-b495-3fda60fbdd7b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:42.383296 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d382b52-5053-46e4-b495-3fda60fbdd7b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:42.388507 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 157/314] 10.222.0.89 () {56 vars in 1397 bytes} [Wed Oct 27 14:49:42 2021] GET /identity/v3/role_assignments?group.id=6cac8542a56d41669279354570b9ac7a&scope.project.id=cdc84d93949743579c8913af0813494a&role.id=f98faade9eb9460b9aa1049aef51b342 => generated 260 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:44.297114 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85035e56-da91-43b6-8634-afaa0ac4494c None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:44.297582 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85035e56-da91-43b6-8634-afaa0ac4494c None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:44.297666 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85035e56-da91-43b6-8634-afaa0ac4494c None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:44.299345 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 158/315] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:49:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:49:44.304461 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b893e10-8222-42bf-a44b-3d29dbda807b None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:44.304883 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b893e10-8222-42bf-a44b-3d29dbda807b None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:44.305033 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b893e10-8222-42bf-a44b-3d29dbda807b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:44.327342 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-9b893e10-8222-42bf-a44b-3d29dbda807b None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:49:44.328497 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-9b893e10-8222-42bf-a44b-3d29dbda807b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:49:44.335054 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 158/316] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:49:44 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:49:44.356722 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85035e56-da91-43b6-8634-afaa0ac4494c None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:44.368543 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85035e56-da91-43b6-8634-afaa0ac4494c None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:44.372422 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce859338-53dc-455a-bedf-95a719967df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:44.373720 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce859338-53dc-455a-bedf-95a719967df4 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:44.374007 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce859338-53dc-455a-bedf-95a719967df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:44.374286 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce859338-53dc-455a-bedf-95a719967df4 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:44.385182 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce859338-53dc-455a-bedf-95a719967df4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:49:44.391958 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-ce859338-53dc-455a-bedf-95a719967df4 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 14:49:44.393007 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 159/317] 10.222.0.89 () {56 vars in 1135 bytes} [Wed Oct 27 14:49:44 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:49:44.398313 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b893e10-8222-42bf-a44b-3d29dbda807b None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:44.406649 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b893e10-8222-42bf-a44b-3d29dbda807b None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:44.410501 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9a288-879a-4ce3-8f6e-4980897327ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:44.411088 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9a288-879a-4ce3-8f6e-4980897327ba admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:44.411375 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9a288-879a-4ce3-8f6e-4980897327ba admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:44.411688 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9a288-879a-4ce3-8f6e-4980897327ba admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:44.412389 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9a288-879a-4ce3-8f6e-4980897327ba admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:44.412687 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9a288-879a-4ce3-8f6e-4980897327ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:44.438803 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9a288-879a-4ce3-8f6e-4980897327ba admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:44.446923 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 159/318] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:49:44 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:44.451881 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce859338-53dc-455a-bedf-95a719967df4 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:44.461685 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce859338-53dc-455a-bedf-95a719967df4 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:44.465525 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a50b1-aab8-40b6-adc4-733a1e954372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:44.466264 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a50b1-aab8-40b6-adc4-733a1e954372 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:44.467045 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a50b1-aab8-40b6-adc4-733a1e954372 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:44.467326 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a50b1-aab8-40b6-adc4-733a1e954372 admin admin] PATH_INFO: `/v3/groups/6cac8542a56d41669279354570b9ac7a` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:44.468403 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a50b1-aab8-40b6-adc4-733a1e954372 admin admin] RBAC: Authorizing `identity:get_group(group_id=6cac8542a56d41669279354570b9ac7a)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:44.493910 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a50b1-aab8-40b6-adc4-733a1e954372 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:44.495321 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 160/319] 10.222.0.89 () {56 vars in 1201 bytes} [Wed Oct 27 14:49:44 2021] GET /identity/v3/groups/6cac8542a56d41669279354570b9ac7a => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:44.500121 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9a288-879a-4ce3-8f6e-4980897327ba admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:44.508892 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9a288-879a-4ce3-8f6e-4980897327ba admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:44.512676 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abd2b0-cc9e-4ffc-a696-e15e8ef0e3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:44.513432 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abd2b0-cc9e-4ffc-a696-e15e8ef0e3eb admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:44.513718 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abd2b0-cc9e-4ffc-a696-e15e8ef0e3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:44.513998 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abd2b0-cc9e-4ffc-a696-e15e8ef0e3eb admin admin] PATH_INFO: `/v3/projects/cdc84d93949743579c8913af0813494a` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:44.515050 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4abd2b0-cc9e-4ffc-a696-e15e8ef0e3eb admin admin] RBAC: Authorizing `identity:get_project(project_id=cdc84d93949743579c8913af0813494a)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:44.540958 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4abd2b0-cc9e-4ffc-a696-e15e8ef0e3eb admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:44.542415 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 160/320] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:49:44 2021] GET /identity/v3/projects/cdc84d93949743579c8913af0813494a => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:44.547862 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a50b1-aab8-40b6-adc4-733a1e954372 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:44.556674 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a50b1-aab8-40b6-adc4-733a1e954372 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:44.561064 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f6a2e-cc40-408c-b94b-4aa8bb682779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:44.561827 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f6a2e-cc40-408c-b94b-4aa8bb682779 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:44.562111 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f6a2e-cc40-408c-b94b-4aa8bb682779 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:44.562392 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f6a2e-cc40-408c-b94b-4aa8bb682779 admin admin] PATH_INFO: `/v3/projects/cdc84d93949743579c8913af0813494a/groups/6cac8542a56d41669279354570b9ac7a/roles/f98faade9eb9460b9aa1049aef51b342` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:44.564332 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f6a2e-cc40-408c-b94b-4aa8bb682779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdc84d93949743579c8913af0813494a, group_id=6cac8542a56d41669279354570b9ac7a, role_id=f98faade9eb9460b9aa1049aef51b342)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:44.590792 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736f6a2e-cc40-408c-b94b-4aa8bb682779 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:44.602345 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 161/321] 10.222.0.89 () {58 vars in 1463 bytes} [Wed Oct 27 14:49:44 2021] PUT /identity/v3/projects/cdc84d93949743579c8913af0813494a/groups/6cac8542a56d41669279354570b9ac7a/roles/f98faade9eb9460b9aa1049aef51b342 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:49:46.509216 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9a264-98d8-4655-829a-ebaf5d57a366 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:46.509709 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9a264-98d8-4655-829a-ebaf5d57a366 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:46.509709 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a9a264-98d8-4655-829a-ebaf5d57a366 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:46.511366 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 161/322] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:49:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:49:46.516813 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e897bb4-9f72-4588-8bba-13d79d11c105 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:46.517257 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e897bb4-9f72-4588-8bba-13d79d11c105 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:46.517380 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e897bb4-9f72-4588-8bba-13d79d11c105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:46.540028 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-4e897bb4-9f72-4588-8bba-13d79d11c105 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:49:46.541139 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-4e897bb4-9f72-4588-8bba-13d79d11c105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:49:46.602210 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 162/323] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:49:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:49:46.624990 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9a264-98d8-4655-829a-ebaf5d57a366 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:46.636295 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a9a264-98d8-4655-829a-ebaf5d57a366 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:46.640099 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a6d90-0075-4169-90fa-6667d033c48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:46.640823 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a6d90-0075-4169-90fa-6667d033c48b admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:46.641111 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a6d90-0075-4169-90fa-6667d033c48b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:46.641387 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a6d90-0075-4169-90fa-6667d033c48b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:46.653019 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a6d90-0075-4169-90fa-6667d033c48b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:49:46.659647 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-d47a6d90-0075-4169-90fa-6667d033c48b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 14:49:46.660716 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 162/324] 10.222.0.89 () {56 vars in 1135 bytes} [Wed Oct 27 14:49:46 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:49:46.666281 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e897bb4-9f72-4588-8bba-13d79d11c105 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:46.675053 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e897bb4-9f72-4588-8bba-13d79d11c105 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:46.678894 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531179c6-6493-4666-bb96-3b7118a8dad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:46.679505 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531179c6-6493-4666-bb96-3b7118a8dad5 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:46.679794 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531179c6-6493-4666-bb96-3b7118a8dad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:46.680070 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531179c6-6493-4666-bb96-3b7118a8dad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:46.680774 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531179c6-6493-4666-bb96-3b7118a8dad5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:46.681070 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531179c6-6493-4666-bb96-3b7118a8dad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:46.706583 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531179c6-6493-4666-bb96-3b7118a8dad5 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:46.714694 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 163/325] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:49:46 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:46.720353 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a6d90-0075-4169-90fa-6667d033c48b admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:46.729304 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a6d90-0075-4169-90fa-6667d033c48b admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:46.733687 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28850a59-f80f-45c3-848f-78e75cb08645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:46.734244 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28850a59-f80f-45c3-848f-78e75cb08645 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:46.734530 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28850a59-f80f-45c3-848f-78e75cb08645 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:46.734814 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28850a59-f80f-45c3-848f-78e75cb08645 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:46.742269 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28850a59-f80f-45c3-848f-78e75cb08645 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:46.767268 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28850a59-f80f-45c3-848f-78e75cb08645 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:46.775400 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 163/326] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:49:46 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:49:46.781157 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531179c6-6493-4666-bb96-3b7118a8dad5 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:46.790197 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531179c6-6493-4666-bb96-3b7118a8dad5 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:46.793968 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b58fc-1206-41f7-a9c6-4dcd14d98095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:46.795260 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b58fc-1206-41f7-a9c6-4dcd14d98095 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:46.795577 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b58fc-1206-41f7-a9c6-4dcd14d98095 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:46.795855 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b58fc-1206-41f7-a9c6-4dcd14d98095 admin admin] PATH_INFO: `/v3/projects/cdc84d93949743579c8913af0813494a` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:46.796903 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b58fc-1206-41f7-a9c6-4dcd14d98095 admin admin] RBAC: Authorizing `identity:get_project(project_id=cdc84d93949743579c8913af0813494a)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:46.821997 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b58fc-1206-41f7-a9c6-4dcd14d98095 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:46.823479 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 164/327] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:49:46 2021] GET /identity/v3/projects/cdc84d93949743579c8913af0813494a => generated 302 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:46.828236 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28850a59-f80f-45c3-848f-78e75cb08645 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:46.836297 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28850a59-f80f-45c3-848f-78e75cb08645 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:46.840123 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf11c0-e18b-40dd-a2f9-7c79d37aca78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:46.840867 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf11c0-e18b-40dd-a2f9-7c79d37aca78 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:46.841154 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf11c0-e18b-40dd-a2f9-7c79d37aca78 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:46.841435 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf11c0-e18b-40dd-a2f9-7c79d37aca78 admin admin] PATH_INFO: `/v3/groups/6cac8542a56d41669279354570b9ac7a` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:46.842986 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf11c0-e18b-40dd-a2f9-7c79d37aca78 admin admin] RBAC: Authorizing `identity:get_group(group_id=6cac8542a56d41669279354570b9ac7a)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:46.868667 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf11c0-e18b-40dd-a2f9-7c79d37aca78 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:46.870069 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 164/328] 10.222.0.89 () {56 vars in 1201 bytes} [Wed Oct 27 14:49:46 2021] GET /identity/v3/groups/6cac8542a56d41669279354570b9ac7a => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:46.875089 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b58fc-1206-41f7-a9c6-4dcd14d98095 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:46.883806 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b58fc-1206-41f7-a9c6-4dcd14d98095 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:46.887586 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a2717-b27d-40bf-8b3b-1974e03c4255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:46.888128 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a2717-b27d-40bf-8b3b-1974e03c4255 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:46.888413 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a2717-b27d-40bf-8b3b-1974e03c4255 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:46.888689 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a2717-b27d-40bf-8b3b-1974e03c4255 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:46.889446 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a2717-b27d-40bf-8b3b-1974e03c4255 admin admin] RBAC: Adding query filter params (group.id=6cac8542a56d41669279354570b9ac7a, role.id=f98faade9eb9460b9aa1049aef51b342, scope.project.id=cdc84d93949743579c8913af0813494a) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:46.889749 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a2717-b27d-40bf-8b3b-1974e03c4255 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:46.915245 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a2717-b27d-40bf-8b3b-1974e03c4255 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:46.921558 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 165/329] 10.222.0.89 () {56 vars in 1397 bytes} [Wed Oct 27 14:49:46 2021] GET /identity/v3/role_assignments?group.id=6cac8542a56d41669279354570b9ac7a&scope.project.id=cdc84d93949743579c8913af0813494a&role.id=f98faade9eb9460b9aa1049aef51b342 => generated 611 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:48.856849 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee386eaf-c94c-4d3a-add3-df122ad93e82 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:48.857404 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee386eaf-c94c-4d3a-add3-df122ad93e82 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:48.857502 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee386eaf-c94c-4d3a-add3-df122ad93e82 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:48.859106 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 165/330] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:49:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:49:48.864286 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49ad88-00ba-4a62-9431-05090e39946b None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:48.864682 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49ad88-00ba-4a62-9431-05090e39946b None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:48.864853 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49ad88-00ba-4a62-9431-05090e39946b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:48.886684 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-6f49ad88-00ba-4a62-9431-05090e39946b None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:49:48.887827 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-6f49ad88-00ba-4a62-9431-05090e39946b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:49:48.894787 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 166/331] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:49:48 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:49:48.916991 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee386eaf-c94c-4d3a-add3-df122ad93e82 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:48.928283 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee386eaf-c94c-4d3a-add3-df122ad93e82 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:48.932054 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936a9d6-700a-40fe-9fcb-091f156aeb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:48.932753 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936a9d6-700a-40fe-9fcb-091f156aeb87 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:48.933040 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936a9d6-700a-40fe-9fcb-091f156aeb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:48.933319 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e936a9d6-700a-40fe-9fcb-091f156aeb87 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:48.944168 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e936a9d6-700a-40fe-9fcb-091f156aeb87 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:49:48.950421 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-e936a9d6-700a-40fe-9fcb-091f156aeb87 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 14:49:48.951994 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 166/332] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:49:48 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:49:48.957130 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49ad88-00ba-4a62-9431-05090e39946b None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:48.965406 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49ad88-00ba-4a62-9431-05090e39946b None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:48.969949 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bdadd7-693a-4a95-bfcb-10352c6fc719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:48.970527 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bdadd7-693a-4a95-bfcb-10352c6fc719 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:48.970815 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bdadd7-693a-4a95-bfcb-10352c6fc719 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:48.971094 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bdadd7-693a-4a95-bfcb-10352c6fc719 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:48.971836 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bdadd7-693a-4a95-bfcb-10352c6fc719 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:48.972135 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bdadd7-693a-4a95-bfcb-10352c6fc719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:48.996964 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bdadd7-693a-4a95-bfcb-10352c6fc719 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:49.005704 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 167/333] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:49:48 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:49.010895 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936a9d6-700a-40fe-9fcb-091f156aeb87 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:49.021481 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e936a9d6-700a-40fe-9fcb-091f156aeb87 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:49.025330 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcc558-a5d5-4cee-9ce6-9ad88c9d71a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:49.025886 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcc558-a5d5-4cee-9ce6-9ad88c9d71a1 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:49.026172 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcc558-a5d5-4cee-9ce6-9ad88c9d71a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:49.026451 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbcc558-a5d5-4cee-9ce6-9ad88c9d71a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:49.033941 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbcc558-a5d5-4cee-9ce6-9ad88c9d71a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:49.059124 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbcc558-a5d5-4cee-9ce6-9ad88c9d71a1 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:49.067840 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 167/334] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:49:49 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:49:49.073034 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bdadd7-693a-4a95-bfcb-10352c6fc719 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:49.082408 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bdadd7-693a-4a95-bfcb-10352c6fc719 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:49.086212 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3d37b-9951-4f42-a7d0-fab7b3231659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:49.086966 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3d37b-9951-4f42-a7d0-fab7b3231659 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:49.087251 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3d37b-9951-4f42-a7d0-fab7b3231659 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:49.087561 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3d37b-9951-4f42-a7d0-fab7b3231659 admin admin] PATH_INFO: `/v3/projects/788e6d12550a446aa50a0962b825388d` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:49.088613 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3d37b-9951-4f42-a7d0-fab7b3231659 admin admin] RBAC: Authorizing `identity:get_project(project_id=788e6d12550a446aa50a0962b825388d)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:49.113343 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3d37b-9951-4f42-a7d0-fab7b3231659 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:49.114755 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 168/335] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:49:49 2021] GET /identity/v3/projects/788e6d12550a446aa50a0962b825388d => generated 344 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:49.119898 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcc558-a5d5-4cee-9ce6-9ad88c9d71a1 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:49.128441 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbcc558-a5d5-4cee-9ce6-9ad88c9d71a1 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:49.132318 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99adb6b-726f-4186-89a8-06f1ec725b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:49.133064 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99adb6b-726f-4186-89a8-06f1ec725b03 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:49.133352 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99adb6b-726f-4186-89a8-06f1ec725b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:49.133631 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99adb6b-726f-4186-89a8-06f1ec725b03 admin admin] PATH_INFO: `/v3/groups/6a6edc31a5124838aab8b72034f797ed` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:49.138124 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99adb6b-726f-4186-89a8-06f1ec725b03 admin admin] RBAC: Authorizing `identity:get_group(group_id=6a6edc31a5124838aab8b72034f797ed)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:49.163693 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99adb6b-726f-4186-89a8-06f1ec725b03 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:49.165373 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 168/336] 10.222.0.89 () {56 vars in 1201 bytes} [Wed Oct 27 14:49:49 2021] GET /identity/v3/groups/6a6edc31a5124838aab8b72034f797ed => generated 229 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:49.170400 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3d37b-9951-4f42-a7d0-fab7b3231659 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:49.179172 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3d37b-9951-4f42-a7d0-fab7b3231659 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:49.182994 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c65c6-a9ee-4a57-bd14-fbb35b2cfd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:49.183569 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c65c6-a9ee-4a57-bd14-fbb35b2cfd2a admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:49.183854 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c65c6-a9ee-4a57-bd14-fbb35b2cfd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:49.184129 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c65c6-a9ee-4a57-bd14-fbb35b2cfd2a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:49.184884 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c65c6-a9ee-4a57-bd14-fbb35b2cfd2a admin admin] RBAC: Adding query filter params (group.id=6a6edc31a5124838aab8b72034f797ed, role.id=c243fbeb99ae4f51910f72ddc1773778, scope.project.id=788e6d12550a446aa50a0962b825388d) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:49.185682 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c65c6-a9ee-4a57-bd14-fbb35b2cfd2a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:49.211242 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c65c6-a9ee-4a57-bd14-fbb35b2cfd2a admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:49.226916 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 169/337] 10.222.0.89 () {56 vars in 1397 bytes} [Wed Oct 27 14:49:49 2021] GET /identity/v3/role_assignments?group.id=6a6edc31a5124838aab8b72034f797ed&scope.project.id=788e6d12550a446aa50a0962b825388d&role.id=c243fbeb99ae4f51910f72ddc1773778 => generated 260 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:51.146337 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131d662-41de-459a-93f2-593bf7a0d5fb None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:51.146856 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131d662-41de-459a-93f2-593bf7a0d5fb None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:51.146965 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131d662-41de-459a-93f2-593bf7a0d5fb None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:51.148608 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 169/338] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:49:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:49:51.153637 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a4338-f143-49d6-bdbe-b3e426287c67 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:51.154608 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a4338-f143-49d6-bdbe-b3e426287c67 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:51.154787 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a4338-f143-49d6-bdbe-b3e426287c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:51.178141 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-102a4338-f143-49d6-bdbe-b3e426287c67 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:49:51.179263 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-102a4338-f143-49d6-bdbe-b3e426287c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:49:51.185841 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 170/339] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:49:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:49:51.207181 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131d662-41de-459a-93f2-593bf7a0d5fb None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:51.219162 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131d662-41de-459a-93f2-593bf7a0d5fb None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:51.223014 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afe8b9-6f69-4ce1-8d62-16f312ac6602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:51.223750 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afe8b9-6f69-4ce1-8d62-16f312ac6602 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:51.224035 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afe8b9-6f69-4ce1-8d62-16f312ac6602 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:51.224311 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73afe8b9-6f69-4ce1-8d62-16f312ac6602 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:51.235178 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73afe8b9-6f69-4ce1-8d62-16f312ac6602 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:49:51.241502 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-73afe8b9-6f69-4ce1-8d62-16f312ac6602 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 14:49:51.242580 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 170/340] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:49:51 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:49:51.248613 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a4338-f143-49d6-bdbe-b3e426287c67 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:51.257028 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a4338-f143-49d6-bdbe-b3e426287c67 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:51.260899 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1afd6-95d0-47d8-93b4-5176ef7138d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:51.261485 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1afd6-95d0-47d8-93b4-5176ef7138d0 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:51.261771 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1afd6-95d0-47d8-93b4-5176ef7138d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:51.262049 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1afd6-95d0-47d8-93b4-5176ef7138d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:51.262753 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1afd6-95d0-47d8-93b4-5176ef7138d0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:51.263047 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1afd6-95d0-47d8-93b4-5176ef7138d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:51.288448 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c1afd6-95d0-47d8-93b4-5176ef7138d0 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:51.297203 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 171/341] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:49:51 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:49:51.302403 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afe8b9-6f69-4ce1-8d62-16f312ac6602 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:51.312914 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73afe8b9-6f69-4ce1-8d62-16f312ac6602 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:51.316911 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10506f1a-0c49-4ce6-b25c-9efb5318e541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:51.317662 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10506f1a-0c49-4ce6-b25c-9efb5318e541 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:51.317950 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10506f1a-0c49-4ce6-b25c-9efb5318e541 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:51.318230 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10506f1a-0c49-4ce6-b25c-9efb5318e541 admin admin] PATH_INFO: `/v3/groups/6a6edc31a5124838aab8b72034f797ed` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:51.319278 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10506f1a-0c49-4ce6-b25c-9efb5318e541 admin admin] RBAC: Authorizing `identity:get_group(group_id=6a6edc31a5124838aab8b72034f797ed)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:51.344808 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10506f1a-0c49-4ce6-b25c-9efb5318e541 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:51.346216 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 171/342] 10.222.0.89 () {56 vars in 1201 bytes} [Wed Oct 27 14:49:51 2021] GET /identity/v3/groups/6a6edc31a5124838aab8b72034f797ed => generated 229 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:51.351020 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1afd6-95d0-47d8-93b4-5176ef7138d0 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:51.359893 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1afd6-95d0-47d8-93b4-5176ef7138d0 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:51.363690 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d570661-7395-4766-869d-298d5f8a0f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:51.364447 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d570661-7395-4766-869d-298d5f8a0f8b admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:51.364727 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d570661-7395-4766-869d-298d5f8a0f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:51.365005 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d570661-7395-4766-869d-298d5f8a0f8b admin admin] PATH_INFO: `/v3/projects/788e6d12550a446aa50a0962b825388d` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:51.366048 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d570661-7395-4766-869d-298d5f8a0f8b admin admin] RBAC: Authorizing `identity:get_project(project_id=788e6d12550a446aa50a0962b825388d)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:51.391929 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d570661-7395-4766-869d-298d5f8a0f8b admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:51.393398 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 172/343] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:49:51 2021] GET /identity/v3/projects/788e6d12550a446aa50a0962b825388d => generated 344 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:51.398375 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10506f1a-0c49-4ce6-b25c-9efb5318e541 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:51.407631 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10506f1a-0c49-4ce6-b25c-9efb5318e541 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:51.411613 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe719598-f2c3-48c0-a8cb-cef2cfe10f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:51.412393 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe719598-f2c3-48c0-a8cb-cef2cfe10f6b admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:51.412684 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe719598-f2c3-48c0-a8cb-cef2cfe10f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:51.412965 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe719598-f2c3-48c0-a8cb-cef2cfe10f6b admin admin] PATH_INFO: `/v3/projects/788e6d12550a446aa50a0962b825388d/groups/6a6edc31a5124838aab8b72034f797ed/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:51.414916 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe719598-f2c3-48c0-a8cb-cef2cfe10f6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=788e6d12550a446aa50a0962b825388d, group_id=6a6edc31a5124838aab8b72034f797ed, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:51.441405 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe719598-f2c3-48c0-a8cb-cef2cfe10f6b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:51.454709 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 172/344] 10.222.0.89 () {58 vars in 1463 bytes} [Wed Oct 27 14:49:51 2021] PUT /identity/v3/projects/788e6d12550a446aa50a0962b825388d/groups/6a6edc31a5124838aab8b72034f797ed/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:49:53.367374 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a7bc6-5727-4acd-893f-f78a38ea535a None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:53.367880 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a7bc6-5727-4acd-893f-f78a38ea535a None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:53.367990 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a7bc6-5727-4acd-893f-f78a38ea535a None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:53.369615 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 173/345] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:49:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:49:53.375287 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b51bd-3b32-4681-9851-40f5b5c3e47f None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:53.375736 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b51bd-3b32-4681-9851-40f5b5c3e47f None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:53.375887 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b51bd-3b32-4681-9851-40f5b5c3e47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:53.397692 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-337b51bd-3b32-4681-9851-40f5b5c3e47f None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:49:53.398816 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-337b51bd-3b32-4681-9851-40f5b5c3e47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:49:53.462271 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 173/346] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:49:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:49:53.484616 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a7bc6-5727-4acd-893f-f78a38ea535a None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:53.495949 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a7bc6-5727-4acd-893f-f78a38ea535a None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:53.500261 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9204e5-7503-4085-980b-5bc104421fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:53.500976 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9204e5-7503-4085-980b-5bc104421fec admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:53.501256 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9204e5-7503-4085-980b-5bc104421fec admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:53.501535 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9204e5-7503-4085-980b-5bc104421fec admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:53.513891 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9204e5-7503-4085-980b-5bc104421fec admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:49:53.520097 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-2a9204e5-7503-4085-980b-5bc104421fec admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 14:49:53.521154 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 174/347] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:49:53 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:49:53.526376 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b51bd-3b32-4681-9851-40f5b5c3e47f None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:53.534751 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b51bd-3b32-4681-9851-40f5b5c3e47f None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:53.538629 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d441681-d17a-4b4d-837e-357298a54dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:53.539490 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d441681-d17a-4b4d-837e-357298a54dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:53.539786 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d441681-d17a-4b4d-837e-357298a54dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:53.540063 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d441681-d17a-4b4d-837e-357298a54dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:53.540772 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d441681-d17a-4b4d-837e-357298a54dd0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:53.541069 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d441681-d17a-4b4d-837e-357298a54dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:53.566260 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d441681-d17a-4b4d-837e-357298a54dd0 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:53.574504 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 174/348] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:49:53 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:53.580145 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9204e5-7503-4085-980b-5bc104421fec admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:53.589085 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9204e5-7503-4085-980b-5bc104421fec admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:53.593407 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3b9f0-216b-4bc9-84a9-4f25df3b7925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:53.593957 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3b9f0-216b-4bc9-84a9-4f25df3b7925 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:53.594239 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3b9f0-216b-4bc9-84a9-4f25df3b7925 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:53.594514 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3b9f0-216b-4bc9-84a9-4f25df3b7925 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:53.602033 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f3b9f0-216b-4bc9-84a9-4f25df3b7925 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:53.627455 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f3b9f0-216b-4bc9-84a9-4f25df3b7925 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:53.635648 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 175/349] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:49:53 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:49:53.640661 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d441681-d17a-4b4d-837e-357298a54dd0 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:53.649418 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d441681-d17a-4b4d-837e-357298a54dd0 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:53.653237 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15a922-86f9-429b-8b1c-7f978357fe33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:53.654495 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15a922-86f9-429b-8b1c-7f978357fe33 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:53.654783 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15a922-86f9-429b-8b1c-7f978357fe33 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:53.655064 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c15a922-86f9-429b-8b1c-7f978357fe33 admin admin] PATH_INFO: `/v3/projects/788e6d12550a446aa50a0962b825388d` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:53.656152 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15a922-86f9-429b-8b1c-7f978357fe33 admin admin] RBAC: Authorizing `identity:get_project(project_id=788e6d12550a446aa50a0962b825388d)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:53.681759 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c15a922-86f9-429b-8b1c-7f978357fe33 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:53.683220 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 175/350] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:49:53 2021] GET /identity/v3/projects/788e6d12550a446aa50a0962b825388d => generated 344 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:53.688165 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3b9f0-216b-4bc9-84a9-4f25df3b7925 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:53.696217 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f3b9f0-216b-4bc9-84a9-4f25df3b7925 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:53.700033 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25d000-fccb-4fad-8cfd-5a756dd8b492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:53.700797 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25d000-fccb-4fad-8cfd-5a756dd8b492 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:53.701081 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25d000-fccb-4fad-8cfd-5a756dd8b492 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:53.701354 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25d000-fccb-4fad-8cfd-5a756dd8b492 admin admin] PATH_INFO: `/v3/groups/6a6edc31a5124838aab8b72034f797ed` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:53.702383 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa25d000-fccb-4fad-8cfd-5a756dd8b492 admin admin] RBAC: Authorizing `identity:get_group(group_id=6a6edc31a5124838aab8b72034f797ed)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:53.727739 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa25d000-fccb-4fad-8cfd-5a756dd8b492 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:53.729132 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 176/351] 10.222.0.89 () {56 vars in 1201 bytes} [Wed Oct 27 14:49:53 2021] GET /identity/v3/groups/6a6edc31a5124838aab8b72034f797ed => generated 229 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:53.734607 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15a922-86f9-429b-8b1c-7f978357fe33 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:53.743313 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c15a922-86f9-429b-8b1c-7f978357fe33 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:53.747103 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ebd142-2c21-42c7-9733-b7fab53534cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:53.747682 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebd142-2c21-42c7-9733-b7fab53534cc admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:53.747963 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebd142-2c21-42c7-9733-b7fab53534cc admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:53.748236 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ebd142-2c21-42c7-9733-b7fab53534cc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:53.748992 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ebd142-2c21-42c7-9733-b7fab53534cc admin admin] RBAC: Adding query filter params (group.id=6a6edc31a5124838aab8b72034f797ed, role.id=c243fbeb99ae4f51910f72ddc1773778, scope.project.id=788e6d12550a446aa50a0962b825388d) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:53.749287 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ebd142-2c21-42c7-9733-b7fab53534cc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:53.773918 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ebd142-2c21-42c7-9733-b7fab53534cc admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:53.779806 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 176/352] 10.222.0.89 () {56 vars in 1397 bytes} [Wed Oct 27 14:49:53 2021] GET /identity/v3/role_assignments?group.id=6a6edc31a5124838aab8b72034f797ed&scope.project.id=788e6d12550a446aa50a0962b825388d&role.id=c243fbeb99ae4f51910f72ddc1773778 => generated 611 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:49:55.753988 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b749f-39d6-4a57-93fe-35016f69f567 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:55.754532 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b749f-39d6-4a57-93fe-35016f69f567 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:55.754532 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b749f-39d6-4a57-93fe-35016f69f567 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:55.756247 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 177/353] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:49:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:49:55.761130 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7301ba2-ef3e-450e-bd06-f01554976033 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:55.761497 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7301ba2-ef3e-450e-bd06-f01554976033 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:55.761687 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7301ba2-ef3e-450e-bd06-f01554976033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:55.783811 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-f7301ba2-ef3e-450e-bd06-f01554976033 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:49:55.784922 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-f7301ba2-ef3e-450e-bd06-f01554976033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:49:55.791547 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 177/354] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:49:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:49:55.814025 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b749f-39d6-4a57-93fe-35016f69f567 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:55.825239 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b749f-39d6-4a57-93fe-35016f69f567 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:55.829570 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958d458-f453-42e5-88e1-dff8c9e78d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:55.830267 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958d458-f453-42e5-88e1-dff8c9e78d05 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:55.830550 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958d458-f453-42e5-88e1-dff8c9e78d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:55.830825 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958d458-f453-42e5-88e1-dff8c9e78d05 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:55.842559 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958d458-f453-42e5-88e1-dff8c9e78d05 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:55.867210 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958d458-f453-42e5-88e1-dff8c9e78d05 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:55.883856 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-5958d458-f453-42e5-88e1-dff8c9e78d05 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:49:55.884882 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 178/355] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:49:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:49:55.890034 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7301ba2-ef3e-450e-bd06-f01554976033 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:55.898281 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7301ba2-ef3e-450e-bd06-f01554976033 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:55.902041 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48825795-4034-46f5-a540-f28cf3a6aef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:55.902618 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48825795-4034-46f5-a540-f28cf3a6aef1 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:55.902900 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48825795-4034-46f5-a540-f28cf3a6aef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:55.903173 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48825795-4034-46f5-a540-f28cf3a6aef1 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:55.904413 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48825795-4034-46f5-a540-f28cf3a6aef1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:55.904706 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48825795-4034-46f5-a540-f28cf3a6aef1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:55.930249 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48825795-4034-46f5-a540-f28cf3a6aef1 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:55.942787 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 178/356] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:49:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:55.948305 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958d458-f453-42e5-88e1-dff8c9e78d05 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:55.957427 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958d458-f453-42e5-88e1-dff8c9e78d05 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:55.961248 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc1e2c3-a0e0-484a-9d56-0bfa587ca77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:55.961832 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1e2c3-a0e0-484a-9d56-0bfa587ca77f admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:55.962119 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1e2c3-a0e0-484a-9d56-0bfa587ca77f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:55.962399 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc1e2c3-a0e0-484a-9d56-0bfa587ca77f admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:55.963035 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1e2c3-a0e0-484a-9d56-0bfa587ca77f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:55.988419 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING py.warnings [None req-cfc1e2c3-a0e0-484a-9d56-0bfa587ca77f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:49:55.988419 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: warnings.warn(msg) Oct 27 14:49:55.988419 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: Oct 27 14:49:55.989593 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc1e2c3-a0e0-484a-9d56-0bfa587ca77f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:56.012454 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 179/357] 10.222.0.89 () {60 vars in 1153 bytes} [Wed Oct 27 14:49:55 2021] POST /identity/v3/users => generated 246 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:49:57.984346 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd174430-e4eb-4592-b99e-10e070640b41 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:57.984897 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd174430-e4eb-4592-b99e-10e070640b41 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:57.984897 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd174430-e4eb-4592-b99e-10e070640b41 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:57.986565 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 179/358] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:49:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 14:49:57.991690 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297d632-c546-4bcd-a31f-24addbf02141 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:57.992089 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297d632-c546-4bcd-a31f-24addbf02141 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:57.992251 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297d632-c546-4bcd-a31f-24addbf02141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:58.014655 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-8297d632-c546-4bcd-a31f-24addbf02141 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:49:58.015790 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-8297d632-c546-4bcd-a31f-24addbf02141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:49:58.022202 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 180/359] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:49:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:49:58.043834 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd174430-e4eb-4592-b99e-10e070640b41 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:58.055167 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd174430-e4eb-4592-b99e-10e070640b41 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:58.058959 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b8f49-fced-418c-b636-d4737b42dd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:58.059697 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b8f49-fced-418c-b636-d4737b42dd52 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:58.059988 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b8f49-fced-418c-b636-d4737b42dd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:58.060270 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b8f49-fced-418c-b636-d4737b42dd52 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:58.071708 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b8f49-fced-418c-b636-d4737b42dd52 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:49:58.078655 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-074b8f49-fced-418c-b636-d4737b42dd52 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 14:49:58.079739 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 180/360] 10.222.0.89 () {56 vars in 1123 bytes} [Wed Oct 27 14:49:58 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:49:58.084717 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297d632-c546-4bcd-a31f-24addbf02141 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:58.092962 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297d632-c546-4bcd-a31f-24addbf02141 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:58.096754 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248f0c4-f70d-4281-a1c9-8b32342150e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:58.097326 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248f0c4-f70d-4281-a1c9-8b32342150e3 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:58.097610 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248f0c4-f70d-4281-a1c9-8b32342150e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:58.097886 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248f0c4-f70d-4281-a1c9-8b32342150e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:58.098584 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248f0c4-f70d-4281-a1c9-8b32342150e3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:58.098878 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248f0c4-f70d-4281-a1c9-8b32342150e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:58.123924 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248f0c4-f70d-4281-a1c9-8b32342150e3 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:58.131938 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 181/361] 10.222.0.89 () {56 vars in 1124 bytes} [Wed Oct 27 14:49:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:58.137043 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b8f49-fced-418c-b636-d4737b42dd52 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:58.146956 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b8f49-fced-418c-b636-d4737b42dd52 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:58.150766 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ca7a1-f3a8-43cc-82cb-e1326bc46a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:58.151464 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ca7a1-f3a8-43cc-82cb-e1326bc46a52 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:58.151762 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ca7a1-f3a8-43cc-82cb-e1326bc46a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:58.152042 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ca7a1-f3a8-43cc-82cb-e1326bc46a52 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:58.162934 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ca7a1-f3a8-43cc-82cb-e1326bc46a52 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:58.189909 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ca7a1-f3a8-43cc-82cb-e1326bc46a52 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:58.207860 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-766ca7a1-f3a8-43cc-82cb-e1326bc46a52 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:49:58.208901 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 181/362] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:49:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:49:58.214076 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248f0c4-f70d-4281-a1c9-8b32342150e3 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:58.223286 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248f0c4-f70d-4281-a1c9-8b32342150e3 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:58.227100 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25a0e8-3e21-444b-bcc6-000e4b5460df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:58.227714 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25a0e8-3e21-444b-bcc6-000e4b5460df admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:58.228005 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25a0e8-3e21-444b-bcc6-000e4b5460df admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:58.228285 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25a0e8-3e21-444b-bcc6-000e4b5460df admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:58.228966 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c25a0e8-3e21-444b-bcc6-000e4b5460df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:58.229264 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c25a0e8-3e21-444b-bcc6-000e4b5460df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:58.253938 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING py.warnings [None req-5c25a0e8-3e21-444b-bcc6-000e4b5460df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:49:58.253938 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: warnings.warn(msg) Oct 27 14:49:58.253938 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: Oct 27 14:49:58.254751 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c25a0e8-3e21-444b-bcc6-000e4b5460df admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:58.268215 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 182/363] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:49:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:58.273332 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ca7a1-f3a8-43cc-82cb-e1326bc46a52 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:58.282379 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ca7a1-f3a8-43cc-82cb-e1326bc46a52 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:58.286382 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2630d1f-a686-4619-abff-eb219e72b2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:58.287096 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2630d1f-a686-4619-abff-eb219e72b2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:58.287384 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2630d1f-a686-4619-abff-eb219e72b2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:58.287701 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2630d1f-a686-4619-abff-eb219e72b2a2 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:58.300327 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2630d1f-a686-4619-abff-eb219e72b2a2 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:58.326198 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2630d1f-a686-4619-abff-eb219e72b2a2 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:58.344001 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-b2630d1f-a686-4619-abff-eb219e72b2a2 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 14:49:58.345123 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 182/364] 10.222.0.89 () {56 vars in 1114 bytes} [Wed Oct 27 14:49:58 2021] GET /identity/v3/users/nova => generated 82 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:49:58.350181 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25a0e8-3e21-444b-bcc6-000e4b5460df admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:58.359699 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25a0e8-3e21-444b-bcc6-000e4b5460df admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:58.363526 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf1081-b256-4255-a91c-082e573792b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:58.364113 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf1081-b256-4255-a91c-082e573792b6 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:58.364400 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf1081-b256-4255-a91c-082e573792b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:58.364682 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf1081-b256-4255-a91c-082e573792b6 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:58.365470 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf1081-b256-4255-a91c-082e573792b6 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:58.365772 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf1081-b256-4255-a91c-082e573792b6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:58.390577 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING py.warnings [None req-c0bf1081-b256-4255-a91c-082e573792b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:49:58.390577 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: warnings.warn(msg) Oct 27 14:49:58.390577 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: Oct 27 14:49:58.391728 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf1081-b256-4255-a91c-082e573792b6 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:58.420967 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 183/365] 10.222.0.89 () {56 vars in 1154 bytes} [Wed Oct 27 14:49:58 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:58.425992 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2630d1f-a686-4619-abff-eb219e72b2a2 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:58.434850 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2630d1f-a686-4619-abff-eb219e72b2a2 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:58.439142 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee202d0-504f-4697-b89e-0ed3351546f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:58.439729 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee202d0-504f-4697-b89e-0ed3351546f8 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:58.440011 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee202d0-504f-4697-b89e-0ed3351546f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:58.440285 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee202d0-504f-4697-b89e-0ed3351546f8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:58.447597 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee202d0-504f-4697-b89e-0ed3351546f8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:58.472395 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee202d0-504f-4697-b89e-0ed3351546f8 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:58.480410 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 183/366] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:49:58 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:49:58.485782 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf1081-b256-4255-a91c-082e573792b6 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:58.494794 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf1081-b256-4255-a91c-082e573792b6 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:58.499227 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c699d-a237-473d-8b16-772126fcc70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:58.499966 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c699d-a237-473d-8b16-772126fcc70c admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:58.500256 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c699d-a237-473d-8b16-772126fcc70c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:58.500536 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c699d-a237-473d-8b16-772126fcc70c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:58.511853 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c699d-a237-473d-8b16-772126fcc70c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:58.536819 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c699d-a237-473d-8b16-772126fcc70c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:58.554262 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-ab3c699d-a237-473d-8b16-772126fcc70c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:49:58.555328 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 184/367] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:49:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:49:58.560643 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee202d0-504f-4697-b89e-0ed3351546f8 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:58.569469 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee202d0-504f-4697-b89e-0ed3351546f8 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:58.573330 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675aafc-985d-4ed2-85b8-b70ea1ddfedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:58.573902 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675aafc-985d-4ed2-85b8-b70ea1ddfedb admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:58.574188 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675aafc-985d-4ed2-85b8-b70ea1ddfedb admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:58.574468 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675aafc-985d-4ed2-85b8-b70ea1ddfedb admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:58.575139 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5675aafc-985d-4ed2-85b8-b70ea1ddfedb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:58.575447 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5675aafc-985d-4ed2-85b8-b70ea1ddfedb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:58.600248 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5675aafc-985d-4ed2-85b8-b70ea1ddfedb admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:58.613186 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 184/368] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:49:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:58.618075 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c699d-a237-473d-8b16-772126fcc70c admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:58.628078 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c699d-a237-473d-8b16-772126fcc70c admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:58.631887 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171a7cc-2e01-492b-ad96-3919cbf9c89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:58.632569 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171a7cc-2e01-492b-ad96-3919cbf9c89f admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:58.632854 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171a7cc-2e01-492b-ad96-3919cbf9c89f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:58.633132 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0171a7cc-2e01-492b-ad96-3919cbf9c89f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:58.641773 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171a7cc-2e01-492b-ad96-3919cbf9c89f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:58.666974 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0171a7cc-2e01-492b-ad96-3919cbf9c89f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:58.681591 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-0171a7cc-2e01-492b-ad96-3919cbf9c89f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:49:58.682709 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 185/369] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:49:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:49:58.688474 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675aafc-985d-4ed2-85b8-b70ea1ddfedb admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:58.697433 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675aafc-985d-4ed2-85b8-b70ea1ddfedb admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:58.701333 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52b71a-fd85-41f7-8f1d-87e6c9c0f971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:58.701848 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52b71a-fd85-41f7-8f1d-87e6c9c0f971 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:58.702134 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52b71a-fd85-41f7-8f1d-87e6c9c0f971 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:58.702414 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52b71a-fd85-41f7-8f1d-87e6c9c0f971 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:58.703142 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52b71a-fd85-41f7-8f1d-87e6c9c0f971 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:58.703457 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52b71a-fd85-41f7-8f1d-87e6c9c0f971 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:58.728066 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING py.warnings [None req-ef52b71a-fd85-41f7-8f1d-87e6c9c0f971 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:49:58.728066 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: warnings.warn(msg) Oct 27 14:49:58.728066 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: Oct 27 14:49:58.729172 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52b71a-fd85-41f7-8f1d-87e6c9c0f971 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:58.742450 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 185/370] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:49:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:49:58.747650 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171a7cc-2e01-492b-ad96-3919cbf9c89f admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:49:58.756602 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0171a7cc-2e01-492b-ad96-3919cbf9c89f admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:49:58.760386 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d767fea-8cd8-40a7-871a-684d0d55c012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:49:58.760942 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d767fea-8cd8-40a7-871a-684d0d55c012 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:49:58.761226 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d767fea-8cd8-40a7-871a-684d0d55c012 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:49:58.761506 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d767fea-8cd8-40a7-871a-684d0d55c012 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:49:58.762321 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d767fea-8cd8-40a7-871a-684d0d55c012 admin admin] RBAC: Adding query filter params (role.id=0af8b2c9076246e6ac61d13d88d91976, scope.project.id=f79f19c59cfd43c48871b51d6aaf501f, user.id=01acdb65e66441418d4abe1f0ed804bc) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:49:58.762575 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d767fea-8cd8-40a7-871a-684d0d55c012 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:49:58.788393 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d767fea-8cd8-40a7-871a-684d0d55c012 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:49:58.793773 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 186/371] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:49:58 2021] GET /identity/v3/role_assignments?user.id=01acdb65e66441418d4abe1f0ed804bc&scope.project.id=f79f19c59cfd43c48871b51d6aaf501f&role.id=0af8b2c9076246e6ac61d13d88d91976 => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:00.693740 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b772df4-53f2-4612-b395-f2cce2c3bc64 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:00.694250 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b772df4-53f2-4612-b395-f2cce2c3bc64 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:00.694339 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b772df4-53f2-4612-b395-f2cce2c3bc64 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:00.696047 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 186/372] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:50:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:50:00.701180 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc94c1e-1726-4e69-8f6b-d7b4c40b2727 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:00.702093 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc94c1e-1726-4e69-8f6b-d7b4c40b2727 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:00.702252 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc94c1e-1726-4e69-8f6b-d7b4c40b2727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:00.725212 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-5fc94c1e-1726-4e69-8f6b-d7b4c40b2727 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:50:00.726395 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-5fc94c1e-1726-4e69-8f6b-d7b4c40b2727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:50:00.733022 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 187/373] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:50:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:50:00.754059 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b772df4-53f2-4612-b395-f2cce2c3bc64 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:00.765919 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b772df4-53f2-4612-b395-f2cce2c3bc64 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:00.769739 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628fea2-4031-46cc-b06f-3552d9d89154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:00.770441 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628fea2-4031-46cc-b06f-3552d9d89154 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:00.770727 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628fea2-4031-46cc-b06f-3552d9d89154 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:00.771003 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8628fea2-4031-46cc-b06f-3552d9d89154 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:00.782531 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8628fea2-4031-46cc-b06f-3552d9d89154 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:50:00.788873 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-8628fea2-4031-46cc-b06f-3552d9d89154 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 14:50:00.790183 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 187/374] 10.222.0.89 () {56 vars in 1123 bytes} [Wed Oct 27 14:50:00 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:00.795308 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc94c1e-1726-4e69-8f6b-d7b4c40b2727 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:00.803691 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc94c1e-1726-4e69-8f6b-d7b4c40b2727 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:00.807586 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795eb20-397c-4340-923f-577f50ad5075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:00.808171 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795eb20-397c-4340-923f-577f50ad5075 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:00.808460 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795eb20-397c-4340-923f-577f50ad5075 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:00.808741 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b795eb20-397c-4340-923f-577f50ad5075 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:00.809449 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795eb20-397c-4340-923f-577f50ad5075 admin admin] RBAC: Adding query filter params (name=service) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:00.809747 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795eb20-397c-4340-923f-577f50ad5075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:00.835098 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b795eb20-397c-4340-923f-577f50ad5075 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:00.843951 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 188/375] 10.222.0.89 () {56 vars in 1124 bytes} [Wed Oct 27 14:50:00 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:50:00.849098 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628fea2-4031-46cc-b06f-3552d9d89154 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:00.859173 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8628fea2-4031-46cc-b06f-3552d9d89154 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:00.863051 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da239947-f8c8-4967-9bb6-35712b5c6aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:00.863857 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da239947-f8c8-4967-9bb6-35712b5c6aba admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:00.864149 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da239947-f8c8-4967-9bb6-35712b5c6aba admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:00.864430 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da239947-f8c8-4967-9bb6-35712b5c6aba admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:00.875574 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da239947-f8c8-4967-9bb6-35712b5c6aba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:00.901118 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da239947-f8c8-4967-9bb6-35712b5c6aba admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:00.919111 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-da239947-f8c8-4967-9bb6-35712b5c6aba admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:50:00.920221 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 188/376] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:50:00 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:00.925571 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795eb20-397c-4340-923f-577f50ad5075 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:00.934538 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b795eb20-397c-4340-923f-577f50ad5075 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:00.938342 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7d4c9-41ba-4b09-adbb-0f2e53f1b1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:00.938925 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7d4c9-41ba-4b09-adbb-0f2e53f1b1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:00.939207 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7d4c9-41ba-4b09-adbb-0f2e53f1b1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:00.939503 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7d4c9-41ba-4b09-adbb-0f2e53f1b1d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:00.940180 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7d4c9-41ba-4b09-adbb-0f2e53f1b1d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:00.940472 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7d4c9-41ba-4b09-adbb-0f2e53f1b1d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:00.965725 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7d4c9-41ba-4b09-adbb-0f2e53f1b1d6 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:00.978548 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 189/377] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:50:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:00.983405 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da239947-f8c8-4967-9bb6-35712b5c6aba admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:00.992402 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da239947-f8c8-4967-9bb6-35712b5c6aba admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:00.996209 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ae2bc-2022-4721-8ef4-28fb94d077c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:00.996900 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ae2bc-2022-4721-8ef4-28fb94d077c8 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:00.997189 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ae2bc-2022-4721-8ef4-28fb94d077c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:00.997469 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ae2bc-2022-4721-8ef4-28fb94d077c8 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:01.010304 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ae2bc-2022-4721-8ef4-28fb94d077c8 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:01.036310 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ae2bc-2022-4721-8ef4-28fb94d077c8 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:01.053587 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-337ae2bc-2022-4721-8ef4-28fb94d077c8 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 14:50:01.054618 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 189/378] 10.222.0.89 () {56 vars in 1114 bytes} [Wed Oct 27 14:50:00 2021] GET /identity/v3/users/nova => generated 82 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:01.059657 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7d4c9-41ba-4b09-adbb-0f2e53f1b1d6 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:01.069052 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7d4c9-41ba-4b09-adbb-0f2e53f1b1d6 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:01.072867 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71f2a8-39a8-4b60-b803-9f342c42350c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:01.073443 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71f2a8-39a8-4b60-b803-9f342c42350c admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:01.073726 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71f2a8-39a8-4b60-b803-9f342c42350c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:01.074001 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd71f2a8-39a8-4b60-b803-9f342c42350c admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:01.074775 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71f2a8-39a8-4b60-b803-9f342c42350c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:01.075069 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71f2a8-39a8-4b60-b803-9f342c42350c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:01.100585 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd71f2a8-39a8-4b60-b803-9f342c42350c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:01.206365 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 190/379] 10.222.0.89 () {56 vars in 1154 bytes} [Wed Oct 27 14:50:01 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:50:01.211932 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ae2bc-2022-4721-8ef4-28fb94d077c8 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:01.221235 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ae2bc-2022-4721-8ef4-28fb94d077c8 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:01.225018 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98376651-1351-47c5-a3e3-535b18f05b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:01.225728 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98376651-1351-47c5-a3e3-535b18f05b46 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:01.226018 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98376651-1351-47c5-a3e3-535b18f05b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:01.226301 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98376651-1351-47c5-a3e3-535b18f05b46 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:01.239681 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98376651-1351-47c5-a3e3-535b18f05b46 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:01.265585 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98376651-1351-47c5-a3e3-535b18f05b46 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:01.282708 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-98376651-1351-47c5-a3e3-535b18f05b46 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:50:01.284037 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 190/380] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:50:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:01.289938 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71f2a8-39a8-4b60-b803-9f342c42350c admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:01.299145 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd71f2a8-39a8-4b60-b803-9f342c42350c admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:01.302935 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d495be-32f3-4484-9273-da0b6857ef85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:01.303552 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d495be-32f3-4484-9273-da0b6857ef85 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:01.303836 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d495be-32f3-4484-9273-da0b6857ef85 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:01.304109 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d495be-32f3-4484-9273-da0b6857ef85 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:01.304782 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d495be-32f3-4484-9273-da0b6857ef85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:01.305070 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d495be-32f3-4484-9273-da0b6857ef85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:01.330640 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d495be-32f3-4484-9273-da0b6857ef85 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:01.342812 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 191/381] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:50:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:01.347828 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98376651-1351-47c5-a3e3-535b18f05b46 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:01.356837 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98376651-1351-47c5-a3e3-535b18f05b46 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:01.361239 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb796c-9082-4c8e-8dd5-844435c4445b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:01.362094 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb796c-9082-4c8e-8dd5-844435c4445b admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:01.362384 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb796c-9082-4c8e-8dd5-844435c4445b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:01.362662 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb796c-9082-4c8e-8dd5-844435c4445b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:01.445724 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb796c-9082-4c8e-8dd5-844435c4445b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:01.470557 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdb796c-9082-4c8e-8dd5-844435c4445b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:01.484533 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-9cdb796c-9082-4c8e-8dd5-844435c4445b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:50:01.485534 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 191/382] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:50:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 138 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 14:50:01.491169 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d495be-32f3-4484-9273-da0b6857ef85 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:01.500972 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d495be-32f3-4484-9273-da0b6857ef85 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:01.504794 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd2154-0c3e-429c-8c7a-285b3e527a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:01.505370 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd2154-0c3e-429c-8c7a-285b3e527a69 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:01.505655 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd2154-0c3e-429c-8c7a-285b3e527a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:01.505933 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd2154-0c3e-429c-8c7a-285b3e527a69 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:01.506671 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd2154-0c3e-429c-8c7a-285b3e527a69 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:01.506967 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd2154-0c3e-429c-8c7a-285b3e527a69 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:01.531203 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING py.warnings [None req-ecfd2154-0c3e-429c-8c7a-285b3e527a69 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:50:01.531203 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: warnings.warn(msg) Oct 27 14:50:01.531203 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: Oct 27 14:50:01.532376 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd2154-0c3e-429c-8c7a-285b3e527a69 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:01.546526 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 192/383] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:50:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:01.551974 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb796c-9082-4c8e-8dd5-844435c4445b admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:01.562472 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb796c-9082-4c8e-8dd5-844435c4445b admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:01.566387 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54be538-c0b2-44ed-8666-291dfe8a639b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:01.567178 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54be538-c0b2-44ed-8666-291dfe8a639b admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:01.567497 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54be538-c0b2-44ed-8666-291dfe8a639b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:01.567782 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54be538-c0b2-44ed-8666-291dfe8a639b admin admin] PATH_INFO: `/v3/projects/f79f19c59cfd43c48871b51d6aaf501f/users/01acdb65e66441418d4abe1f0ed804bc/roles/0af8b2c9076246e6ac61d13d88d91976` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:01.586681 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54be538-c0b2-44ed-8666-291dfe8a639b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79f19c59cfd43c48871b51d6aaf501f, user_id=01acdb65e66441418d4abe1f0ed804bc, role_id=0af8b2c9076246e6ac61d13d88d91976)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:01.613048 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54be538-c0b2-44ed-8666-291dfe8a639b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:01.625434 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 192/384] 10.222.0.89 () {58 vars in 1460 bytes} [Wed Oct 27 14:50:01 2021] PUT /identity/v3/projects/f79f19c59cfd43c48871b51d6aaf501f/users/01acdb65e66441418d4abe1f0ed804bc/roles/0af8b2c9076246e6ac61d13d88d91976 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:50:03.540578 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7b211-740f-4a71-813a-03abb396bf2b None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:03.541074 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7b211-740f-4a71-813a-03abb396bf2b None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:03.541074 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff7b211-740f-4a71-813a-03abb396bf2b None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:03.542706 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 193/385] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:50:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:50:03.548415 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68e18b-ef8a-4c1e-a329-2df55b9967c3 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:03.548824 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68e18b-ef8a-4c1e-a329-2df55b9967c3 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:03.548984 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68e18b-ef8a-4c1e-a329-2df55b9967c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:03.571229 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-1b68e18b-ef8a-4c1e-a329-2df55b9967c3 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:50:03.572394 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-1b68e18b-ef8a-4c1e-a329-2df55b9967c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:50:03.633683 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 193/386] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:50:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:50:03.656383 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff7b211-740f-4a71-813a-03abb396bf2b None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:03.667826 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff7b211-740f-4a71-813a-03abb396bf2b None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:03.671567 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67715b69-877e-4054-a88a-2e4b9d10e8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:03.672273 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67715b69-877e-4054-a88a-2e4b9d10e8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:03.672555 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67715b69-877e-4054-a88a-2e4b9d10e8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:03.672830 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67715b69-877e-4054-a88a-2e4b9d10e8c0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:03.683617 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67715b69-877e-4054-a88a-2e4b9d10e8c0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:50:03.689862 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-67715b69-877e-4054-a88a-2e4b9d10e8c0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 14:50:03.690909 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 194/387] 10.222.0.89 () {56 vars in 1123 bytes} [Wed Oct 27 14:50:03 2021] GET /identity/v3/roles/service => generated 85 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:03.696202 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68e18b-ef8a-4c1e-a329-2df55b9967c3 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:03.704845 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68e18b-ef8a-4c1e-a329-2df55b9967c3 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:03.708621 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9920b75-cab7-467d-9659-dda3db8a30e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:03.709197 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9920b75-cab7-467d-9659-dda3db8a30e0 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:03.709479 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9920b75-cab7-467d-9659-dda3db8a30e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:03.709756 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9920b75-cab7-467d-9659-dda3db8a30e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:03.710448 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9920b75-cab7-467d-9659-dda3db8a30e0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:03.710738 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9920b75-cab7-467d-9659-dda3db8a30e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:03.736004 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9920b75-cab7-467d-9659-dda3db8a30e0 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:03.743986 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 194/388] 10.222.0.89 () {56 vars in 1124 bytes} [Wed Oct 27 14:50:03 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:50:03.749007 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67715b69-877e-4054-a88a-2e4b9d10e8c0 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:03.758182 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67715b69-877e-4054-a88a-2e4b9d10e8c0 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:03.761949 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b012d9-e5f1-4f61-b42c-4d97fd137544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:03.762622 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b012d9-e5f1-4f61-b42c-4d97fd137544 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:03.762903 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b012d9-e5f1-4f61-b42c-4d97fd137544 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:03.763176 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b012d9-e5f1-4f61-b42c-4d97fd137544 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:03.774373 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b012d9-e5f1-4f61-b42c-4d97fd137544 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:03.800069 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b012d9-e5f1-4f61-b42c-4d97fd137544 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:03.816655 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-c3b012d9-e5f1-4f61-b42c-4d97fd137544 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:50:03.817665 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 195/389] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:50:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:03.822676 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9920b75-cab7-467d-9659-dda3db8a30e0 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:03.831920 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9920b75-cab7-467d-9659-dda3db8a30e0 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:03.835698 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e46a7-064e-41e7-b786-a6809e5d7f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:03.836256 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e46a7-064e-41e7-b786-a6809e5d7f8b admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:03.836537 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e46a7-064e-41e7-b786-a6809e5d7f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:03.836811 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e46a7-064e-41e7-b786-a6809e5d7f8b admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:03.837475 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450e46a7-064e-41e7-b786-a6809e5d7f8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:03.837767 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450e46a7-064e-41e7-b786-a6809e5d7f8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:03.862918 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450e46a7-064e-41e7-b786-a6809e5d7f8b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:03.875083 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 195/390] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:50:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:50:03.880088 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b012d9-e5f1-4f61-b42c-4d97fd137544 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:03.889472 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b012d9-e5f1-4f61-b42c-4d97fd137544 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:03.893338 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611d13b-1b4d-441e-b2e4-12a8cba335a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:03.894028 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611d13b-1b4d-441e-b2e4-12a8cba335a5 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:03.894316 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611d13b-1b4d-441e-b2e4-12a8cba335a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:03.894597 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611d13b-1b4d-441e-b2e4-12a8cba335a5 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:03.907877 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611d13b-1b4d-441e-b2e4-12a8cba335a5 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:03.933436 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611d13b-1b4d-441e-b2e4-12a8cba335a5 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:03.950565 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-c611d13b-1b4d-441e-b2e4-12a8cba335a5 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 14:50:03.952139 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 196/391] 10.222.0.89 () {56 vars in 1114 bytes} [Wed Oct 27 14:50:03 2021] GET /identity/v3/users/nova => generated 82 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:03.957366 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e46a7-064e-41e7-b786-a6809e5d7f8b admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:03.966265 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e46a7-064e-41e7-b786-a6809e5d7f8b admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:03.970632 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240a5c9-1862-49c5-8610-3d8f66bc12c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:03.971210 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240a5c9-1862-49c5-8610-3d8f66bc12c2 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:03.971523 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240a5c9-1862-49c5-8610-3d8f66bc12c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:03.971803 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240a5c9-1862-49c5-8610-3d8f66bc12c2 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:03.972577 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240a5c9-1862-49c5-8610-3d8f66bc12c2 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:03.972873 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240a5c9-1862-49c5-8610-3d8f66bc12c2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:03.996920 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING py.warnings [None req-8240a5c9-1862-49c5-8610-3d8f66bc12c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:50:03.996920 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: warnings.warn(msg) Oct 27 14:50:03.996920 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: Oct 27 14:50:03.998512 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8240a5c9-1862-49c5-8610-3d8f66bc12c2 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:04.027052 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 196/392] 10.222.0.89 () {56 vars in 1154 bytes} [Wed Oct 27 14:50:03 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:50:04.032226 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611d13b-1b4d-441e-b2e4-12a8cba335a5 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:04.041432 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611d13b-1b4d-441e-b2e4-12a8cba335a5 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:04.045292 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825f764-97c1-4349-b88b-bf3c680fd18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:04.045847 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825f764-97c1-4349-b88b-bf3c680fd18f admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:04.046133 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825f764-97c1-4349-b88b-bf3c680fd18f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:04.046412 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825f764-97c1-4349-b88b-bf3c680fd18f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:04.053924 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825f764-97c1-4349-b88b-bf3c680fd18f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:04.079664 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f825f764-97c1-4349-b88b-bf3c680fd18f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:04.087854 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 197/393] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:50:04 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:50:04.092761 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240a5c9-1862-49c5-8610-3d8f66bc12c2 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:04.101452 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240a5c9-1862-49c5-8610-3d8f66bc12c2 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:04.105258 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08954c85-7536-4a44-9638-4da7bd6f4f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:04.105948 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08954c85-7536-4a44-9638-4da7bd6f4f8e admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:04.106231 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08954c85-7536-4a44-9638-4da7bd6f4f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:04.106505 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08954c85-7536-4a44-9638-4da7bd6f4f8e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:04.117552 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08954c85-7536-4a44-9638-4da7bd6f4f8e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:04.143467 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08954c85-7536-4a44-9638-4da7bd6f4f8e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:04.159805 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-08954c85-7536-4a44-9638-4da7bd6f4f8e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:50:04.160839 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 197/394] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:50:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:04.166228 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825f764-97c1-4349-b88b-bf3c680fd18f admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:04.174478 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825f764-97c1-4349-b88b-bf3c680fd18f admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:04.178369 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5448c8-593f-493c-a01a-2661d956c2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:04.178937 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5448c8-593f-493c-a01a-2661d956c2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:04.179222 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5448c8-593f-493c-a01a-2661d956c2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:04.179540 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5448c8-593f-493c-a01a-2661d956c2a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:04.180211 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5448c8-593f-493c-a01a-2661d956c2a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:04.180508 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5448c8-593f-493c-a01a-2661d956c2a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:04.206138 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5448c8-593f-493c-a01a-2661d956c2a6 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:04.218790 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 198/395] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:50:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:04.223815 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08954c85-7536-4a44-9638-4da7bd6f4f8e admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:04.232776 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08954c85-7536-4a44-9638-4da7bd6f4f8e admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:04.236614 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a949a-b63e-4fd4-9dd6-0a754dabd619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:04.237311 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a949a-b63e-4fd4-9dd6-0a754dabd619 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:04.237597 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a949a-b63e-4fd4-9dd6-0a754dabd619 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:04.237873 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a949a-b63e-4fd4-9dd6-0a754dabd619 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:04.246596 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a949a-b63e-4fd4-9dd6-0a754dabd619 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:04.272680 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a949a-b63e-4fd4-9dd6-0a754dabd619 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:04.285945 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-a07a949a-b63e-4fd4-9dd6-0a754dabd619 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:50:04.286992 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 198/396] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:50:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:04.292541 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5448c8-593f-493c-a01a-2661d956c2a6 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:04.301598 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5448c8-593f-493c-a01a-2661d956c2a6 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:04.305525 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4b1f0-46e4-4f4c-bf2a-709cebe58c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:04.306049 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4b1f0-46e4-4f4c-bf2a-709cebe58c29 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:04.306335 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4b1f0-46e4-4f4c-bf2a-709cebe58c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:04.306609 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4b1f0-46e4-4f4c-bf2a-709cebe58c29 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:04.307341 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4b1f0-46e4-4f4c-bf2a-709cebe58c29 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:04.307673 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4b1f0-46e4-4f4c-bf2a-709cebe58c29 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:04.333878 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4b1f0-46e4-4f4c-bf2a-709cebe58c29 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:04.346499 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 199/397] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:50:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:04.351812 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a949a-b63e-4fd4-9dd6-0a754dabd619 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:04.361242 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a949a-b63e-4fd4-9dd6-0a754dabd619 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:04.365161 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393cab5b-5eef-4163-be24-5cbab13a5781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:04.365721 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cab5b-5eef-4163-be24-5cbab13a5781 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:04.366009 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cab5b-5eef-4163-be24-5cbab13a5781 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:04.366286 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393cab5b-5eef-4163-be24-5cbab13a5781 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:04.367055 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393cab5b-5eef-4163-be24-5cbab13a5781 admin admin] RBAC: Adding query filter params (role.id=0af8b2c9076246e6ac61d13d88d91976, scope.project.id=f79f19c59cfd43c48871b51d6aaf501f, user.id=01acdb65e66441418d4abe1f0ed804bc) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:04.367354 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393cab5b-5eef-4163-be24-5cbab13a5781 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:04.392802 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393cab5b-5eef-4163-be24-5cbab13a5781 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:04.398287 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 199/398] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:50:04 2021] GET /identity/v3/role_assignments?user.id=01acdb65e66441418d4abe1f0ed804bc&scope.project.id=f79f19c59cfd43c48871b51d6aaf501f&role.id=0af8b2c9076246e6ac61d13d88d91976 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:50:06.366714 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579250c4-0ee6-43e0-a119-aadf7cd20342 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:06.367188 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579250c4-0ee6-43e0-a119-aadf7cd20342 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:06.367347 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579250c4-0ee6-43e0-a119-aadf7cd20342 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:06.369065 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 200/399] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:50:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:50:06.374149 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0037c-fc96-42f3-af39-100cb36174a0 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:06.374534 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0037c-fc96-42f3-af39-100cb36174a0 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:06.374712 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0037c-fc96-42f3-af39-100cb36174a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:06.396665 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-64a0037c-fc96-42f3-af39-100cb36174a0 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:50:06.397785 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-64a0037c-fc96-42f3-af39-100cb36174a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:50:06.404763 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 200/400] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:50:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:50:06.426909 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579250c4-0ee6-43e0-a119-aadf7cd20342 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:06.438302 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579250c4-0ee6-43e0-a119-aadf7cd20342 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:06.442087 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c4f54-3088-44a9-896a-d444b26e20fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:06.442787 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c4f54-3088-44a9-896a-d444b26e20fd admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:06.443082 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c4f54-3088-44a9-896a-d444b26e20fd admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:06.443361 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c4f54-3088-44a9-896a-d444b26e20fd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:06.454225 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c4f54-3088-44a9-896a-d444b26e20fd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:50:06.460422 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-928c4f54-3088-44a9-896a-d444b26e20fd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 14:50:06.461473 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 201/401] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:50:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:06.466623 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0037c-fc96-42f3-af39-100cb36174a0 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:06.475363 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0037c-fc96-42f3-af39-100cb36174a0 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:06.479230 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da9529-c716-4935-9a49-72cc9ee8a5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:06.479837 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da9529-c716-4935-9a49-72cc9ee8a5ee admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:06.480124 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da9529-c716-4935-9a49-72cc9ee8a5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:06.480398 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da9529-c716-4935-9a49-72cc9ee8a5ee admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:06.481095 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da9529-c716-4935-9a49-72cc9ee8a5ee admin admin] RBAC: Adding query filter params (name=admin) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:06.481388 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da9529-c716-4935-9a49-72cc9ee8a5ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:06.506853 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da9529-c716-4935-9a49-72cc9ee8a5ee admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:06.515142 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 201/402] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:50:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:06.520279 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c4f54-3088-44a9-896a-d444b26e20fd admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:06.530195 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c4f54-3088-44a9-896a-d444b26e20fd admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:06.534093 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca454e-486d-479c-ae71-3334d994686b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:06.534778 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca454e-486d-479c-ae71-3334d994686b admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:06.535066 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca454e-486d-479c-ae71-3334d994686b admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:06.535346 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca454e-486d-479c-ae71-3334d994686b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:06.547146 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca454e-486d-479c-ae71-3334d994686b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:06.572168 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca454e-486d-479c-ae71-3334d994686b admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:06.589773 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-9eca454e-486d-479c-ae71-3334d994686b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:50:06.590815 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 202/403] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:50:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:06.596524 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da9529-c716-4935-9a49-72cc9ee8a5ee admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:06.605428 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da9529-c716-4935-9a49-72cc9ee8a5ee admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:06.609287 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5178f7-fde3-4632-96c2-ccf223b53f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:06.609860 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5178f7-fde3-4632-96c2-ccf223b53f22 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:06.610149 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5178f7-fde3-4632-96c2-ccf223b53f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:06.610427 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5178f7-fde3-4632-96c2-ccf223b53f22 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:06.611105 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5178f7-fde3-4632-96c2-ccf223b53f22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:06.611401 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5178f7-fde3-4632-96c2-ccf223b53f22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:06.636281 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5178f7-fde3-4632-96c2-ccf223b53f22 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:06.650431 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 202/404] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:50:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:06.656276 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca454e-486d-479c-ae71-3334d994686b admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:06.665374 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca454e-486d-479c-ae71-3334d994686b admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:06.669210 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15749a9b-3c3b-435f-ab87-4749b9d6eaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:06.669890 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15749a9b-3c3b-435f-ab87-4749b9d6eaf3 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:06.670172 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15749a9b-3c3b-435f-ab87-4749b9d6eaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:06.670449 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15749a9b-3c3b-435f-ab87-4749b9d6eaf3 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:06.682622 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15749a9b-3c3b-435f-ab87-4749b9d6eaf3 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:06.708150 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15749a9b-3c3b-435f-ab87-4749b9d6eaf3 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:06.725577 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-15749a9b-3c3b-435f-ab87-4749b9d6eaf3 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 14:50:06.726597 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 203/405] 10.222.0.89 () {56 vars in 1114 bytes} [Wed Oct 27 14:50:06 2021] GET /identity/v3/users/nova => generated 82 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:06.731874 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5178f7-fde3-4632-96c2-ccf223b53f22 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:06.740872 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5178f7-fde3-4632-96c2-ccf223b53f22 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:06.744765 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50ed08-6455-4565-93d7-9ff4c20abe6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:06.745339 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50ed08-6455-4565-93d7-9ff4c20abe6c admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:06.745624 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50ed08-6455-4565-93d7-9ff4c20abe6c admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:06.745902 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50ed08-6455-4565-93d7-9ff4c20abe6c admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:06.746680 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50ed08-6455-4565-93d7-9ff4c20abe6c admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:06.746979 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50ed08-6455-4565-93d7-9ff4c20abe6c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:06.772355 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee50ed08-6455-4565-93d7-9ff4c20abe6c admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:06.800911 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 203/406] 10.222.0.89 () {56 vars in 1154 bytes} [Wed Oct 27 14:50:06 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:06.806036 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15749a9b-3c3b-435f-ab87-4749b9d6eaf3 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:06.814901 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15749a9b-3c3b-435f-ab87-4749b9d6eaf3 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:06.818664 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4239c89-3556-402b-a716-94c75e55e636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:06.819210 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4239c89-3556-402b-a716-94c75e55e636 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:06.819524 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4239c89-3556-402b-a716-94c75e55e636 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:06.819801 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4239c89-3556-402b-a716-94c75e55e636 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:06.827732 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4239c89-3556-402b-a716-94c75e55e636 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:06.853012 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4239c89-3556-402b-a716-94c75e55e636 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:06.861115 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 204/407] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:50:06 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:50:06.866019 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50ed08-6455-4565-93d7-9ff4c20abe6c admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:06.874861 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50ed08-6455-4565-93d7-9ff4c20abe6c admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:06.878694 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a45fa-72a6-4e3c-b40b-6e4e202bd645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:06.879382 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a45fa-72a6-4e3c-b40b-6e4e202bd645 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:06.879699 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a45fa-72a6-4e3c-b40b-6e4e202bd645 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:06.879974 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a45fa-72a6-4e3c-b40b-6e4e202bd645 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:06.891613 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a45fa-72a6-4e3c-b40b-6e4e202bd645 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:06.917266 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a45fa-72a6-4e3c-b40b-6e4e202bd645 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:06.933508 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-869a45fa-72a6-4e3c-b40b-6e4e202bd645 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:50:06.934548 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 204/408] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:50:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:06.939621 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4239c89-3556-402b-a716-94c75e55e636 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:06.947867 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4239c89-3556-402b-a716-94c75e55e636 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:06.952253 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44431c5-e06d-40a3-b931-1b0a6517f0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:06.952819 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44431c5-e06d-40a3-b931-1b0a6517f0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:06.953099 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44431c5-e06d-40a3-b931-1b0a6517f0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:06.953370 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44431c5-e06d-40a3-b931-1b0a6517f0c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:06.954039 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44431c5-e06d-40a3-b931-1b0a6517f0c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:06.954338 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44431c5-e06d-40a3-b931-1b0a6517f0c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:06.979456 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44431c5-e06d-40a3-b931-1b0a6517f0c5 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:06.991824 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 205/409] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:50:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:06.996634 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a45fa-72a6-4e3c-b40b-6e4e202bd645 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:07.005930 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a45fa-72a6-4e3c-b40b-6e4e202bd645 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:07.009768 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28d31b-f693-43fb-a60c-f692d9ee95be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:07.010448 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28d31b-f693-43fb-a60c-f692d9ee95be admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:07.010730 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28d31b-f693-43fb-a60c-f692d9ee95be admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:07.011004 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb28d31b-f693-43fb-a60c-f692d9ee95be admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:07.020215 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28d31b-f693-43fb-a60c-f692d9ee95be admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:07.045498 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb28d31b-f693-43fb-a60c-f692d9ee95be admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:07.058610 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-fb28d31b-f693-43fb-a60c-f692d9ee95be admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:50:07.059703 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 205/410] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:50:06 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 14:50:07.065358 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44431c5-e06d-40a3-b931-1b0a6517f0c5 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:07.074189 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44431c5-e06d-40a3-b931-1b0a6517f0c5 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:07.078074 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb419b66-2fb9-4520-b952-25c67ea51a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:07.078637 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb419b66-2fb9-4520-b952-25c67ea51a1f admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:07.078922 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb419b66-2fb9-4520-b952-25c67ea51a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:07.079197 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb419b66-2fb9-4520-b952-25c67ea51a1f admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:07.079962 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb419b66-2fb9-4520-b952-25c67ea51a1f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:07.080259 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb419b66-2fb9-4520-b952-25c67ea51a1f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:07.105546 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb419b66-2fb9-4520-b952-25c67ea51a1f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:07.119515 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 206/411] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:50:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:50:07.124699 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28d31b-f693-43fb-a60c-f692d9ee95be admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:07.133413 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb28d31b-f693-43fb-a60c-f692d9ee95be admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:07.137240 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538da18-b23c-4d15-8c58-70677b12d85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:07.137793 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538da18-b23c-4d15-8c58-70677b12d85e admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:07.138078 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538da18-b23c-4d15-8c58-70677b12d85e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:07.138354 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538da18-b23c-4d15-8c58-70677b12d85e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:07.139111 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538da18-b23c-4d15-8c58-70677b12d85e admin admin] RBAC: Adding query filter params (role.id=c243fbeb99ae4f51910f72ddc1773778, scope.project.id=f79f19c59cfd43c48871b51d6aaf501f, user.id=01acdb65e66441418d4abe1f0ed804bc) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:07.139408 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538da18-b23c-4d15-8c58-70677b12d85e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:07.164994 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538da18-b23c-4d15-8c58-70677b12d85e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:07.170671 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 206/412] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:50:07 2021] GET /identity/v3/role_assignments?user.id=01acdb65e66441418d4abe1f0ed804bc&scope.project.id=f79f19c59cfd43c48871b51d6aaf501f&role.id=c243fbeb99ae4f51910f72ddc1773778 => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:09.069905 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5091e96-b1d2-4ec4-af1b-c83c00dfc385 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:09.070457 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5091e96-b1d2-4ec4-af1b-c83c00dfc385 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:09.070457 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5091e96-b1d2-4ec4-af1b-c83c00dfc385 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:09.072134 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 207/413] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:50:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:50:09.077817 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d1e6d-fdca-4478-a3da-0a2245f95e5e None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:09.078233 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d1e6d-fdca-4478-a3da-0a2245f95e5e None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:09.078392 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d1e6d-fdca-4478-a3da-0a2245f95e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:09.100886 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-f79d1e6d-fdca-4478-a3da-0a2245f95e5e None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:50:09.102015 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-f79d1e6d-fdca-4478-a3da-0a2245f95e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:50:09.108606 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 207/414] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:50:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:50:09.129489 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5091e96-b1d2-4ec4-af1b-c83c00dfc385 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:09.141278 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5091e96-b1d2-4ec4-af1b-c83c00dfc385 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:09.145002 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6d41e-60d7-4578-8829-fd6aaca00387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:09.145690 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6d41e-60d7-4578-8829-fd6aaca00387 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:09.145974 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6d41e-60d7-4578-8829-fd6aaca00387 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:09.146244 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a6d41e-60d7-4578-8829-fd6aaca00387 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:09.157076 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a6d41e-60d7-4578-8829-fd6aaca00387 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:50:09.163200 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-26a6d41e-60d7-4578-8829-fd6aaca00387 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 14:50:09.164537 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 208/415] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:50:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:09.170249 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d1e6d-fdca-4478-a3da-0a2245f95e5e None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:09.178435 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d1e6d-fdca-4478-a3da-0a2245f95e5e None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:09.182298 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949562c-2178-481c-a250-108971f403ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:09.182878 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949562c-2178-481c-a250-108971f403ab admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:09.183167 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949562c-2178-481c-a250-108971f403ab admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:09.183515 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949562c-2178-481c-a250-108971f403ab admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:09.184489 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949562c-2178-481c-a250-108971f403ab admin admin] RBAC: Adding query filter params (name=admin) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:09.184838 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949562c-2178-481c-a250-108971f403ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:09.211260 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949562c-2178-481c-a250-108971f403ab admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:09.220575 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 208/416] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:50:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:09.225505 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6d41e-60d7-4578-8829-fd6aaca00387 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:09.235652 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a6d41e-60d7-4578-8829-fd6aaca00387 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:09.239480 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c3f98-11cb-4577-a91a-1b1b211724dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:09.240175 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c3f98-11cb-4577-a91a-1b1b211724dd admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:09.240455 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c3f98-11cb-4577-a91a-1b1b211724dd admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:09.240729 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c3f98-11cb-4577-a91a-1b1b211724dd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:09.251563 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c3f98-11cb-4577-a91a-1b1b211724dd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:09.276352 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c3f98-11cb-4577-a91a-1b1b211724dd admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:09.293874 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-c20c3f98-11cb-4577-a91a-1b1b211724dd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:50:09.295483 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 209/417] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:50:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:09.300627 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949562c-2178-481c-a250-108971f403ab admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:09.309701 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949562c-2178-481c-a250-108971f403ab admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:09.313628 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81924ee6-c0f6-48cb-b38d-8b64a259bd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:09.314210 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81924ee6-c0f6-48cb-b38d-8b64a259bd59 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:09.314498 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81924ee6-c0f6-48cb-b38d-8b64a259bd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:09.314778 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81924ee6-c0f6-48cb-b38d-8b64a259bd59 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:09.315486 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81924ee6-c0f6-48cb-b38d-8b64a259bd59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:09.315791 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81924ee6-c0f6-48cb-b38d-8b64a259bd59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:09.340580 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81924ee6-c0f6-48cb-b38d-8b64a259bd59 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:09.353356 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 209/418] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:50:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:50:09.359036 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c3f98-11cb-4577-a91a-1b1b211724dd admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:09.367941 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c3f98-11cb-4577-a91a-1b1b211724dd admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:09.371752 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa336571-0d9b-46fd-adf7-9c649e8fd207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:09.372438 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa336571-0d9b-46fd-adf7-9c649e8fd207 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:09.372725 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa336571-0d9b-46fd-adf7-9c649e8fd207 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:09.373028 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa336571-0d9b-46fd-adf7-9c649e8fd207 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:09.385273 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa336571-0d9b-46fd-adf7-9c649e8fd207 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:09.410726 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa336571-0d9b-46fd-adf7-9c649e8fd207 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:09.428356 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-fa336571-0d9b-46fd-adf7-9c649e8fd207 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 14:50:09.429360 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 210/419] 10.222.0.89 () {56 vars in 1114 bytes} [Wed Oct 27 14:50:09 2021] GET /identity/v3/users/nova => generated 82 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:09.434454 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81924ee6-c0f6-48cb-b38d-8b64a259bd59 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:09.443417 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81924ee6-c0f6-48cb-b38d-8b64a259bd59 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:09.447273 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040560ee-4f98-41b1-9f98-f94d2225e724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:09.447892 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040560ee-4f98-41b1-9f98-f94d2225e724 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:09.448178 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040560ee-4f98-41b1-9f98-f94d2225e724 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:09.448459 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040560ee-4f98-41b1-9f98-f94d2225e724 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:09.449237 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040560ee-4f98-41b1-9f98-f94d2225e724 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:09.449540 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040560ee-4f98-41b1-9f98-f94d2225e724 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:09.475055 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040560ee-4f98-41b1-9f98-f94d2225e724 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:09.503259 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 210/420] 10.222.0.89 () {56 vars in 1154 bytes} [Wed Oct 27 14:50:09 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:09.508215 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa336571-0d9b-46fd-adf7-9c649e8fd207 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:09.517054 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa336571-0d9b-46fd-adf7-9c649e8fd207 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:09.520854 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0d872-f3fa-4804-96ed-80d7aebdc3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:09.521537 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0d872-f3fa-4804-96ed-80d7aebdc3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:09.521820 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0d872-f3fa-4804-96ed-80d7aebdc3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:09.522094 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0d872-f3fa-4804-96ed-80d7aebdc3e8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:09.534274 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0d872-f3fa-4804-96ed-80d7aebdc3e8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:09.559337 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0d872-f3fa-4804-96ed-80d7aebdc3e8 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:09.575915 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-9ea0d872-f3fa-4804-96ed-80d7aebdc3e8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:50:09.577469 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 211/421] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:50:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:09.582495 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040560ee-4f98-41b1-9f98-f94d2225e724 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:09.591503 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040560ee-4f98-41b1-9f98-f94d2225e724 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:09.595273 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365cfbe-f40b-4dc3-9c5e-6a118d0bb7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:09.595901 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365cfbe-f40b-4dc3-9c5e-6a118d0bb7ab admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:09.596190 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365cfbe-f40b-4dc3-9c5e-6a118d0bb7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:09.596469 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365cfbe-f40b-4dc3-9c5e-6a118d0bb7ab admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:09.597147 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365cfbe-f40b-4dc3-9c5e-6a118d0bb7ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:09.597444 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365cfbe-f40b-4dc3-9c5e-6a118d0bb7ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:09.622780 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365cfbe-f40b-4dc3-9c5e-6a118d0bb7ab admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:09.634928 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 211/422] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:50:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:50:09.639934 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0d872-f3fa-4804-96ed-80d7aebdc3e8 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:09.648811 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0d872-f3fa-4804-96ed-80d7aebdc3e8 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:09.652623 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d813e-e55f-4d71-8450-7cf7c4be23d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:09.653308 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d813e-e55f-4d71-8450-7cf7c4be23d7 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:09.653591 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d813e-e55f-4d71-8450-7cf7c4be23d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:09.653866 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d813e-e55f-4d71-8450-7cf7c4be23d7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:09.662449 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d813e-e55f-4d71-8450-7cf7c4be23d7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:09.688824 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d813e-e55f-4d71-8450-7cf7c4be23d7 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:09.702100 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-419d813e-e55f-4d71-8450-7cf7c4be23d7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:50:09.703133 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 212/423] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:50:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:09.708410 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365cfbe-f40b-4dc3-9c5e-6a118d0bb7ab admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:09.717481 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365cfbe-f40b-4dc3-9c5e-6a118d0bb7ab admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:09.721392 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac2391-a7a7-4023-a022-48acb445f113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:09.721966 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac2391-a7a7-4023-a022-48acb445f113 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:09.722256 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac2391-a7a7-4023-a022-48acb445f113 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:09.722538 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac2391-a7a7-4023-a022-48acb445f113 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:09.723277 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac2391-a7a7-4023-a022-48acb445f113 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:09.723616 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac2391-a7a7-4023-a022-48acb445f113 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:09.749810 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ac2391-a7a7-4023-a022-48acb445f113 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:09.762353 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 212/424] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:50:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:09.767449 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d813e-e55f-4d71-8450-7cf7c4be23d7 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:09.776303 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d813e-e55f-4d71-8450-7cf7c4be23d7 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:09.780098 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731e69f-ac85-4a6b-8081-05b8ff043416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:09.780877 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731e69f-ac85-4a6b-8081-05b8ff043416 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:09.781158 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731e69f-ac85-4a6b-8081-05b8ff043416 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:09.781431 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731e69f-ac85-4a6b-8081-05b8ff043416 admin admin] PATH_INFO: `/v3/projects/f79f19c59cfd43c48871b51d6aaf501f/users/01acdb65e66441418d4abe1f0ed804bc/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:09.783136 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731e69f-ac85-4a6b-8081-05b8ff043416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79f19c59cfd43c48871b51d6aaf501f, user_id=01acdb65e66441418d4abe1f0ed804bc, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:09.809748 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731e69f-ac85-4a6b-8081-05b8ff043416 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:09.821967 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 213/425] 10.222.0.89 () {58 vars in 1460 bytes} [Wed Oct 27 14:50:09 2021] PUT /identity/v3/projects/f79f19c59cfd43c48871b51d6aaf501f/users/01acdb65e66441418d4abe1f0ed804bc/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:50:11.746035 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fb1d2-eb95-4aa4-895b-86167842a51c None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:11.746548 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fb1d2-eb95-4aa4-895b-86167842a51c None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:11.746660 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fb1d2-eb95-4aa4-895b-86167842a51c None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:11.748818 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 213/426] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:50:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:50:11.753964 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6927fc4-07e9-4725-988e-508f59617a2e None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:11.754337 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6927fc4-07e9-4725-988e-508f59617a2e None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:11.754520 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6927fc4-07e9-4725-988e-508f59617a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:11.776998 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-f6927fc4-07e9-4725-988e-508f59617a2e None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:50:11.778112 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-f6927fc4-07e9-4725-988e-508f59617a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:50:11.839496 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 214/427] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:50:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:50:11.861528 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84fb1d2-eb95-4aa4-895b-86167842a51c None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:11.872777 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84fb1d2-eb95-4aa4-895b-86167842a51c None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:11.877161 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d16a59-0fb2-4948-8449-cc94fc1a4f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:11.877865 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d16a59-0fb2-4948-8449-cc94fc1a4f8a admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:11.878151 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d16a59-0fb2-4948-8449-cc94fc1a4f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:11.878428 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d16a59-0fb2-4948-8449-cc94fc1a4f8a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:11.889304 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d16a59-0fb2-4948-8449-cc94fc1a4f8a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:50:11.895534 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-50d16a59-0fb2-4948-8449-cc94fc1a4f8a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 14:50:11.896581 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 214/428] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:50:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:11.901777 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6927fc4-07e9-4725-988e-508f59617a2e None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:11.910081 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6927fc4-07e9-4725-988e-508f59617a2e None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:11.914177 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24eb063-bc04-404d-858b-8037126628ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:11.914762 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24eb063-bc04-404d-858b-8037126628ad admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:11.915048 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24eb063-bc04-404d-858b-8037126628ad admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:11.915322 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24eb063-bc04-404d-858b-8037126628ad admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:11.916055 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24eb063-bc04-404d-858b-8037126628ad admin admin] RBAC: Adding query filter params (name=admin) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:11.916348 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24eb063-bc04-404d-858b-8037126628ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:11.941615 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24eb063-bc04-404d-858b-8037126628ad admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:11.949829 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 215/429] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:50:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:11.956744 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d16a59-0fb2-4948-8449-cc94fc1a4f8a admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:11.966049 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d16a59-0fb2-4948-8449-cc94fc1a4f8a admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:11.970582 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25558fc0-0b73-40e5-a3d5-4b48bd5070ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:11.971266 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25558fc0-0b73-40e5-a3d5-4b48bd5070ca admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:11.971586 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25558fc0-0b73-40e5-a3d5-4b48bd5070ca admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:11.971862 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25558fc0-0b73-40e5-a3d5-4b48bd5070ca admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:11.982875 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25558fc0-0b73-40e5-a3d5-4b48bd5070ca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:12.008009 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25558fc0-0b73-40e5-a3d5-4b48bd5070ca admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:12.025323 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-25558fc0-0b73-40e5-a3d5-4b48bd5070ca admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:50:12.026343 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 215/430] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:50:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:12.032292 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24eb063-bc04-404d-858b-8037126628ad admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:12.041549 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24eb063-bc04-404d-858b-8037126628ad admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:12.045444 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac388eec-7330-46ed-bd62-2d27dee57a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:12.046013 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac388eec-7330-46ed-bd62-2d27dee57a99 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:12.046299 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac388eec-7330-46ed-bd62-2d27dee57a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:12.046578 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac388eec-7330-46ed-bd62-2d27dee57a99 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:12.047282 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac388eec-7330-46ed-bd62-2d27dee57a99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:12.047616 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac388eec-7330-46ed-bd62-2d27dee57a99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:12.072175 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac388eec-7330-46ed-bd62-2d27dee57a99 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:12.084881 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 216/431] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:50:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:12.089661 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25558fc0-0b73-40e5-a3d5-4b48bd5070ca admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:12.099150 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25558fc0-0b73-40e5-a3d5-4b48bd5070ca admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:12.103000 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3fa58f-47b4-4696-b662-920b1ea1c543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:12.103721 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fa58f-47b4-4696-b662-920b1ea1c543 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:12.104015 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fa58f-47b4-4696-b662-920b1ea1c543 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:12.104292 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3fa58f-47b4-4696-b662-920b1ea1c543 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:12.118246 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3fa58f-47b4-4696-b662-920b1ea1c543 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:12.143727 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3fa58f-47b4-4696-b662-920b1ea1c543 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:12.161189 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-2d3fa58f-47b4-4696-b662-920b1ea1c543 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 14:50:12.162210 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 216/432] 10.222.0.89 () {56 vars in 1114 bytes} [Wed Oct 27 14:50:12 2021] GET /identity/v3/users/nova => generated 82 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:12.167503 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac388eec-7330-46ed-bd62-2d27dee57a99 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:12.176428 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac388eec-7330-46ed-bd62-2d27dee57a99 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:12.180255 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98aecf2-7509-4aba-8dec-e9506dede917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:12.180828 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98aecf2-7509-4aba-8dec-e9506dede917 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:12.181112 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98aecf2-7509-4aba-8dec-e9506dede917 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:12.181388 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98aecf2-7509-4aba-8dec-e9506dede917 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:12.182162 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98aecf2-7509-4aba-8dec-e9506dede917 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:12.182459 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98aecf2-7509-4aba-8dec-e9506dede917 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:12.209062 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98aecf2-7509-4aba-8dec-e9506dede917 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:12.237623 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 217/433] 10.222.0.89 () {56 vars in 1154 bytes} [Wed Oct 27 14:50:12 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:12.242965 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3fa58f-47b4-4696-b662-920b1ea1c543 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:12.252504 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3fa58f-47b4-4696-b662-920b1ea1c543 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:12.256314 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c07f6c-109e-44d6-9ff8-5803ea0b31af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:12.256878 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c07f6c-109e-44d6-9ff8-5803ea0b31af admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:12.257160 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c07f6c-109e-44d6-9ff8-5803ea0b31af admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:12.257430 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c07f6c-109e-44d6-9ff8-5803ea0b31af admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:12.265564 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c07f6c-109e-44d6-9ff8-5803ea0b31af admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:12.290375 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c07f6c-109e-44d6-9ff8-5803ea0b31af admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:12.298531 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 217/434] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:50:12 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:50:12.303715 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98aecf2-7509-4aba-8dec-e9506dede917 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:12.313467 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98aecf2-7509-4aba-8dec-e9506dede917 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:12.317476 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b415e4-9ace-4aaf-bc95-c260cf237087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:12.318184 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b415e4-9ace-4aaf-bc95-c260cf237087 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:12.318467 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b415e4-9ace-4aaf-bc95-c260cf237087 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:12.318743 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b415e4-9ace-4aaf-bc95-c260cf237087 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:12.332600 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b415e4-9ace-4aaf-bc95-c260cf237087 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:12.357997 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b415e4-9ace-4aaf-bc95-c260cf237087 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:12.374917 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-36b415e4-9ace-4aaf-bc95-c260cf237087 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:50:12.376030 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 218/435] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:50:12 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:12.381064 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c07f6c-109e-44d6-9ff8-5803ea0b31af admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:12.389915 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c07f6c-109e-44d6-9ff8-5803ea0b31af admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:12.393799 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d7081-b375-4b04-9a5f-d7c69a08ef42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:12.394369 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d7081-b375-4b04-9a5f-d7c69a08ef42 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:12.394653 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d7081-b375-4b04-9a5f-d7c69a08ef42 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:12.394927 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d7081-b375-4b04-9a5f-d7c69a08ef42 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:12.395631 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d7081-b375-4b04-9a5f-d7c69a08ef42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:12.395926 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d7081-b375-4b04-9a5f-d7c69a08ef42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:12.420751 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d7081-b375-4b04-9a5f-d7c69a08ef42 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:12.433132 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 218/436] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:50:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:12.438778 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b415e4-9ace-4aaf-bc95-c260cf237087 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:12.448095 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b415e4-9ace-4aaf-bc95-c260cf237087 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:12.452674 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f711b-2539-4f5d-bc68-734edb003ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:12.453345 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f711b-2539-4f5d-bc68-734edb003ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:12.453628 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f711b-2539-4f5d-bc68-734edb003ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:12.453898 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f711b-2539-4f5d-bc68-734edb003ed8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:12.462511 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f711b-2539-4f5d-bc68-734edb003ed8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:12.488353 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f711b-2539-4f5d-bc68-734edb003ed8 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:12.502498 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-550f711b-2539-4f5d-bc68-734edb003ed8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:50:12.503667 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 219/437] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:50:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:12.508572 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d7081-b375-4b04-9a5f-d7c69a08ef42 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:12.518115 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d7081-b375-4b04-9a5f-d7c69a08ef42 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:12.521984 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341f031-ebb7-4c37-b0ae-760cf9529b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:12.522553 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341f031-ebb7-4c37-b0ae-760cf9529b01 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:12.522838 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341f031-ebb7-4c37-b0ae-760cf9529b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:12.523114 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341f031-ebb7-4c37-b0ae-760cf9529b01 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:12.523888 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341f031-ebb7-4c37-b0ae-760cf9529b01 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:12.524190 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341f031-ebb7-4c37-b0ae-760cf9529b01 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:12.549414 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341f031-ebb7-4c37-b0ae-760cf9529b01 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:12.562566 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 219/438] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:50:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:12.567841 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f711b-2539-4f5d-bc68-734edb003ed8 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:12.577673 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f711b-2539-4f5d-bc68-734edb003ed8 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:12.581691 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f51fb-b93e-4d7c-9669-3bf2a86aac5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:12.582288 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f51fb-b93e-4d7c-9669-3bf2a86aac5d admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:12.582602 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f51fb-b93e-4d7c-9669-3bf2a86aac5d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:12.582883 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f51fb-b93e-4d7c-9669-3bf2a86aac5d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:12.583719 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f51fb-b93e-4d7c-9669-3bf2a86aac5d admin admin] RBAC: Adding query filter params (role.id=c243fbeb99ae4f51910f72ddc1773778, scope.project.id=f79f19c59cfd43c48871b51d6aaf501f, user.id=01acdb65e66441418d4abe1f0ed804bc) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:12.584049 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f51fb-b93e-4d7c-9669-3bf2a86aac5d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:12.611139 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f51fb-b93e-4d7c-9669-3bf2a86aac5d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:12.616901 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 220/439] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:50:12 2021] GET /identity/v3/role_assignments?user.id=01acdb65e66441418d4abe1f0ed804bc&scope.project.id=f79f19c59cfd43c48871b51d6aaf501f&role.id=c243fbeb99ae4f51910f72ddc1773778 => generated 608 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:50:14.562866 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870316e8-db3e-4558-8d3f-07cd1f8d1e45 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:14.563395 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870316e8-db3e-4558-8d3f-07cd1f8d1e45 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:14.563395 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870316e8-db3e-4558-8d3f-07cd1f8d1e45 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:14.565038 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 220/440] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:50:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:50:14.570325 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb3372-c607-447d-9037-458b2378e01e None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:14.570704 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb3372-c607-447d-9037-458b2378e01e None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:14.570892 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb3372-c607-447d-9037-458b2378e01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:14.593590 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-3dbb3372-c607-447d-9037-458b2378e01e None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:50:14.594714 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-3dbb3372-c607-447d-9037-458b2378e01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:50:14.601230 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 221/441] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:50:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:50:14.621738 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870316e8-db3e-4558-8d3f-07cd1f8d1e45 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:14.633603 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870316e8-db3e-4558-8d3f-07cd1f8d1e45 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:14.637365 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3fbf5-10ff-4a06-a05a-0237e84dcda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:14.638087 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3fbf5-10ff-4a06-a05a-0237e84dcda8 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:14.638956 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3fbf5-10ff-4a06-a05a-0237e84dcda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:14.639251 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3fbf5-10ff-4a06-a05a-0237e84dcda8 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:14.639906 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3fbf5-10ff-4a06-a05a-0237e84dcda8 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:14.664311 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING py.warnings [None req-92b3fbf5-10ff-4a06-a05a-0237e84dcda8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:50:14.664311 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: warnings.warn(msg) Oct 27 14:50:14.664311 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: Oct 27 14:50:14.665183 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3fbf5-10ff-4a06-a05a-0237e84dcda8 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:14.676279 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-92b3fbf5-10ff-4a06-a05a-0237e84dcda8 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 14:50:14.677311 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 221/442] 10.222.0.89 () {56 vars in 1153 bytes} [Wed Oct 27 14:50:14 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:14.682613 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb3372-c607-447d-9037-458b2378e01e None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:14.691593 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb3372-c607-447d-9037-458b2378e01e None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:14.695624 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e5e36-f2ee-4697-a155-de224e6f0cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:14.696209 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e5e36-f2ee-4697-a155-de224e6f0cfc admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:14.696494 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e5e36-f2ee-4697-a155-de224e6f0cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:14.696771 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e5e36-f2ee-4697-a155-de224e6f0cfc admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:14.697437 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e5e36-f2ee-4697-a155-de224e6f0cfc admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:14.697732 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e5e36-f2ee-4697-a155-de224e6f0cfc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:14.722399 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING py.warnings [None req-a49e5e36-f2ee-4697-a155-de224e6f0cfc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:50:14.722399 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: warnings.warn(msg) Oct 27 14:50:14.722399 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: Oct 27 14:50:14.723259 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e5e36-f2ee-4697-a155-de224e6f0cfc admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:14.727361 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 222/443] 10.222.0.89 () {56 vars in 1147 bytes} [Wed Oct 27 14:50:14 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:14.732293 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3fbf5-10ff-4a06-a05a-0237e84dcda8 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:14.741087 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3fbf5-10ff-4a06-a05a-0237e84dcda8 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:14.744961 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14097ea-a88c-449e-b299-dfa9960cb595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:14.745527 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14097ea-a88c-449e-b299-dfa9960cb595 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:14.745815 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14097ea-a88c-449e-b299-dfa9960cb595 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:14.746095 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14097ea-a88c-449e-b299-dfa9960cb595 admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:14.746752 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14097ea-a88c-449e-b299-dfa9960cb595 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:14.747046 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14097ea-a88c-449e-b299-dfa9960cb595 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:14.772168 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING py.warnings [None req-a14097ea-a88c-449e-b299-dfa9960cb595 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:50:14.772168 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: warnings.warn(msg) Oct 27 14:50:14.772168 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: Oct 27 14:50:14.773027 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14097ea-a88c-449e-b299-dfa9960cb595 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:14.777306 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 222/444] 10.222.0.89 () {56 vars in 1147 bytes} [Wed Oct 27 14:50:14 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:16.709726 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a104e7-4392-42f1-a8d8-4abd27202015 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:16.710237 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a104e7-4392-42f1-a8d8-4abd27202015 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:16.710323 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a104e7-4392-42f1-a8d8-4abd27202015 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:16.711998 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 223/445] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:50:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:50:16.716945 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ff3ba-d118-44e7-86cd-6ed5c4716f53 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:16.717361 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ff3ba-d118-44e7-86cd-6ed5c4716f53 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:16.717556 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ff3ba-d118-44e7-86cd-6ed5c4716f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:16.739791 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-ec4ff3ba-d118-44e7-86cd-6ed5c4716f53 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:50:16.740901 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-ec4ff3ba-d118-44e7-86cd-6ed5c4716f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:50:16.747355 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 223/446] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:50:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:50:16.769360 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a104e7-4392-42f1-a8d8-4abd27202015 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:16.780609 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a104e7-4392-42f1-a8d8-4abd27202015 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:16.784365 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b234ff11-3db3-421a-9d2a-21edd8ae64e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:16.784937 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234ff11-3db3-421a-9d2a-21edd8ae64e9 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:16.785221 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234ff11-3db3-421a-9d2a-21edd8ae64e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:16.785495 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234ff11-3db3-421a-9d2a-21edd8ae64e9 admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:16.786165 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234ff11-3db3-421a-9d2a-21edd8ae64e9 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:16.811029 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING py.warnings [None req-b234ff11-3db3-421a-9d2a-21edd8ae64e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:50:16.811029 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: warnings.warn(msg) Oct 27 14:50:16.811029 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: Oct 27 14:50:16.811920 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b234ff11-3db3-421a-9d2a-21edd8ae64e9 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:16.824692 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 224/447] 10.222.0.89 () {60 vars in 1162 bytes} [Wed Oct 27 14:50:16 2021] POST /identity/v3/services => generated 269 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:50:18.779101 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065ad05-a214-45ee-93e7-d2b944a11d97 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:18.779755 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065ad05-a214-45ee-93e7-d2b944a11d97 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:18.779755 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065ad05-a214-45ee-93e7-d2b944a11d97 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:18.781341 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 224/448] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:50:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:50:18.786315 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8066db-c904-45c5-8665-64621cc877ea None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:18.786760 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8066db-c904-45c5-8665-64621cc877ea None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:18.786893 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8066db-c904-45c5-8665-64621cc877ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:18.809311 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-ce8066db-c904-45c5-8665-64621cc877ea None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:50:18.810936 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-ce8066db-c904-45c5-8665-64621cc877ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:50:18.826889 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 225/449] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:50:18 2021] POST /identity/v3/auth/tokens => generated 1177 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:50:18.848075 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065ad05-a214-45ee-93e7-d2b944a11d97 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:18.859192 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065ad05-a214-45ee-93e7-d2b944a11d97 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:18.862932 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f4c7f-7476-4c3b-ae2d-9bf69069b4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:18.863673 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f4c7f-7476-4c3b-ae2d-9bf69069b4de admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:18.863958 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f4c7f-7476-4c3b-ae2d-9bf69069b4de admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:18.864233 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f4c7f-7476-4c3b-ae2d-9bf69069b4de admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:18.864846 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f4c7f-7476-4c3b-ae2d-9bf69069b4de admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:18.890513 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f4c7f-7476-4c3b-ae2d-9bf69069b4de admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:18.900852 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-506f4c7f-7476-4c3b-ae2d-9bf69069b4de admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 14:50:18.901866 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 225/450] 10.222.0.89 () {56 vars in 1153 bytes} [Wed Oct 27 14:50:18 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:18.907292 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8066db-c904-45c5-8665-64621cc877ea None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:18.915940 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8066db-c904-45c5-8665-64621cc877ea None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:18.919898 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0332014-74b1-42f1-9bf1-d65ae7de8aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:18.920480 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0332014-74b1-42f1-9bf1-d65ae7de8aad admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:18.920768 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0332014-74b1-42f1-9bf1-d65ae7de8aad admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:18.921050 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0332014-74b1-42f1-9bf1-d65ae7de8aad admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:18.921720 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0332014-74b1-42f1-9bf1-d65ae7de8aad admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:18.922019 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0332014-74b1-42f1-9bf1-d65ae7de8aad admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:18.947138 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0332014-74b1-42f1-9bf1-d65ae7de8aad admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:18.951905 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 226/451] 10.222.0.89 () {56 vars in 1147 bytes} [Wed Oct 27 14:50:18 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:18.956683 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f4c7f-7476-4c3b-ae2d-9bf69069b4de admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:18.965342 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f4c7f-7476-4c3b-ae2d-9bf69069b4de admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:18.969133 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c56dc-6b24-4dc3-8751-84613fafcc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:18.969682 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c56dc-6b24-4dc3-8751-84613fafcc23 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:18.969963 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c56dc-6b24-4dc3-8751-84613fafcc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:18.970239 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c56dc-6b24-4dc3-8751-84613fafcc23 admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:18.970881 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c56dc-6b24-4dc3-8751-84613fafcc23 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:18.971171 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c56dc-6b24-4dc3-8751-84613fafcc23 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:18.996165 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c56dc-6b24-4dc3-8751-84613fafcc23 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:19.001221 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 226/452] 10.222.0.89 () {56 vars in 1147 bytes} [Wed Oct 27 14:50:18 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:19.006303 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0332014-74b1-42f1-9bf1-d65ae7de8aad admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:19.015107 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0332014-74b1-42f1-9bf1-d65ae7de8aad admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:19.018969 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9b746-29ed-47ab-b1d9-85c0ea5df8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:19.019553 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9b746-29ed-47ab-b1d9-85c0ea5df8ad admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:19.019844 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9b746-29ed-47ab-b1d9-85c0ea5df8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:19.020126 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9b746-29ed-47ab-b1d9-85c0ea5df8ad admin admin] PATH_INFO: `/v3/endpoints` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:19.020858 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9b746-29ed-47ab-b1d9-85c0ea5df8ad admin admin] RBAC: Adding query filter params (interface=public, service_id=afd11a7f3e0f4e568f9f57acab0abcef, region_id=RegionOne) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:19.021160 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9b746-29ed-47ab-b1d9-85c0ea5df8ad admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:19.045900 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING py.warnings [None req-27e9b746-29ed-47ab-b1d9-85c0ea5df8ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:50:19.045900 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: warnings.warn(msg) Oct 27 14:50:19.045900 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: Oct 27 14:50:19.046699 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9b746-29ed-47ab-b1d9-85c0ea5df8ad admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:19.052363 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 227/453] 10.222.0.89 () {56 vars in 1272 bytes} [Wed Oct 27 14:50:19 2021] GET /identity/v3/endpoints?service_id=afd11a7f3e0f4e568f9f57acab0abcef&interface=public®ion_id=RegionOne => generated 194 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:19.057131 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c56dc-6b24-4dc3-8751-84613fafcc23 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:19.066405 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c56dc-6b24-4dc3-8751-84613fafcc23 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:19.070217 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cee966-17e4-4c41-b778-2f331aa4e19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:19.070765 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cee966-17e4-4c41-b778-2f331aa4e19d admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:19.071045 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cee966-17e4-4c41-b778-2f331aa4e19d admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:19.071317 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cee966-17e4-4c41-b778-2f331aa4e19d admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:19.072038 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cee966-17e4-4c41-b778-2f331aa4e19d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:19.096354 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cee966-17e4-4c41-b778-2f331aa4e19d admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:19.100792 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 227/454] 10.222.0.89 () {56 vars in 1108 bytes} [Wed Oct 27 14:50:19 2021] GET /identity/v3/services => generated 562 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:21.043372 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1e220-1a8c-4764-a0b7-0261f105dcba None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:21.043949 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1e220-1a8c-4764-a0b7-0261f105dcba None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:21.044054 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1e220-1a8c-4764-a0b7-0261f105dcba None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:21.046245 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 228/455] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:50:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:50:21.051283 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680672a8-eb09-4874-9a8f-6a74a9c5fead None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:21.051746 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680672a8-eb09-4874-9a8f-6a74a9c5fead None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:21.051869 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680672a8-eb09-4874-9a8f-6a74a9c5fead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:21.073630 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-680672a8-eb09-4874-9a8f-6a74a9c5fead None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:50:21.074737 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-680672a8-eb09-4874-9a8f-6a74a9c5fead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:50:21.081176 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 228/456] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:50:21 2021] POST /identity/v3/auth/tokens => generated 1177 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:50:21.102836 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1e220-1a8c-4764-a0b7-0261f105dcba None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:21.114707 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1e220-1a8c-4764-a0b7-0261f105dcba None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:21.118494 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ebb21-a8ff-46b7-8e74-0c0deadc6007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:21.119212 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ebb21-a8ff-46b7-8e74-0c0deadc6007 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:21.119530 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ebb21-a8ff-46b7-8e74-0c0deadc6007 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:21.119812 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ebb21-a8ff-46b7-8e74-0c0deadc6007 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:21.120430 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ebb21-a8ff-46b7-8e74-0c0deadc6007 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:21.144702 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING py.warnings [None req-126ebb21-a8ff-46b7-8e74-0c0deadc6007 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:50:21.144702 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: warnings.warn(msg) Oct 27 14:50:21.144702 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: Oct 27 14:50:21.145572 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ebb21-a8ff-46b7-8e74-0c0deadc6007 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:21.157130 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-126ebb21-a8ff-46b7-8e74-0c0deadc6007 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 14:50:21.158156 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 229/457] 10.222.0.89 () {56 vars in 1153 bytes} [Wed Oct 27 14:50:21 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:21.163294 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680672a8-eb09-4874-9a8f-6a74a9c5fead None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:21.172352 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680672a8-eb09-4874-9a8f-6a74a9c5fead None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:21.176214 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d39d8-abb4-4e8a-a719-0e191e057f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:21.176782 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d39d8-abb4-4e8a-a719-0e191e057f13 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:21.177064 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d39d8-abb4-4e8a-a719-0e191e057f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:21.177336 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d39d8-abb4-4e8a-a719-0e191e057f13 admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:21.177990 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d39d8-abb4-4e8a-a719-0e191e057f13 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:21.178282 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d39d8-abb4-4e8a-a719-0e191e057f13 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:21.202958 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d39d8-abb4-4e8a-a719-0e191e057f13 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:21.207042 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 229/458] 10.222.0.89 () {56 vars in 1147 bytes} [Wed Oct 27 14:50:21 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:21.211905 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ebb21-a8ff-46b7-8e74-0c0deadc6007 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:21.221531 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ebb21-a8ff-46b7-8e74-0c0deadc6007 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:21.225406 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7853230-8273-4267-a6fb-b75dc87f7fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:21.225969 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7853230-8273-4267-a6fb-b75dc87f7fdc admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:21.226257 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7853230-8273-4267-a6fb-b75dc87f7fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:21.226536 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7853230-8273-4267-a6fb-b75dc87f7fdc admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:21.227190 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7853230-8273-4267-a6fb-b75dc87f7fdc admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:21.227524 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7853230-8273-4267-a6fb-b75dc87f7fdc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:21.253035 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7853230-8273-4267-a6fb-b75dc87f7fdc admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:21.257793 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 230/459] 10.222.0.89 () {56 vars in 1147 bytes} [Wed Oct 27 14:50:21 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:21.262967 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d39d8-abb4-4e8a-a719-0e191e057f13 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:21.272402 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d39d8-abb4-4e8a-a719-0e191e057f13 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:21.276228 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4500689e-19d1-4599-aa40-b1d98878cb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:21.276791 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500689e-19d1-4599-aa40-b1d98878cb4d admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:21.277076 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500689e-19d1-4599-aa40-b1d98878cb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:21.277351 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4500689e-19d1-4599-aa40-b1d98878cb4d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:21.278021 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500689e-19d1-4599-aa40-b1d98878cb4d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:21.302851 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING py.warnings [None req-4500689e-19d1-4599-aa40-b1d98878cb4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:50:21.302851 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: warnings.warn(msg) Oct 27 14:50:21.302851 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: Oct 27 14:50:21.303681 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4500689e-19d1-4599-aa40-b1d98878cb4d admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:21.321699 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 230/460] 10.222.0.89 () {60 vars in 1165 bytes} [Wed Oct 27 14:50:21 2021] POST /identity/v3/endpoints => generated 347 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:50:23.276588 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216dfdc-cce0-4726-9611-3a0d7fa271b1 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:23.276995 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216dfdc-cce0-4726-9611-3a0d7fa271b1 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:23.277160 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216dfdc-cce0-4726-9611-3a0d7fa271b1 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:23.278861 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 231/461] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:50:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:50:23.283937 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a498007-65e6-472d-af1b-7cc4a5fa143e None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:23.284317 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a498007-65e6-472d-af1b-7cc4a5fa143e None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:23.284495 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a498007-65e6-472d-af1b-7cc4a5fa143e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:23.306338 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-8a498007-65e6-472d-af1b-7cc4a5fa143e None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:50:23.307464 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-8a498007-65e6-472d-af1b-7cc4a5fa143e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:50:23.327879 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 231/462] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:50:23 2021] POST /identity/v3/auth/tokens => generated 1364 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:50:23.348486 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216dfdc-cce0-4726-9611-3a0d7fa271b1 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:23.359828 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216dfdc-cce0-4726-9611-3a0d7fa271b1 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:23.363650 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aea5bf-917c-4850-8553-42e106aeea3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:23.364385 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aea5bf-917c-4850-8553-42e106aeea3b admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:23.364672 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aea5bf-917c-4850-8553-42e106aeea3b admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:23.364953 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aea5bf-917c-4850-8553-42e106aeea3b admin admin] PATH_INFO: `/v3/services/compute` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:23.365574 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aea5bf-917c-4850-8553-42e106aeea3b admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:23.391281 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aea5bf-917c-4850-8553-42e106aeea3b admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:23.401228 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-c5aea5bf-917c-4850-8553-42e106aeea3b admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 14:50:23.402253 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 232/463] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:50:23 2021] GET /identity/v3/services/compute => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:23.407454 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a498007-65e6-472d-af1b-7cc4a5fa143e None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:23.415913 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a498007-65e6-472d-af1b-7cc4a5fa143e None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:23.419782 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123c5c3-f2a5-4da4-a8fe-ed651000bf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:23.420356 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123c5c3-f2a5-4da4-a8fe-ed651000bf48 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:23.420638 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123c5c3-f2a5-4da4-a8fe-ed651000bf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:23.420909 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123c5c3-f2a5-4da4-a8fe-ed651000bf48 admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:23.421566 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123c5c3-f2a5-4da4-a8fe-ed651000bf48 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:23.421864 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123c5c3-f2a5-4da4-a8fe-ed651000bf48 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:23.446931 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123c5c3-f2a5-4da4-a8fe-ed651000bf48 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:23.451577 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 232/464] 10.222.0.89 () {56 vars in 1133 bytes} [Wed Oct 27 14:50:23 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:23.456679 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aea5bf-917c-4850-8553-42e106aeea3b admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:23.466587 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aea5bf-917c-4850-8553-42e106aeea3b admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:23.470479 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca7d48-8fd9-4834-9192-967edd02ce36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:23.471040 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca7d48-8fd9-4834-9192-967edd02ce36 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:23.471330 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca7d48-8fd9-4834-9192-967edd02ce36 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:23.471644 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca7d48-8fd9-4834-9192-967edd02ce36 admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:23.472300 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca7d48-8fd9-4834-9192-967edd02ce36 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:23.472598 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca7d48-8fd9-4834-9192-967edd02ce36 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:23.498316 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca7d48-8fd9-4834-9192-967edd02ce36 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:23.502442 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 233/465] 10.222.0.89 () {56 vars in 1133 bytes} [Wed Oct 27 14:50:23 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:25.429268 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9188a-e569-45f0-862d-adce0f5e539f None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:25.429803 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9188a-e569-45f0-862d-adce0f5e539f None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:25.429803 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9188a-e569-45f0-862d-adce0f5e539f None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:25.431489 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 233/466] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:50:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:50:25.436921 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e205f1-156f-4a07-bd71-329c107683fb None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:25.437350 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e205f1-156f-4a07-bd71-329c107683fb None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:25.437487 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e205f1-156f-4a07-bd71-329c107683fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:25.459938 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-f4e205f1-156f-4a07-bd71-329c107683fb None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:50:25.461061 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-f4e205f1-156f-4a07-bd71-329c107683fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:50:25.467693 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 234/467] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:50:25 2021] POST /identity/v3/auth/tokens => generated 1364 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:50:25.488857 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9188a-e569-45f0-862d-adce0f5e539f None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:25.500626 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9188a-e569-45f0-862d-adce0f5e539f None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:25.504502 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa7326-0dbd-401d-8e68-8830c76ebe8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:25.505080 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa7326-0dbd-401d-8e68-8830c76ebe8b admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:25.505369 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa7326-0dbd-401d-8e68-8830c76ebe8b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:25.505649 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa7326-0dbd-401d-8e68-8830c76ebe8b admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:25.506381 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa7326-0dbd-401d-8e68-8830c76ebe8b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:25.531033 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING py.warnings [None req-67aa7326-0dbd-401d-8e68-8830c76ebe8b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:50:25.531033 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: warnings.warn(msg) Oct 27 14:50:25.531033 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: Oct 27 14:50:25.531939 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa7326-0dbd-401d-8e68-8830c76ebe8b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:25.544987 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 234/468] 10.222.0.89 () {60 vars in 1162 bytes} [Wed Oct 27 14:50:25 2021] POST /identity/v3/services => generated 242 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:50:27.469459 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1f351-4185-4a3c-bf5e-425a921eab9d None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:27.470010 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1f351-4185-4a3c-bf5e-425a921eab9d None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:27.470010 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1f351-4185-4a3c-bf5e-425a921eab9d None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:27.471773 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 235/469] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:50:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:50:27.476897 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ceddb3-f02a-4e8b-b293-6194ebfd754c None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:27.477268 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ceddb3-f02a-4e8b-b293-6194ebfd754c None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:27.477458 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ceddb3-f02a-4e8b-b293-6194ebfd754c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:27.499289 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-21ceddb3-f02a-4e8b-b293-6194ebfd754c None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:50:27.500565 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-21ceddb3-f02a-4e8b-b293-6194ebfd754c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:50:27.517257 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 235/470] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:50:27 2021] POST /identity/v3/auth/tokens => generated 1460 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:50:27.539190 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1f351-4185-4a3c-bf5e-425a921eab9d None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:27.550524 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1f351-4185-4a3c-bf5e-425a921eab9d None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:27.554359 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15286673-0de9-4d40-9f4d-7f0fd472a188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:27.555085 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15286673-0de9-4d40-9f4d-7f0fd472a188 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:27.555372 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15286673-0de9-4d40-9f4d-7f0fd472a188 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:27.555679 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15286673-0de9-4d40-9f4d-7f0fd472a188 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:27.556301 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15286673-0de9-4d40-9f4d-7f0fd472a188 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:27.581721 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15286673-0de9-4d40-9f4d-7f0fd472a188 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:27.592749 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-15286673-0de9-4d40-9f4d-7f0fd472a188 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 14:50:27.593773 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 236/471] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:50:27 2021] GET /identity/v3/services/compute => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:27.599038 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ceddb3-f02a-4e8b-b293-6194ebfd754c None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:27.607353 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ceddb3-f02a-4e8b-b293-6194ebfd754c None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:27.611192 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d858ea-028b-4e76-aa78-81088a2effad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:27.611798 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d858ea-028b-4e76-aa78-81088a2effad admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:27.612083 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d858ea-028b-4e76-aa78-81088a2effad admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:27.612360 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d858ea-028b-4e76-aa78-81088a2effad admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:27.613020 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d858ea-028b-4e76-aa78-81088a2effad admin admin] RBAC: Adding query filter params (name=compute) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:27.613315 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d858ea-028b-4e76-aa78-81088a2effad admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:27.639024 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d858ea-028b-4e76-aa78-81088a2effad admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:27.643196 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 236/472] 10.222.0.89 () {56 vars in 1133 bytes} [Wed Oct 27 14:50:27 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:27.648362 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15286673-0de9-4d40-9f4d-7f0fd472a188 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:27.657541 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15286673-0de9-4d40-9f4d-7f0fd472a188 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:27.661464 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855067c-65f8-4fd4-b5f0-dd3fa2a340ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:27.662018 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855067c-65f8-4fd4-b5f0-dd3fa2a340ee admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:27.662306 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855067c-65f8-4fd4-b5f0-dd3fa2a340ee admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:27.662585 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855067c-65f8-4fd4-b5f0-dd3fa2a340ee admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:27.663243 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3855067c-65f8-4fd4-b5f0-dd3fa2a340ee admin admin] RBAC: Adding query filter params (type=compute) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:27.663571 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3855067c-65f8-4fd4-b5f0-dd3fa2a340ee admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:27.689272 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3855067c-65f8-4fd4-b5f0-dd3fa2a340ee admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:27.693844 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 237/473] 10.222.0.89 () {56 vars in 1133 bytes} [Wed Oct 27 14:50:27 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:27.698991 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d858ea-028b-4e76-aa78-81088a2effad admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:27.708433 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d858ea-028b-4e76-aa78-81088a2effad admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:27.712334 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba51ea-7c13-40ef-bc21-7e062653856f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:27.712893 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba51ea-7c13-40ef-bc21-7e062653856f admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:27.713182 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba51ea-7c13-40ef-bc21-7e062653856f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:27.713466 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba51ea-7c13-40ef-bc21-7e062653856f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:27.714194 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba51ea-7c13-40ef-bc21-7e062653856f admin admin] RBAC: Adding query filter params (interface=public, service_id=be61008eeb414b71bee2c991c0677fb5, region_id=RegionOne) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:27.714496 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba51ea-7c13-40ef-bc21-7e062653856f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:27.738545 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING py.warnings [None req-07ba51ea-7c13-40ef-bc21-7e062653856f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:50:27.738545 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: warnings.warn(msg) Oct 27 14:50:27.738545 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: Oct 27 14:50:27.739399 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba51ea-7c13-40ef-bc21-7e062653856f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:27.745255 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 237/474] 10.222.0.89 () {56 vars in 1272 bytes} [Wed Oct 27 14:50:27 2021] GET /identity/v3/endpoints?service_id=be61008eeb414b71bee2c991c0677fb5&interface=public®ion_id=RegionOne => generated 194 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:27.750648 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855067c-65f8-4fd4-b5f0-dd3fa2a340ee admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:27.759662 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855067c-65f8-4fd4-b5f0-dd3fa2a340ee admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:27.764200 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1153a-ea46-45ba-b022-8eb7075a6384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:27.764758 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1153a-ea46-45ba-b022-8eb7075a6384 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:27.765043 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1153a-ea46-45ba-b022-8eb7075a6384 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:27.765318 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1153a-ea46-45ba-b022-8eb7075a6384 admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:27.765955 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1153a-ea46-45ba-b022-8eb7075a6384 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:27.791089 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1153a-ea46-45ba-b022-8eb7075a6384 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:27.795957 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 238/475] 10.222.0.89 () {56 vars in 1108 bytes} [Wed Oct 27 14:50:27 2021] GET /identity/v3/services => generated 792 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:29.750658 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77c7ea-da6d-4130-89d8-d176c6944f40 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:29.751174 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77c7ea-da6d-4130-89d8-d176c6944f40 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:29.751277 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77c7ea-da6d-4130-89d8-d176c6944f40 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:29.752915 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 238/476] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:50:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:50:29.757901 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fd392-1391-4e51-a06f-1844a3c1c73b None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:29.758331 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fd392-1391-4e51-a06f-1844a3c1c73b None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:29.758467 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fd392-1391-4e51-a06f-1844a3c1c73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:29.781501 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-f32fd392-1391-4e51-a06f-1844a3c1c73b None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:50:29.782628 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-f32fd392-1391-4e51-a06f-1844a3c1c73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:50:29.789490 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 239/477] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:50:29 2021] POST /identity/v3/auth/tokens => generated 1460 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:50:29.810894 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77c7ea-da6d-4130-89d8-d176c6944f40 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:29.822148 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77c7ea-da6d-4130-89d8-d176c6944f40 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:29.826570 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff33736-8fae-40ec-bdf5-f3b794248675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:29.827272 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff33736-8fae-40ec-bdf5-f3b794248675 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:29.827585 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff33736-8fae-40ec-bdf5-f3b794248675 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:29.827865 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff33736-8fae-40ec-bdf5-f3b794248675 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:29.828482 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff33736-8fae-40ec-bdf5-f3b794248675 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:29.853711 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff33736-8fae-40ec-bdf5-f3b794248675 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:29.863790 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-1ff33736-8fae-40ec-bdf5-f3b794248675 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 14:50:29.864811 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 239/478] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:50:29 2021] GET /identity/v3/services/compute => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:29.870079 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fd392-1391-4e51-a06f-1844a3c1c73b None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:29.878972 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fd392-1391-4e51-a06f-1844a3c1c73b None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:29.882902 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a1cea-a6b4-4875-a0f4-56d9728b6f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:29.883502 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a1cea-a6b4-4875-a0f4-56d9728b6f7f admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:29.883799 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a1cea-a6b4-4875-a0f4-56d9728b6f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:29.884078 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a1cea-a6b4-4875-a0f4-56d9728b6f7f admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:29.884743 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a1cea-a6b4-4875-a0f4-56d9728b6f7f admin admin] RBAC: Adding query filter params (name=compute) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:29.885038 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a1cea-a6b4-4875-a0f4-56d9728b6f7f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:29.910401 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a1cea-a6b4-4875-a0f4-56d9728b6f7f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:29.914906 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 240/479] 10.222.0.89 () {56 vars in 1133 bytes} [Wed Oct 27 14:50:29 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:29.919911 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff33736-8fae-40ec-bdf5-f3b794248675 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:29.928734 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff33736-8fae-40ec-bdf5-f3b794248675 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:29.932587 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c43b0f-6f47-478f-bc74-6f37bed4b5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:29.933149 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c43b0f-6f47-478f-bc74-6f37bed4b5cd admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:29.933435 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c43b0f-6f47-478f-bc74-6f37bed4b5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:29.933712 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c43b0f-6f47-478f-bc74-6f37bed4b5cd admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:29.934358 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c43b0f-6f47-478f-bc74-6f37bed4b5cd admin admin] RBAC: Adding query filter params (type=compute) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:29.934650 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c43b0f-6f47-478f-bc74-6f37bed4b5cd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:29.960643 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c43b0f-6f47-478f-bc74-6f37bed4b5cd admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:29.965107 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 240/480] 10.222.0.89 () {56 vars in 1133 bytes} [Wed Oct 27 14:50:29 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:29.970098 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a1cea-a6b4-4875-a0f4-56d9728b6f7f admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:29.978947 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a1cea-a6b4-4875-a0f4-56d9728b6f7f admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:29.982851 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83b6f3-d902-4035-8782-105f6e212c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:29.983416 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83b6f3-d902-4035-8782-105f6e212c38 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:29.983731 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83b6f3-d902-4035-8782-105f6e212c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:29.984013 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83b6f3-d902-4035-8782-105f6e212c38 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:29.984687 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83b6f3-d902-4035-8782-105f6e212c38 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:30.009482 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING py.warnings [None req-8b83b6f3-d902-4035-8782-105f6e212c38 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:50:30.009482 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: warnings.warn(msg) Oct 27 14:50:30.009482 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: Oct 27 14:50:30.010283 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83b6f3-d902-4035-8782-105f6e212c38 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:30.030134 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 241/481] 10.222.0.89 () {60 vars in 1165 bytes} [Wed Oct 27 14:50:29 2021] POST /identity/v3/endpoints => generated 334 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:50:32.036220 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3dc586-5362-424f-b9e0-7385b0bdcd4f None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:32.036843 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3dc586-5362-424f-b9e0-7385b0bdcd4f None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:32.036843 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3dc586-5362-424f-b9e0-7385b0bdcd4f None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:32.038440 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 241/482] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:50:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:50:32.043695 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96eaa6b-0321-4315-8ba0-6b6a46aab9ff None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:32.044652 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96eaa6b-0321-4315-8ba0-6b6a46aab9ff None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:32.044749 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96eaa6b-0321-4315-8ba0-6b6a46aab9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:32.067530 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-c96eaa6b-0321-4315-8ba0-6b6a46aab9ff None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:50:32.068641 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-c96eaa6b-0321-4315-8ba0-6b6a46aab9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:50:32.084025 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 242/483] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:50:32 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:50:32.106436 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3dc586-5362-424f-b9e0-7385b0bdcd4f None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:32.118325 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3dc586-5362-424f-b9e0-7385b0bdcd4f None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:32.122187 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42fecc-de9b-4015-8b12-d4ecc3b95c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:32.122906 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42fecc-de9b-4015-8b12-d4ecc3b95c04 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:32.123194 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42fecc-de9b-4015-8b12-d4ecc3b95c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:32.123504 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b42fecc-de9b-4015-8b12-d4ecc3b95c04 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:32.135277 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b42fecc-de9b-4015-8b12-d4ecc3b95c04 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:50:32.142041 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-8b42fecc-de9b-4015-8b12-d4ecc3b95c04 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 14:50:32.143098 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 242/484] 10.222.0.89 () {56 vars in 1141 bytes} [Wed Oct 27 14:50:32 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:32.148407 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96eaa6b-0321-4315-8ba0-6b6a46aab9ff None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:32.157155 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96eaa6b-0321-4315-8ba0-6b6a46aab9ff None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:32.161073 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ca05a-4358-49da-a869-64b8e0ff549e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:32.161649 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ca05a-4358-49da-a869-64b8e0ff549e admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:32.161932 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ca05a-4358-49da-a869-64b8e0ff549e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:32.162205 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ca05a-4358-49da-a869-64b8e0ff549e admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:32.162907 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ca05a-4358-49da-a869-64b8e0ff549e admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:32.163199 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ca05a-4358-49da-a869-64b8e0ff549e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:32.188797 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ca05a-4358-49da-a869-64b8e0ff549e admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:32.196799 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 243/485] 10.222.0.89 () {56 vars in 1136 bytes} [Wed Oct 27 14:50:32 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:32.201828 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42fecc-de9b-4015-8b12-d4ecc3b95c04 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:32.210720 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b42fecc-de9b-4015-8b12-d4ecc3b95c04 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:32.214642 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5e48f-939f-4c22-812d-11b6befe79de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:32.215327 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5e48f-939f-4c22-812d-11b6befe79de admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:32.215654 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5e48f-939f-4c22-812d-11b6befe79de admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:32.216451 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5e48f-939f-4c22-812d-11b6befe79de admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:32.227945 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5e48f-939f-4c22-812d-11b6befe79de admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:32.253577 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5e48f-939f-4c22-812d-11b6befe79de admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:32.270209 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-b9f5e48f-939f-4c22-812d-11b6befe79de admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:50:32.271265 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 243/486] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:50:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:32.276830 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ca05a-4358-49da-a869-64b8e0ff549e admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:32.286437 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ca05a-4358-49da-a869-64b8e0ff549e admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:32.290476 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96025ed-0b5d-4c11-bb5c-262f7c67eab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:32.291045 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96025ed-0b5d-4c11-bb5c-262f7c67eab9 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:32.291329 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96025ed-0b5d-4c11-bb5c-262f7c67eab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:32.291639 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96025ed-0b5d-4c11-bb5c-262f7c67eab9 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:32.292313 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96025ed-0b5d-4c11-bb5c-262f7c67eab9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:32.292604 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96025ed-0b5d-4c11-bb5c-262f7c67eab9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:32.317828 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96025ed-0b5d-4c11-bb5c-262f7c67eab9 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:32.330679 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 244/487] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:50:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:32.335713 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5e48f-939f-4c22-812d-11b6befe79de admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:32.344671 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5e48f-939f-4c22-812d-11b6befe79de admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:32.348541 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ea1c2-005f-4e60-83fc-9dca30c26a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:32.349228 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ea1c2-005f-4e60-83fc-9dca30c26a07 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:32.349518 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ea1c2-005f-4e60-83fc-9dca30c26a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:32.349799 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ea1c2-005f-4e60-83fc-9dca30c26a07 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:32.362716 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ea1c2-005f-4e60-83fc-9dca30c26a07 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:32.389018 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ea1c2-005f-4e60-83fc-9dca30c26a07 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:32.406129 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-231ea1c2-005f-4e60-83fc-9dca30c26a07 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 14:50:32.407183 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 244/488] 10.222.0.89 () {56 vars in 1114 bytes} [Wed Oct 27 14:50:32 2021] GET /identity/v3/users/nova => generated 82 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:32.412632 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96025ed-0b5d-4c11-bb5c-262f7c67eab9 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:32.421883 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96025ed-0b5d-4c11-bb5c-262f7c67eab9 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:32.425783 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112af54-42c8-439a-8be7-a8bad57de124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:32.426364 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112af54-42c8-439a-8be7-a8bad57de124 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:32.426645 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112af54-42c8-439a-8be7-a8bad57de124 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:32.426917 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112af54-42c8-439a-8be7-a8bad57de124 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:32.427739 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112af54-42c8-439a-8be7-a8bad57de124 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:32.428035 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112af54-42c8-439a-8be7-a8bad57de124 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:32.454008 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112af54-42c8-439a-8be7-a8bad57de124 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:32.482009 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 245/489] 10.222.0.89 () {56 vars in 1154 bytes} [Wed Oct 27 14:50:32 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:32.487148 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ea1c2-005f-4e60-83fc-9dca30c26a07 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:32.496034 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ea1c2-005f-4e60-83fc-9dca30c26a07 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:32.500542 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c62a13-c166-45f0-83d8-be6106b2c9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:32.501103 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c62a13-c166-45f0-83d8-be6106b2c9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:32.501390 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c62a13-c166-45f0-83d8-be6106b2c9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:32.501669 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c62a13-c166-45f0-83d8-be6106b2c9d2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:32.509049 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c62a13-c166-45f0-83d8-be6106b2c9d2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:32.533826 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c62a13-c166-45f0-83d8-be6106b2c9d2 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:32.543174 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 245/490] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:50:32 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:50:32.548779 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112af54-42c8-439a-8be7-a8bad57de124 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:32.557600 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112af54-42c8-439a-8be7-a8bad57de124 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:32.562072 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c4536-9b36-4087-9712-b329481cfae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:32.562764 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c4536-9b36-4087-9712-b329481cfae2 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:32.563046 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c4536-9b36-4087-9712-b329481cfae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:32.563320 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c4536-9b36-4087-9712-b329481cfae2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:32.574471 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c4536-9b36-4087-9712-b329481cfae2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:32.599254 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c4536-9b36-4087-9712-b329481cfae2 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:32.616078 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-aa4c4536-9b36-4087-9712-b329481cfae2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:50:32.617096 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 246/491] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:50:32 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:32.622058 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c62a13-c166-45f0-83d8-be6106b2c9d2 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:32.630816 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c62a13-c166-45f0-83d8-be6106b2c9d2 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:32.634761 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22379d-a585-4c88-add0-dca3308872bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:32.635327 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22379d-a585-4c88-add0-dca3308872bd admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:32.635654 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22379d-a585-4c88-add0-dca3308872bd admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:32.635935 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac22379d-a585-4c88-add0-dca3308872bd admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:32.636604 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22379d-a585-4c88-add0-dca3308872bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:32.636902 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22379d-a585-4c88-add0-dca3308872bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:32.661676 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac22379d-a585-4c88-add0-dca3308872bd admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:32.674171 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 246/492] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:50:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:32.679097 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c4536-9b36-4087-9712-b329481cfae2 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:32.688486 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c4536-9b36-4087-9712-b329481cfae2 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:32.692311 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fb606-1a99-4f4d-b9cb-b956ac9bbc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:32.692985 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fb606-1a99-4f4d-b9cb-b956ac9bbc7e admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:32.693267 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fb606-1a99-4f4d-b9cb-b956ac9bbc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:32.693539 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fb606-1a99-4f4d-b9cb-b956ac9bbc7e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:32.703548 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6fb606-1a99-4f4d-b9cb-b956ac9bbc7e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:32.728184 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6fb606-1a99-4f4d-b9cb-b956ac9bbc7e admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:32.741591 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-5a6fb606-1a99-4f4d-b9cb-b956ac9bbc7e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:50:32.742606 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 247/493] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:50:32 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:32.748413 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22379d-a585-4c88-add0-dca3308872bd admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:32.757304 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac22379d-a585-4c88-add0-dca3308872bd admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:32.761235 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab5fef-4c9d-469e-b12e-db3c69a627e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:32.761800 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab5fef-4c9d-469e-b12e-db3c69a627e8 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:32.762088 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab5fef-4c9d-469e-b12e-db3c69a627e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:32.762368 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab5fef-4c9d-469e-b12e-db3c69a627e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:32.763103 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab5fef-4c9d-469e-b12e-db3c69a627e8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:32.763403 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab5fef-4c9d-469e-b12e-db3c69a627e8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:32.788392 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab5fef-4c9d-469e-b12e-db3c69a627e8 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:32.801725 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 247/494] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:50:32 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:32.806901 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fb606-1a99-4f4d-b9cb-b956ac9bbc7e admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:32.816359 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fb606-1a99-4f4d-b9cb-b956ac9bbc7e admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:32.820253 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22debb-2dd3-4b48-9171-a7ae8e36e0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:32.820809 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22debb-2dd3-4b48-9171-a7ae8e36e0fd admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:32.821084 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22debb-2dd3-4b48-9171-a7ae8e36e0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:32.821366 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22debb-2dd3-4b48-9171-a7ae8e36e0fd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:32.822130 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22debb-2dd3-4b48-9171-a7ae8e36e0fd admin admin] RBAC: Adding query filter params (role.id=11f4d60c63ce44fbb0b73623a47d4ea5, scope.project.id=f79f19c59cfd43c48871b51d6aaf501f, user.id=01acdb65e66441418d4abe1f0ed804bc) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:32.822430 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22debb-2dd3-4b48-9171-a7ae8e36e0fd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:32.847906 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22debb-2dd3-4b48-9171-a7ae8e36e0fd admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:32.852995 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 248/495] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:50:32 2021] GET /identity/v3/role_assignments?user.id=01acdb65e66441418d4abe1f0ed804bc&scope.project.id=f79f19c59cfd43c48871b51d6aaf501f&role.id=11f4d60c63ce44fbb0b73623a47d4ea5 => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:34.771959 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4986041-dd5e-4fa0-b958-1c6a89ba9f88 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:34.772513 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4986041-dd5e-4fa0-b958-1c6a89ba9f88 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:34.772513 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4986041-dd5e-4fa0-b958-1c6a89ba9f88 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:34.774296 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 248/496] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:50:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:50:34.780088 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d6665-5ea6-47b0-b892-a22016caf59a None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:34.780501 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d6665-5ea6-47b0-b892-a22016caf59a None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:34.780653 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d6665-5ea6-47b0-b892-a22016caf59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:34.802936 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-067d6665-5ea6-47b0-b892-a22016caf59a None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:50:34.804099 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-067d6665-5ea6-47b0-b892-a22016caf59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:50:34.810693 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 249/497] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:50:34 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:50:34.832350 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4986041-dd5e-4fa0-b958-1c6a89ba9f88 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:34.845025 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4986041-dd5e-4fa0-b958-1c6a89ba9f88 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:34.849106 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156053d-43bf-4c4d-99a8-890930cc125b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:34.849879 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156053d-43bf-4c4d-99a8-890930cc125b admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:34.850189 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156053d-43bf-4c4d-99a8-890930cc125b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:34.850492 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b156053d-43bf-4c4d-99a8-890930cc125b admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:34.861918 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b156053d-43bf-4c4d-99a8-890930cc125b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:50:34.869027 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-b156053d-43bf-4c4d-99a8-890930cc125b admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 14:50:34.870161 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 249/498] 10.222.0.89 () {56 vars in 1141 bytes} [Wed Oct 27 14:50:34 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:34.875513 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d6665-5ea6-47b0-b892-a22016caf59a None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:34.883811 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d6665-5ea6-47b0-b892-a22016caf59a None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:34.888333 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242962a-1b20-4354-b6bc-f1dcbf85b177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:34.888909 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242962a-1b20-4354-b6bc-f1dcbf85b177 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:34.889195 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242962a-1b20-4354-b6bc-f1dcbf85b177 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:34.889469 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242962a-1b20-4354-b6bc-f1dcbf85b177 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:34.890175 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242962a-1b20-4354-b6bc-f1dcbf85b177 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:34.890476 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242962a-1b20-4354-b6bc-f1dcbf85b177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:34.915956 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242962a-1b20-4354-b6bc-f1dcbf85b177 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:34.924088 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 250/499] 10.222.0.89 () {56 vars in 1136 bytes} [Wed Oct 27 14:50:34 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:34.929391 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156053d-43bf-4c4d-99a8-890930cc125b admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:34.940938 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b156053d-43bf-4c4d-99a8-890930cc125b admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:34.944907 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c493ac-aa6d-4044-a04d-4f7c7440ecce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:34.945580 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c493ac-aa6d-4044-a04d-4f7c7440ecce admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:34.945868 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c493ac-aa6d-4044-a04d-4f7c7440ecce admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:34.946147 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c493ac-aa6d-4044-a04d-4f7c7440ecce admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:34.957650 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c493ac-aa6d-4044-a04d-4f7c7440ecce admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:34.984060 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c493ac-aa6d-4044-a04d-4f7c7440ecce admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:35.002049 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-58c493ac-aa6d-4044-a04d-4f7c7440ecce admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:50:35.003144 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 250/500] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:50:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:35.008313 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242962a-1b20-4354-b6bc-f1dcbf85b177 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:35.017742 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242962a-1b20-4354-b6bc-f1dcbf85b177 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:35.021627 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36035aec-e53d-4557-979d-91a8f7c1120b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:35.022237 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36035aec-e53d-4557-979d-91a8f7c1120b admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:35.022478 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36035aec-e53d-4557-979d-91a8f7c1120b admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:35.022750 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36035aec-e53d-4557-979d-91a8f7c1120b admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:35.023417 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36035aec-e53d-4557-979d-91a8f7c1120b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:35.023737 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36035aec-e53d-4557-979d-91a8f7c1120b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:35.049127 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36035aec-e53d-4557-979d-91a8f7c1120b admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:35.061387 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 251/501] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:50:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:35.066386 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c493ac-aa6d-4044-a04d-4f7c7440ecce admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:35.076406 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c493ac-aa6d-4044-a04d-4f7c7440ecce admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:35.080505 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f7c4a-67e9-4234-bd5a-8c4f6b6c6beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:35.081230 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f7c4a-67e9-4234-bd5a-8c4f6b6c6beb admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:35.081540 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f7c4a-67e9-4234-bd5a-8c4f6b6c6beb admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:35.081821 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f7c4a-67e9-4234-bd5a-8c4f6b6c6beb admin admin] PATH_INFO: `/v3/users/nova` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:35.095359 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f7c4a-67e9-4234-bd5a-8c4f6b6c6beb admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:35.121393 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f7c4a-67e9-4234-bd5a-8c4f6b6c6beb admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:35.139344 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-666f7c4a-67e9-4234-bd5a-8c4f6b6c6beb admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 14:50:35.140392 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 251/502] 10.222.0.89 () {56 vars in 1114 bytes} [Wed Oct 27 14:50:35 2021] GET /identity/v3/users/nova => generated 82 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:35.145677 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36035aec-e53d-4557-979d-91a8f7c1120b admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:35.154611 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36035aec-e53d-4557-979d-91a8f7c1120b admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:35.158403 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415900c-91aa-4c15-8a15-1e5aba8d60db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:35.158975 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415900c-91aa-4c15-8a15-1e5aba8d60db admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:35.159256 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415900c-91aa-4c15-8a15-1e5aba8d60db admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:35.159552 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415900c-91aa-4c15-8a15-1e5aba8d60db admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:35.160325 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415900c-91aa-4c15-8a15-1e5aba8d60db admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:35.160618 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415900c-91aa-4c15-8a15-1e5aba8d60db admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:35.186379 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415900c-91aa-4c15-8a15-1e5aba8d60db admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:35.214580 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 252/503] 10.222.0.89 () {56 vars in 1154 bytes} [Wed Oct 27 14:50:35 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:35.219957 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f7c4a-67e9-4234-bd5a-8c4f6b6c6beb admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:35.229091 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f7c4a-67e9-4234-bd5a-8c4f6b6c6beb admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:35.233103 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c503d2d-28c6-4e92-a76c-68ed501d3404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:35.233897 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c503d2d-28c6-4e92-a76c-68ed501d3404 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:35.234263 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c503d2d-28c6-4e92-a76c-68ed501d3404 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:35.234680 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c503d2d-28c6-4e92-a76c-68ed501d3404 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:35.246595 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c503d2d-28c6-4e92-a76c-68ed501d3404 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:35.272754 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c503d2d-28c6-4e92-a76c-68ed501d3404 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:35.289353 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-0c503d2d-28c6-4e92-a76c-68ed501d3404 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:50:35.290402 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 252/504] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:50:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:35.296068 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415900c-91aa-4c15-8a15-1e5aba8d60db admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:35.305699 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415900c-91aa-4c15-8a15-1e5aba8d60db admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:35.310324 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ba55e-24e9-46b1-af80-c2b7e830cd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:35.310960 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ba55e-24e9-46b1-af80-c2b7e830cd93 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:35.311273 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ba55e-24e9-46b1-af80-c2b7e830cd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:35.311608 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ba55e-24e9-46b1-af80-c2b7e830cd93 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:35.312337 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ba55e-24e9-46b1-af80-c2b7e830cd93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:35.312636 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ba55e-24e9-46b1-af80-c2b7e830cd93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:35.339402 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ba55e-24e9-46b1-af80-c2b7e830cd93 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:35.351624 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 253/505] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:50:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:35.356635 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c503d2d-28c6-4e92-a76c-68ed501d3404 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:35.365579 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c503d2d-28c6-4e92-a76c-68ed501d3404 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:35.369445 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2bcbb-83c0-4e04-8a19-0b77cce78d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:35.370133 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2bcbb-83c0-4e04-8a19-0b77cce78d96 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:35.370416 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2bcbb-83c0-4e04-8a19-0b77cce78d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:35.370697 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b2bcbb-83c0-4e04-8a19-0b77cce78d96 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:35.379863 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2bcbb-83c0-4e04-8a19-0b77cce78d96 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:35.405607 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b2bcbb-83c0-4e04-8a19-0b77cce78d96 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:35.418953 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-d7b2bcbb-83c0-4e04-8a19-0b77cce78d96 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:50:35.419994 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 253/506] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:50:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 14:50:35.425843 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ba55e-24e9-46b1-af80-c2b7e830cd93 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:35.435306 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ba55e-24e9-46b1-af80-c2b7e830cd93 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:35.439220 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2da78f-0881-47cf-89a8-c2401a4a6234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:35.439827 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2da78f-0881-47cf-89a8-c2401a4a6234 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:35.440110 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2da78f-0881-47cf-89a8-c2401a4a6234 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:35.440386 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2da78f-0881-47cf-89a8-c2401a4a6234 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:35.441116 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2da78f-0881-47cf-89a8-c2401a4a6234 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:35.441411 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2da78f-0881-47cf-89a8-c2401a4a6234 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:35.466806 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2da78f-0881-47cf-89a8-c2401a4a6234 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:35.479391 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 254/507] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:50:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:35.485188 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2bcbb-83c0-4e04-8a19-0b77cce78d96 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:35.494068 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b2bcbb-83c0-4e04-8a19-0b77cce78d96 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:35.498587 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0571997-1945-456b-b70f-e7b7e19dc0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:35.499366 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0571997-1945-456b-b70f-e7b7e19dc0dd admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:35.499678 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0571997-1945-456b-b70f-e7b7e19dc0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:35.499955 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0571997-1945-456b-b70f-e7b7e19dc0dd admin admin] PATH_INFO: `/v3/projects/f79f19c59cfd43c48871b51d6aaf501f/users/01acdb65e66441418d4abe1f0ed804bc/roles/11f4d60c63ce44fbb0b73623a47d4ea5` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:35.501890 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0571997-1945-456b-b70f-e7b7e19dc0dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79f19c59cfd43c48871b51d6aaf501f, user_id=01acdb65e66441418d4abe1f0ed804bc, role_id=11f4d60c63ce44fbb0b73623a47d4ea5)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:35.527824 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0571997-1945-456b-b70f-e7b7e19dc0dd admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:35.541294 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 254/508] 10.222.0.89 () {58 vars in 1460 bytes} [Wed Oct 27 14:50:35 2021] PUT /identity/v3/projects/f79f19c59cfd43c48871b51d6aaf501f/users/01acdb65e66441418d4abe1f0ed804bc/roles/11f4d60c63ce44fbb0b73623a47d4ea5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:50:37.455592 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49678a05-4c06-4414-be6d-69435d28e533 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:37.456129 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49678a05-4c06-4414-be6d-69435d28e533 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:37.456129 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49678a05-4c06-4414-be6d-69435d28e533 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:37.457805 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 255/509] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:50:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:50:37.462931 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871325b-862c-4cfe-81bb-c260e584b87b None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:37.463340 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871325b-862c-4cfe-81bb-c260e584b87b None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:37.463516 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871325b-862c-4cfe-81bb-c260e584b87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:37.486359 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-9871325b-862c-4cfe-81bb-c260e584b87b None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:50:37.487487 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-9871325b-862c-4cfe-81bb-c260e584b87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:50:37.548542 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 255/510] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:50:37 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:50:37.569962 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49678a05-4c06-4414-be6d-69435d28e533 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:37.581229 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49678a05-4c06-4414-be6d-69435d28e533 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:37.585010 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16b56a-678f-4b70-a27e-280721a5ee39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:37.585726 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16b56a-678f-4b70-a27e-280721a5ee39 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:37.586010 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16b56a-678f-4b70-a27e-280721a5ee39 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:37.586284 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16b56a-678f-4b70-a27e-280721a5ee39 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:37.597606 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad16b56a-678f-4b70-a27e-280721a5ee39 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:50:37.604253 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-ad16b56a-678f-4b70-a27e-280721a5ee39 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 14:50:37.605306 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 256/511] 10.222.0.89 () {56 vars in 1141 bytes} [Wed Oct 27 14:50:37 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:37.611103 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871325b-862c-4cfe-81bb-c260e584b87b None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:37.619237 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871325b-862c-4cfe-81bb-c260e584b87b None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:37.623146 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909dd35b-811c-4f66-850b-ace7c4e72899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:37.623756 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909dd35b-811c-4f66-850b-ace7c4e72899 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:37.624043 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909dd35b-811c-4f66-850b-ace7c4e72899 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:37.624314 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909dd35b-811c-4f66-850b-ace7c4e72899 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:37.625011 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909dd35b-811c-4f66-850b-ace7c4e72899 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:37.625302 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909dd35b-811c-4f66-850b-ace7c4e72899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:37.649911 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909dd35b-811c-4f66-850b-ace7c4e72899 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:37.658543 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 256/512] 10.222.0.89 () {56 vars in 1136 bytes} [Wed Oct 27 14:50:37 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:37.664115 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16b56a-678f-4b70-a27e-280721a5ee39 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:37.674138 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16b56a-678f-4b70-a27e-280721a5ee39 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:37.678180 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fe007-5e79-46fd-b29f-2dae3d1263c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:37.678875 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fe007-5e79-46fd-b29f-2dae3d1263c8 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:37.679153 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fe007-5e79-46fd-b29f-2dae3d1263c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:37.679423 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fe007-5e79-46fd-b29f-2dae3d1263c8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:37.690322 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4fe007-5e79-46fd-b29f-2dae3d1263c8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:37.715248 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4fe007-5e79-46fd-b29f-2dae3d1263c8 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:37.732513 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-ca4fe007-5e79-46fd-b29f-2dae3d1263c8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:50:37.733534 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 257/513] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:50:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 14:50:37.738543 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909dd35b-811c-4f66-850b-ace7c4e72899 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:37.747466 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909dd35b-811c-4f66-850b-ace7c4e72899 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:37.751352 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c962bf-642b-4dc6-94e5-7ada3cb74dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:37.751960 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c962bf-642b-4dc6-94e5-7ada3cb74dfc admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:37.752248 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c962bf-642b-4dc6-94e5-7ada3cb74dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:37.752527 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c962bf-642b-4dc6-94e5-7ada3cb74dfc admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:37.753205 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c962bf-642b-4dc6-94e5-7ada3cb74dfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:37.753508 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c962bf-642b-4dc6-94e5-7ada3cb74dfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:37.779289 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c962bf-642b-4dc6-94e5-7ada3cb74dfc admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:37.791880 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 257/514] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:50:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:37.796895 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fe007-5e79-46fd-b29f-2dae3d1263c8 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:37.805709 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fe007-5e79-46fd-b29f-2dae3d1263c8 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:37.809537 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db121822-275f-4c48-8a2c-ec2aae8319f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:37.810215 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db121822-275f-4c48-8a2c-ec2aae8319f4 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:37.810498 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db121822-275f-4c48-8a2c-ec2aae8319f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:37.810771 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db121822-275f-4c48-8a2c-ec2aae8319f4 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:37.822934 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db121822-275f-4c48-8a2c-ec2aae8319f4 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:37.848928 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db121822-275f-4c48-8a2c-ec2aae8319f4 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:37.865788 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-db121822-275f-4c48-8a2c-ec2aae8319f4 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 14:50:37.866800 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 258/515] 10.222.0.89 () {56 vars in 1114 bytes} [Wed Oct 27 14:50:37 2021] GET /identity/v3/users/nova => generated 82 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:37.871908 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c962bf-642b-4dc6-94e5-7ada3cb74dfc admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:37.880806 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c962bf-642b-4dc6-94e5-7ada3cb74dfc admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:37.884693 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1494c0-3767-496b-ac9f-ea82447061b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:37.885271 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1494c0-3767-496b-ac9f-ea82447061b5 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:37.885560 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1494c0-3767-496b-ac9f-ea82447061b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:37.885843 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1494c0-3767-496b-ac9f-ea82447061b5 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:37.886618 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1494c0-3767-496b-ac9f-ea82447061b5 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:37.886925 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1494c0-3767-496b-ac9f-ea82447061b5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:37.913094 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1494c0-3767-496b-ac9f-ea82447061b5 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:37.941047 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 258/516] 10.222.0.89 () {56 vars in 1154 bytes} [Wed Oct 27 14:50:37 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:37.946367 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db121822-275f-4c48-8a2c-ec2aae8319f4 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:37.955855 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db121822-275f-4c48-8a2c-ec2aae8319f4 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:37.959823 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf59713-a02f-4a09-858e-4767aee662dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:37.960381 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf59713-a02f-4a09-858e-4767aee662dd admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:37.960664 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf59713-a02f-4a09-858e-4767aee662dd admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:37.960940 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf59713-a02f-4a09-858e-4767aee662dd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:37.969034 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf59713-a02f-4a09-858e-4767aee662dd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:37.993774 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf59713-a02f-4a09-858e-4767aee662dd admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:38.002035 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 259/517] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:50:37 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:50:38.007016 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1494c0-3767-496b-ac9f-ea82447061b5 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:38.016436 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1494c0-3767-496b-ac9f-ea82447061b5 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:38.020316 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92bd62-c1a1-42fe-b7f8-f93d4d5eda10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:38.021013 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92bd62-c1a1-42fe-b7f8-f93d4d5eda10 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:38.021299 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92bd62-c1a1-42fe-b7f8-f93d4d5eda10 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:38.021578 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db92bd62-c1a1-42fe-b7f8-f93d4d5eda10 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:38.033490 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db92bd62-c1a1-42fe-b7f8-f93d4d5eda10 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:38.058568 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db92bd62-c1a1-42fe-b7f8-f93d4d5eda10 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:38.074610 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-db92bd62-c1a1-42fe-b7f8-f93d4d5eda10 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:50:38.076171 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 259/518] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:50:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 14:50:38.081130 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf59713-a02f-4a09-858e-4767aee662dd admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:38.089253 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf59713-a02f-4a09-858e-4767aee662dd admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:38.093716 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9edb3d-0844-408a-8528-7b1aeff2d529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:38.094274 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9edb3d-0844-408a-8528-7b1aeff2d529 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:38.094556 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9edb3d-0844-408a-8528-7b1aeff2d529 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:38.094829 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9edb3d-0844-408a-8528-7b1aeff2d529 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:38.095533 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9edb3d-0844-408a-8528-7b1aeff2d529 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:38.095826 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9edb3d-0844-408a-8528-7b1aeff2d529 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:38.120387 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9edb3d-0844-408a-8528-7b1aeff2d529 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:38.133187 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 260/519] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:50:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:38.138149 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92bd62-c1a1-42fe-b7f8-f93d4d5eda10 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:38.146942 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db92bd62-c1a1-42fe-b7f8-f93d4d5eda10 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:38.150800 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe185b2c-f10f-413d-8718-2bdde38d4a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:38.151503 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe185b2c-f10f-413d-8718-2bdde38d4a2f admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:38.151789 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe185b2c-f10f-413d-8718-2bdde38d4a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:38.152061 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe185b2c-f10f-413d-8718-2bdde38d4a2f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:38.162519 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe185b2c-f10f-413d-8718-2bdde38d4a2f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:38.188845 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe185b2c-f10f-413d-8718-2bdde38d4a2f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:38.202323 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-fe185b2c-f10f-413d-8718-2bdde38d4a2f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:50:38.203348 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 260/520] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:50:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:38.208590 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9edb3d-0844-408a-8528-7b1aeff2d529 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:38.218048 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9edb3d-0844-408a-8528-7b1aeff2d529 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:38.221893 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b6d9e-fa9a-4c51-8cbc-093a358e2a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:38.222461 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b6d9e-fa9a-4c51-8cbc-093a358e2a04 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:38.222744 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b6d9e-fa9a-4c51-8cbc-093a358e2a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:38.223020 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b6d9e-fa9a-4c51-8cbc-093a358e2a04 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:38.223787 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b6d9e-fa9a-4c51-8cbc-093a358e2a04 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:38.224085 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b6d9e-fa9a-4c51-8cbc-093a358e2a04 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:38.249543 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b6d9e-fa9a-4c51-8cbc-093a358e2a04 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:38.262226 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 261/521] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:50:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:38.267780 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe185b2c-f10f-413d-8718-2bdde38d4a2f admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:38.276852 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe185b2c-f10f-413d-8718-2bdde38d4a2f admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:38.281196 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed63e59-73b9-4a39-8867-88818d1f5b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:38.281759 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed63e59-73b9-4a39-8867-88818d1f5b19 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:38.282046 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed63e59-73b9-4a39-8867-88818d1f5b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:38.282324 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed63e59-73b9-4a39-8867-88818d1f5b19 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:38.283094 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed63e59-73b9-4a39-8867-88818d1f5b19 admin admin] RBAC: Adding query filter params (role.id=11f4d60c63ce44fbb0b73623a47d4ea5, scope.project.id=f79f19c59cfd43c48871b51d6aaf501f, user.id=01acdb65e66441418d4abe1f0ed804bc) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:38.283398 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed63e59-73b9-4a39-8867-88818d1f5b19 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:38.309063 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed63e59-73b9-4a39-8867-88818d1f5b19 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:38.314514 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 261/522] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:50:38 2021] GET /identity/v3/role_assignments?user.id=01acdb65e66441418d4abe1f0ed804bc&scope.project.id=f79f19c59cfd43c48871b51d6aaf501f&role.id=11f4d60c63ce44fbb0b73623a47d4ea5 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:40.333736 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e25591-49f3-492a-8a85-78783f1e7de7 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:40.334187 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e25591-49f3-492a-8a85-78783f1e7de7 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:40.334308 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e25591-49f3-492a-8a85-78783f1e7de7 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:40.336016 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 262/523] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:50:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:50:40.341749 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac07c65-d6af-48ab-8a1b-46a09a8e4d2e None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:40.342156 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac07c65-d6af-48ab-8a1b-46a09a8e4d2e None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:40.342299 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac07c65-d6af-48ab-8a1b-46a09a8e4d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:40.364017 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-7ac07c65-d6af-48ab-8a1b-46a09a8e4d2e None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:50:40.365139 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-7ac07c65-d6af-48ab-8a1b-46a09a8e4d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:50:40.371566 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 262/524] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:50:40 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:50:40.395112 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e25591-49f3-492a-8a85-78783f1e7de7 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:40.406622 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e25591-49f3-492a-8a85-78783f1e7de7 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:40.410441 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9646b8-8125-476b-893a-606a1884c6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:40.411136 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9646b8-8125-476b-893a-606a1884c6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:40.411424 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9646b8-8125-476b-893a-606a1884c6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:40.411728 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9646b8-8125-476b-893a-606a1884c6b1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:40.423197 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9646b8-8125-476b-893a-606a1884c6b1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:40.449049 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9646b8-8125-476b-893a-606a1884c6b1 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:40.465822 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-de9646b8-8125-476b-893a-606a1884c6b1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:50:40.466860 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 263/525] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:50:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:40.472255 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac07c65-d6af-48ab-8a1b-46a09a8e4d2e None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:40.480464 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac07c65-d6af-48ab-8a1b-46a09a8e4d2e None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:40.484338 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb59f1f-eee2-4954-be20-d02a0e218f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:40.484913 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb59f1f-eee2-4954-be20-d02a0e218f75 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:40.485192 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb59f1f-eee2-4954-be20-d02a0e218f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:40.485462 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb59f1f-eee2-4954-be20-d02a0e218f75 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:40.486134 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb59f1f-eee2-4954-be20-d02a0e218f75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:40.486425 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb59f1f-eee2-4954-be20-d02a0e218f75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:40.511501 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb59f1f-eee2-4954-be20-d02a0e218f75 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:40.524127 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 263/526] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:50:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:40.529219 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9646b8-8125-476b-893a-606a1884c6b1 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:40.538291 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9646b8-8125-476b-893a-606a1884c6b1 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:40.542378 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29cf3d-f250-44a2-8bc0-85d30fabdf79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:40.542947 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29cf3d-f250-44a2-8bc0-85d30fabdf79 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:40.543233 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29cf3d-f250-44a2-8bc0-85d30fabdf79 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:40.543545 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29cf3d-f250-44a2-8bc0-85d30fabdf79 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:40.544178 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29cf3d-f250-44a2-8bc0-85d30fabdf79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:40.569529 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29cf3d-f250-44a2-8bc0-85d30fabdf79 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:40.590555 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 264/527] 10.222.0.89 () {60 vars in 1153 bytes} [Wed Oct 27 14:50:40 2021] POST /identity/v3/users => generated 248 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:50:42.559306 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4edc4-10c5-4c5a-b6eb-8807b475bc10 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:42.559826 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4edc4-10c5-4c5a-b6eb-8807b475bc10 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:42.560002 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4edc4-10c5-4c5a-b6eb-8807b475bc10 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:42.561553 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 264/528] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:50:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:50:42.566531 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff386d10-8506-4a80-9dd8-15c194ce9a5d None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:42.566952 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff386d10-8506-4a80-9dd8-15c194ce9a5d None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:42.567114 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff386d10-8506-4a80-9dd8-15c194ce9a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:42.589188 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-ff386d10-8506-4a80-9dd8-15c194ce9a5d None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:50:42.590308 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-ff386d10-8506-4a80-9dd8-15c194ce9a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:50:42.597509 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 265/529] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:50:42 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:50:42.618994 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4edc4-10c5-4c5a-b6eb-8807b475bc10 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:42.630716 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d4edc4-10c5-4c5a-b6eb-8807b475bc10 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:42.634544 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7787e1c-cc3e-4c50-860d-929522982f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:42.635237 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7787e1c-cc3e-4c50-860d-929522982f1a admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:42.635557 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7787e1c-cc3e-4c50-860d-929522982f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:42.635834 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7787e1c-cc3e-4c50-860d-929522982f1a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:42.647216 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7787e1c-cc3e-4c50-860d-929522982f1a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:50:42.653474 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-c7787e1c-cc3e-4c50-860d-929522982f1a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 14:50:42.654504 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 265/530] 10.222.0.89 () {56 vars in 1123 bytes} [Wed Oct 27 14:50:42 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:42.659719 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff386d10-8506-4a80-9dd8-15c194ce9a5d None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:42.668179 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff386d10-8506-4a80-9dd8-15c194ce9a5d None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:42.672074 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05e33f-eefb-450d-9421-fd5ee3810911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:42.672643 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05e33f-eefb-450d-9421-fd5ee3810911 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:42.672924 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05e33f-eefb-450d-9421-fd5ee3810911 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:42.673198 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05e33f-eefb-450d-9421-fd5ee3810911 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:42.673891 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b05e33f-eefb-450d-9421-fd5ee3810911 admin admin] RBAC: Adding query filter params (name=service) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:42.674184 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b05e33f-eefb-450d-9421-fd5ee3810911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:42.699222 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b05e33f-eefb-450d-9421-fd5ee3810911 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:42.707867 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 266/531] 10.222.0.89 () {56 vars in 1124 bytes} [Wed Oct 27 14:50:42 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:42.712968 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7787e1c-cc3e-4c50-860d-929522982f1a admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:42.722247 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7787e1c-cc3e-4c50-860d-929522982f1a admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:42.726149 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef2f90-0f53-49be-b9a2-3c32ba7559b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:42.726823 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef2f90-0f53-49be-b9a2-3c32ba7559b9 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:42.727107 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef2f90-0f53-49be-b9a2-3c32ba7559b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:42.727382 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef2f90-0f53-49be-b9a2-3c32ba7559b9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:42.738238 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef2f90-0f53-49be-b9a2-3c32ba7559b9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:42.764260 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef2f90-0f53-49be-b9a2-3c32ba7559b9 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:42.781356 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-d1ef2f90-0f53-49be-b9a2-3c32ba7559b9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:50:42.782403 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 266/532] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:50:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:42.787535 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05e33f-eefb-450d-9421-fd5ee3810911 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:42.796627 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05e33f-eefb-450d-9421-fd5ee3810911 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:42.800549 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6f866-0a00-4d3a-ae46-128a1646a0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:42.801106 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6f866-0a00-4d3a-ae46-128a1646a0aa admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:42.801386 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6f866-0a00-4d3a-ae46-128a1646a0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:42.801655 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c6f866-0a00-4d3a-ae46-128a1646a0aa admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:42.802322 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6f866-0a00-4d3a-ae46-128a1646a0aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:42.802613 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6f866-0a00-4d3a-ae46-128a1646a0aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:42.828167 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c6f866-0a00-4d3a-ae46-128a1646a0aa admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:42.840210 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 267/533] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:50:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:42.845031 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef2f90-0f53-49be-b9a2-3c32ba7559b9 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:42.853805 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef2f90-0f53-49be-b9a2-3c32ba7559b9 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:42.857663 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514243a9-0946-454d-a112-7f11e0829fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:42.858334 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514243a9-0946-454d-a112-7f11e0829fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:42.858614 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514243a9-0946-454d-a112-7f11e0829fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:42.858883 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514243a9-0946-454d-a112-7f11e0829fb1 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:42.871000 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514243a9-0946-454d-a112-7f11e0829fb1 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:42.897174 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514243a9-0946-454d-a112-7f11e0829fb1 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:42.914470 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-514243a9-0946-454d-a112-7f11e0829fb1 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 27 14:50:42.915523 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 267/534] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:50:42 2021] GET /identity/v3/users/glance => generated 84 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:42.920505 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6f866-0a00-4d3a-ae46-128a1646a0aa admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:42.929361 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c6f866-0a00-4d3a-ae46-128a1646a0aa admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:42.933263 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7cf14-ab21-4f03-a692-d860e6bb6157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:42.933838 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7cf14-ab21-4f03-a692-d860e6bb6157 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:42.934124 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7cf14-ab21-4f03-a692-d860e6bb6157 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:42.934904 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7cf14-ab21-4f03-a692-d860e6bb6157 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:42.935722 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7cf14-ab21-4f03-a692-d860e6bb6157 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:42.936022 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7cf14-ab21-4f03-a692-d860e6bb6157 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:42.961538 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7cf14-ab21-4f03-a692-d860e6bb6157 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:42.989869 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 268/535] 10.222.0.89 () {56 vars in 1158 bytes} [Wed Oct 27 14:50:42 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:42.994896 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514243a9-0946-454d-a112-7f11e0829fb1 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:43.003947 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514243a9-0946-454d-a112-7f11e0829fb1 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:43.007909 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131cc8a-f6d8-453f-a156-95698b37f269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:43.008462 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131cc8a-f6d8-453f-a156-95698b37f269 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:43.008747 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131cc8a-f6d8-453f-a156-95698b37f269 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:43.009023 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131cc8a-f6d8-453f-a156-95698b37f269 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:43.016921 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b131cc8a-f6d8-453f-a156-95698b37f269 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:43.042534 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b131cc8a-f6d8-453f-a156-95698b37f269 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:43.050697 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 268/536] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:50:42 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:50:43.055774 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7cf14-ab21-4f03-a692-d860e6bb6157 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:43.064607 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7cf14-ab21-4f03-a692-d860e6bb6157 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:43.068448 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99005656-c8f2-426c-9d72-e5e81c26aab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:43.069135 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99005656-c8f2-426c-9d72-e5e81c26aab2 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:43.069420 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99005656-c8f2-426c-9d72-e5e81c26aab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:43.069699 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99005656-c8f2-426c-9d72-e5e81c26aab2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:43.081451 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99005656-c8f2-426c-9d72-e5e81c26aab2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:43.106828 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99005656-c8f2-426c-9d72-e5e81c26aab2 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:43.122951 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-99005656-c8f2-426c-9d72-e5e81c26aab2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:50:43.124004 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 269/537] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:50:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:43.129007 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131cc8a-f6d8-453f-a156-95698b37f269 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:43.137107 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131cc8a-f6d8-453f-a156-95698b37f269 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:43.141586 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ded3dc-bc7c-4bed-ae0d-7f58e7dc1de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:43.142150 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ded3dc-bc7c-4bed-ae0d-7f58e7dc1de0 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:43.142438 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ded3dc-bc7c-4bed-ae0d-7f58e7dc1de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:43.142715 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ded3dc-bc7c-4bed-ae0d-7f58e7dc1de0 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:43.143381 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ded3dc-bc7c-4bed-ae0d-7f58e7dc1de0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:43.143707 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ded3dc-bc7c-4bed-ae0d-7f58e7dc1de0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:43.169254 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ded3dc-bc7c-4bed-ae0d-7f58e7dc1de0 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:43.181642 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 269/538] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:50:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:50:43.186557 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99005656-c8f2-426c-9d72-e5e81c26aab2 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:43.195567 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99005656-c8f2-426c-9d72-e5e81c26aab2 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:43.199523 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ba786-033d-4d90-bfe0-b5e120ea5662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:43.200638 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ba786-033d-4d90-bfe0-b5e120ea5662 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:43.200919 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ba786-033d-4d90-bfe0-b5e120ea5662 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:43.201194 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ba786-033d-4d90-bfe0-b5e120ea5662 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:43.209742 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ba786-033d-4d90-bfe0-b5e120ea5662 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:43.235267 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ba786-033d-4d90-bfe0-b5e120ea5662 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:43.248487 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-1c8ba786-033d-4d90-bfe0-b5e120ea5662 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:50:43.249531 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 270/539] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:50:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:43.254998 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ded3dc-bc7c-4bed-ae0d-7f58e7dc1de0 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:43.264566 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ded3dc-bc7c-4bed-ae0d-7f58e7dc1de0 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:43.268493 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3eb0a-fbda-4a52-a182-361aaba32ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:43.269069 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3eb0a-fbda-4a52-a182-361aaba32ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:43.269352 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3eb0a-fbda-4a52-a182-361aaba32ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:43.269781 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3eb0a-fbda-4a52-a182-361aaba32ea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:43.270515 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3eb0a-fbda-4a52-a182-361aaba32ea6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:43.270810 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3eb0a-fbda-4a52-a182-361aaba32ea6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:43.296745 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3eb0a-fbda-4a52-a182-361aaba32ea6 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:43.309183 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 270/540] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:50:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:50:43.314620 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ba786-033d-4d90-bfe0-b5e120ea5662 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:43.323655 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ba786-033d-4d90-bfe0-b5e120ea5662 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:43.328094 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f1639-01cb-4249-bc39-e51f6190bd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:43.328654 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f1639-01cb-4249-bc39-e51f6190bd42 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:43.328937 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f1639-01cb-4249-bc39-e51f6190bd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:43.329213 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f1639-01cb-4249-bc39-e51f6190bd42 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:43.329980 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f1639-01cb-4249-bc39-e51f6190bd42 admin admin] RBAC: Adding query filter params (role.id=0af8b2c9076246e6ac61d13d88d91976, scope.project.id=f79f19c59cfd43c48871b51d6aaf501f, user.id=17c345fc642242469346303afbeda2f6) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:43.330282 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f1639-01cb-4249-bc39-e51f6190bd42 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:43.355837 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f1639-01cb-4249-bc39-e51f6190bd42 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:43.360881 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 271/541] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:50:43 2021] GET /identity/v3/role_assignments?user.id=17c345fc642242469346303afbeda2f6&scope.project.id=f79f19c59cfd43c48871b51d6aaf501f&role.id=0af8b2c9076246e6ac61d13d88d91976 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:45.267286 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f621bb-1d48-4937-8478-140b71fd099d None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:45.267768 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f621bb-1d48-4937-8478-140b71fd099d None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:45.267885 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f621bb-1d48-4937-8478-140b71fd099d None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:45.269574 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 271/542] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:50:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:50:45.274554 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c822cdc-333f-4adc-bfcc-c86d2fdd53d0 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:45.274959 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c822cdc-333f-4adc-bfcc-c86d2fdd53d0 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:45.275122 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c822cdc-333f-4adc-bfcc-c86d2fdd53d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:45.298118 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-5c822cdc-333f-4adc-bfcc-c86d2fdd53d0 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:50:45.299241 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-5c822cdc-333f-4adc-bfcc-c86d2fdd53d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:50:45.305796 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 272/543] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:50:45 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:50:45.327822 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f621bb-1d48-4937-8478-140b71fd099d None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:45.339127 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f621bb-1d48-4937-8478-140b71fd099d None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:45.343696 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb9731-6067-48b5-b9a3-84e64c935b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:45.344399 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb9731-6067-48b5-b9a3-84e64c935b1e admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:45.344687 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb9731-6067-48b5-b9a3-84e64c935b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:45.344964 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb9731-6067-48b5-b9a3-84e64c935b1e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:45.355890 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb9731-6067-48b5-b9a3-84e64c935b1e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:50:45.362157 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-49eb9731-6067-48b5-b9a3-84e64c935b1e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 14:50:45.363230 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 272/544] 10.222.0.89 () {56 vars in 1123 bytes} [Wed Oct 27 14:50:45 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:45.368558 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c822cdc-333f-4adc-bfcc-c86d2fdd53d0 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:45.376909 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c822cdc-333f-4adc-bfcc-c86d2fdd53d0 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:45.380817 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5870a6-e723-45fa-b998-d93080fdbb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:45.381397 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5870a6-e723-45fa-b998-d93080fdbb0b admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:45.381684 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5870a6-e723-45fa-b998-d93080fdbb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:45.381959 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5870a6-e723-45fa-b998-d93080fdbb0b admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:45.382658 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5870a6-e723-45fa-b998-d93080fdbb0b admin admin] RBAC: Adding query filter params (name=service) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:45.382954 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5870a6-e723-45fa-b998-d93080fdbb0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:45.409117 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5870a6-e723-45fa-b998-d93080fdbb0b admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:45.417550 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 273/545] 10.222.0.89 () {56 vars in 1124 bytes} [Wed Oct 27 14:50:45 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:45.422642 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb9731-6067-48b5-b9a3-84e64c935b1e admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:45.432101 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb9731-6067-48b5-b9a3-84e64c935b1e admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:45.436006 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44dfb2-781f-40a5-b40b-6b953f36ecc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:45.436717 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44dfb2-781f-40a5-b40b-6b953f36ecc1 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:45.436998 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44dfb2-781f-40a5-b40b-6b953f36ecc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:45.437274 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44dfb2-781f-40a5-b40b-6b953f36ecc1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:45.448225 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44dfb2-781f-40a5-b40b-6b953f36ecc1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:45.474415 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44dfb2-781f-40a5-b40b-6b953f36ecc1 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:45.491303 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-ee44dfb2-781f-40a5-b40b-6b953f36ecc1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:50:45.492371 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 273/546] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:50:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:45.497797 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5870a6-e723-45fa-b998-d93080fdbb0b admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:45.507044 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5870a6-e723-45fa-b998-d93080fdbb0b admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:45.511046 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51698d0-36d5-4dce-92dc-c7b5c75afe23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:45.511618 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51698d0-36d5-4dce-92dc-c7b5c75afe23 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:45.511904 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51698d0-36d5-4dce-92dc-c7b5c75afe23 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:45.512188 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51698d0-36d5-4dce-92dc-c7b5c75afe23 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:45.513372 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51698d0-36d5-4dce-92dc-c7b5c75afe23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:45.513669 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51698d0-36d5-4dce-92dc-c7b5c75afe23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:45.539283 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51698d0-36d5-4dce-92dc-c7b5c75afe23 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:45.551736 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 274/547] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:50:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:45.556661 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44dfb2-781f-40a5-b40b-6b953f36ecc1 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:45.565520 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44dfb2-781f-40a5-b40b-6b953f36ecc1 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:45.569451 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a22331-cbaa-4636-88ed-4285edc97250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:45.570142 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a22331-cbaa-4636-88ed-4285edc97250 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:45.570428 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a22331-cbaa-4636-88ed-4285edc97250 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:45.570709 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a22331-cbaa-4636-88ed-4285edc97250 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:45.583413 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a22331-cbaa-4636-88ed-4285edc97250 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:45.609071 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a22331-cbaa-4636-88ed-4285edc97250 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:45.626513 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-b6a22331-cbaa-4636-88ed-4285edc97250 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 27 14:50:45.627556 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 274/548] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:50:45 2021] GET /identity/v3/users/glance => generated 84 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:45.632804 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51698d0-36d5-4dce-92dc-c7b5c75afe23 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:45.641915 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51698d0-36d5-4dce-92dc-c7b5c75afe23 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:45.645885 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34927803-dcdd-4c6b-9999-66efcb224dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:45.646477 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34927803-dcdd-4c6b-9999-66efcb224dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:45.646764 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34927803-dcdd-4c6b-9999-66efcb224dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:45.647042 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34927803-dcdd-4c6b-9999-66efcb224dc0 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:45.647860 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34927803-dcdd-4c6b-9999-66efcb224dc0 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:45.648162 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34927803-dcdd-4c6b-9999-66efcb224dc0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:45.674484 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34927803-dcdd-4c6b-9999-66efcb224dc0 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:45.702810 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 275/549] 10.222.0.89 () {56 vars in 1158 bytes} [Wed Oct 27 14:50:45 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:45.708070 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a22331-cbaa-4636-88ed-4285edc97250 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:45.717455 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a22331-cbaa-4636-88ed-4285edc97250 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:45.721380 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2a429-61d2-4e85-9074-8387288f4edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:45.722073 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2a429-61d2-4e85-9074-8387288f4edc admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:45.722357 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2a429-61d2-4e85-9074-8387288f4edc admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:45.722633 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e2a429-61d2-4e85-9074-8387288f4edc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:45.735031 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2a429-61d2-4e85-9074-8387288f4edc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:45.759926 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e2a429-61d2-4e85-9074-8387288f4edc admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:45.776064 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-76e2a429-61d2-4e85-9074-8387288f4edc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:50:45.777034 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 275/550] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:50:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:45.782652 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34927803-dcdd-4c6b-9999-66efcb224dc0 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:45.792030 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34927803-dcdd-4c6b-9999-66efcb224dc0 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:45.796699 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4510d-cdc0-453c-bf54-39f089dd0304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:45.797275 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4510d-cdc0-453c-bf54-39f089dd0304 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:45.797564 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4510d-cdc0-453c-bf54-39f089dd0304 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:45.797845 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4510d-cdc0-453c-bf54-39f089dd0304 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:45.798525 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4510d-cdc0-453c-bf54-39f089dd0304 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:45.798825 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4510d-cdc0-453c-bf54-39f089dd0304 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:45.823622 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4510d-cdc0-453c-bf54-39f089dd0304 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:45.835105 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 276/551] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:50:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:50:45.840008 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2a429-61d2-4e85-9074-8387288f4edc admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:45.849286 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e2a429-61d2-4e85-9074-8387288f4edc admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:45.853194 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80ad65-371a-4ec5-b8f1-6190b99cbed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:45.853878 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80ad65-371a-4ec5-b8f1-6190b99cbed4 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:45.854162 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80ad65-371a-4ec5-b8f1-6190b99cbed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:45.854440 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f80ad65-371a-4ec5-b8f1-6190b99cbed4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:45.864859 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80ad65-371a-4ec5-b8f1-6190b99cbed4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:45.889531 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f80ad65-371a-4ec5-b8f1-6190b99cbed4 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:45.902485 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-3f80ad65-371a-4ec5-b8f1-6190b99cbed4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:50:45.904086 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 276/552] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:50:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:45.909326 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4510d-cdc0-453c-bf54-39f089dd0304 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:45.918556 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4510d-cdc0-453c-bf54-39f089dd0304 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:45.923097 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b89cd-0d74-4ad4-8cef-0c1b94da4209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:45.923704 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b89cd-0d74-4ad4-8cef-0c1b94da4209 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:45.923994 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b89cd-0d74-4ad4-8cef-0c1b94da4209 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:45.924272 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b89cd-0d74-4ad4-8cef-0c1b94da4209 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:45.925006 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b89cd-0d74-4ad4-8cef-0c1b94da4209 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:45.925306 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b89cd-0d74-4ad4-8cef-0c1b94da4209 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:45.950484 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b89cd-0d74-4ad4-8cef-0c1b94da4209 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:45.963172 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 277/553] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:50:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:45.968790 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80ad65-371a-4ec5-b8f1-6190b99cbed4 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:45.977531 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f80ad65-371a-4ec5-b8f1-6190b99cbed4 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:45.981991 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d83d4f-949e-4b6f-a6b9-c4387c661020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:45.982766 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d83d4f-949e-4b6f-a6b9-c4387c661020 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:45.983046 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d83d4f-949e-4b6f-a6b9-c4387c661020 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:45.983317 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d83d4f-949e-4b6f-a6b9-c4387c661020 admin admin] PATH_INFO: `/v3/projects/f79f19c59cfd43c48871b51d6aaf501f/users/17c345fc642242469346303afbeda2f6/roles/0af8b2c9076246e6ac61d13d88d91976` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:46.002214 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d83d4f-949e-4b6f-a6b9-c4387c661020 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79f19c59cfd43c48871b51d6aaf501f, user_id=17c345fc642242469346303afbeda2f6, role_id=0af8b2c9076246e6ac61d13d88d91976)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:46.028994 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d83d4f-949e-4b6f-a6b9-c4387c661020 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:46.041241 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 277/554] 10.222.0.89 () {58 vars in 1460 bytes} [Wed Oct 27 14:50:45 2021] PUT /identity/v3/projects/f79f19c59cfd43c48871b51d6aaf501f/users/17c345fc642242469346303afbeda2f6/roles/0af8b2c9076246e6ac61d13d88d91976 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:50:47.963467 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ec6e2-c24a-4fbd-8b54-641ccc0408cb None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:47.964025 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ec6e2-c24a-4fbd-8b54-641ccc0408cb None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:47.964025 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81ec6e2-c24a-4fbd-8b54-641ccc0408cb None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:47.966232 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 278/555] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:50:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:50:47.971151 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cc42b-f472-42fd-b01b-d5557288baf6 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:47.971624 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cc42b-f472-42fd-b01b-d5557288baf6 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:47.971750 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cc42b-f472-42fd-b01b-d5557288baf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:47.994051 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-1a2cc42b-f472-42fd-b01b-d5557288baf6 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:50:47.995183 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-1a2cc42b-f472-42fd-b01b-d5557288baf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:50:48.057010 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 278/556] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:50:47 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:50:48.078891 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ec6e2-c24a-4fbd-8b54-641ccc0408cb None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:48.090349 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81ec6e2-c24a-4fbd-8b54-641ccc0408cb None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:48.094635 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97149aa-0b65-4242-bde6-f30aa2e7b7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:48.095336 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97149aa-0b65-4242-bde6-f30aa2e7b7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:48.095656 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97149aa-0b65-4242-bde6-f30aa2e7b7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:48.095942 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97149aa-0b65-4242-bde6-f30aa2e7b7f4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:48.107321 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97149aa-0b65-4242-bde6-f30aa2e7b7f4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:50:48.113588 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-e97149aa-0b65-4242-bde6-f30aa2e7b7f4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 14:50:48.114646 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 279/557] 10.222.0.89 () {56 vars in 1123 bytes} [Wed Oct 27 14:50:48 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:48.119770 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2cc42b-f472-42fd-b01b-d5557288baf6 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:48.128024 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2cc42b-f472-42fd-b01b-d5557288baf6 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:48.131952 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3985235-a05b-4460-b065-34b60db26a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:48.132532 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3985235-a05b-4460-b065-34b60db26a4a admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:48.132817 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3985235-a05b-4460-b065-34b60db26a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:48.133094 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3985235-a05b-4460-b065-34b60db26a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:48.133791 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3985235-a05b-4460-b065-34b60db26a4a admin admin] RBAC: Adding query filter params (name=service) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:48.134086 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3985235-a05b-4460-b065-34b60db26a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:48.159279 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3985235-a05b-4460-b065-34b60db26a4a admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:48.167615 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 279/558] 10.222.0.89 () {56 vars in 1124 bytes} [Wed Oct 27 14:50:48 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:48.173444 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97149aa-0b65-4242-bde6-f30aa2e7b7f4 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:48.184626 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97149aa-0b65-4242-bde6-f30aa2e7b7f4 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:48.188601 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5330e9-6c45-4548-b1b4-a2212e07fdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:48.189312 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5330e9-6c45-4548-b1b4-a2212e07fdeb admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:48.189598 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5330e9-6c45-4548-b1b4-a2212e07fdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:48.189874 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5330e9-6c45-4548-b1b4-a2212e07fdeb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:48.200822 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5330e9-6c45-4548-b1b4-a2212e07fdeb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:48.226082 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5330e9-6c45-4548-b1b4-a2212e07fdeb admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:48.243630 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-0c5330e9-6c45-4548-b1b4-a2212e07fdeb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:50:48.244686 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 280/559] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:50:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:48.250099 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3985235-a05b-4460-b065-34b60db26a4a admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:48.259163 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3985235-a05b-4460-b065-34b60db26a4a admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:48.263587 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf7d7a-a8e4-4482-9ad2-fe61b9198f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:48.264165 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf7d7a-a8e4-4482-9ad2-fe61b9198f60 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:48.264449 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf7d7a-a8e4-4482-9ad2-fe61b9198f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:48.264750 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf7d7a-a8e4-4482-9ad2-fe61b9198f60 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:48.265430 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf7d7a-a8e4-4482-9ad2-fe61b9198f60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:48.265728 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf7d7a-a8e4-4482-9ad2-fe61b9198f60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:48.291318 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bf7d7a-a8e4-4482-9ad2-fe61b9198f60 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:48.303598 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 280/560] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:50:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:48.308713 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5330e9-6c45-4548-b1b4-a2212e07fdeb admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:48.317703 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5330e9-6c45-4548-b1b4-a2212e07fdeb admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:48.321603 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bcc32-1a46-40df-93b8-c9f147b975ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:48.322297 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bcc32-1a46-40df-93b8-c9f147b975ac admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:48.322579 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bcc32-1a46-40df-93b8-c9f147b975ac admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:48.322853 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bcc32-1a46-40df-93b8-c9f147b975ac admin admin] PATH_INFO: `/v3/users/glance` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:48.335578 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bcc32-1a46-40df-93b8-c9f147b975ac admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:48.361103 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bcc32-1a46-40df-93b8-c9f147b975ac admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:48.377948 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-1b1bcc32-1a46-40df-93b8-c9f147b975ac admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 27 14:50:48.378971 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 281/561] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:50:48 2021] GET /identity/v3/users/glance => generated 84 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:48.384073 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf7d7a-a8e4-4482-9ad2-fe61b9198f60 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:48.393487 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bf7d7a-a8e4-4482-9ad2-fe61b9198f60 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:48.397397 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d5933-ff69-4912-9dc2-07c484980c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:48.397978 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d5933-ff69-4912-9dc2-07c484980c35 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:48.398264 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d5933-ff69-4912-9dc2-07c484980c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:48.398543 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d5933-ff69-4912-9dc2-07c484980c35 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:48.399322 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d5933-ff69-4912-9dc2-07c484980c35 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:48.399653 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d5933-ff69-4912-9dc2-07c484980c35 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:48.425735 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d5933-ff69-4912-9dc2-07c484980c35 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:48.453958 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 281/562] 10.222.0.89 () {56 vars in 1158 bytes} [Wed Oct 27 14:50:48 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:50:48.459027 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bcc32-1a46-40df-93b8-c9f147b975ac admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:48.468498 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bcc32-1a46-40df-93b8-c9f147b975ac admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:48.472325 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041e061-0262-43d2-846b-cd91da015535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:48.472873 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041e061-0262-43d2-846b-cd91da015535 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:48.473154 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041e061-0262-43d2-846b-cd91da015535 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:48.473425 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041e061-0262-43d2-846b-cd91da015535 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:48.480862 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041e061-0262-43d2-846b-cd91da015535 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:48.505498 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041e061-0262-43d2-846b-cd91da015535 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:48.514149 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 282/563] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:50:48 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:50:48.519070 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d5933-ff69-4912-9dc2-07c484980c35 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:48.528591 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d5933-ff69-4912-9dc2-07c484980c35 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:48.532537 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e57bd-3635-4d9a-b11f-7d2ede6b6b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:48.533219 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e57bd-3635-4d9a-b11f-7d2ede6b6b47 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:48.533505 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e57bd-3635-4d9a-b11f-7d2ede6b6b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:48.533783 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e57bd-3635-4d9a-b11f-7d2ede6b6b47 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:48.545197 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e57bd-3635-4d9a-b11f-7d2ede6b6b47 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:48.570052 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e57bd-3635-4d9a-b11f-7d2ede6b6b47 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:48.586657 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-dd7e57bd-3635-4d9a-b11f-7d2ede6b6b47 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:50:48.587708 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 282/564] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:50:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:48.593242 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041e061-0262-43d2-846b-cd91da015535 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:48.601474 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041e061-0262-43d2-846b-cd91da015535 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:48.605445 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca2a5b-99d5-4228-a500-bae97c275952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:48.606013 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca2a5b-99d5-4228-a500-bae97c275952 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:48.606298 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca2a5b-99d5-4228-a500-bae97c275952 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:48.606577 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca2a5b-99d5-4228-a500-bae97c275952 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:48.607250 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca2a5b-99d5-4228-a500-bae97c275952 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:48.607588 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca2a5b-99d5-4228-a500-bae97c275952 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:48.632698 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca2a5b-99d5-4228-a500-bae97c275952 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:48.645732 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 283/565] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:50:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:48.650532 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e57bd-3635-4d9a-b11f-7d2ede6b6b47 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:48.659373 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e57bd-3635-4d9a-b11f-7d2ede6b6b47 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:48.663275 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636dd5e0-3961-4fa3-9a82-21d5586124b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:48.664243 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636dd5e0-3961-4fa3-9a82-21d5586124b8 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:48.664531 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636dd5e0-3961-4fa3-9a82-21d5586124b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:48.664814 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636dd5e0-3961-4fa3-9a82-21d5586124b8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:48.673458 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636dd5e0-3961-4fa3-9a82-21d5586124b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:48.699015 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636dd5e0-3961-4fa3-9a82-21d5586124b8 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:48.712678 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-636dd5e0-3961-4fa3-9a82-21d5586124b8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:50:48.713696 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 283/566] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:50:48 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:48.718725 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca2a5b-99d5-4228-a500-bae97c275952 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:48.727591 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca2a5b-99d5-4228-a500-bae97c275952 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:48.731562 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41550458-dee4-40f7-bf34-d5883a9a251f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:48.732073 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41550458-dee4-40f7-bf34-d5883a9a251f admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:48.732358 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41550458-dee4-40f7-bf34-d5883a9a251f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:48.732634 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41550458-dee4-40f7-bf34-d5883a9a251f admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:48.733364 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41550458-dee4-40f7-bf34-d5883a9a251f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:48.733660 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41550458-dee4-40f7-bf34-d5883a9a251f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:48.758960 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41550458-dee4-40f7-bf34-d5883a9a251f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:48.772178 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 284/567] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:50:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:48.777276 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636dd5e0-3961-4fa3-9a82-21d5586124b8 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:48.786102 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636dd5e0-3961-4fa3-9a82-21d5586124b8 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:48.790321 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07fb1f-c82f-424d-b824-5ca21cc5ba38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:48.790883 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07fb1f-c82f-424d-b824-5ca21cc5ba38 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:48.791171 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07fb1f-c82f-424d-b824-5ca21cc5ba38 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:48.791480 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07fb1f-c82f-424d-b824-5ca21cc5ba38 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:48.792254 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07fb1f-c82f-424d-b824-5ca21cc5ba38 admin admin] RBAC: Adding query filter params (role.id=0af8b2c9076246e6ac61d13d88d91976, scope.project.id=f79f19c59cfd43c48871b51d6aaf501f, user.id=17c345fc642242469346303afbeda2f6) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:48.792558 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07fb1f-c82f-424d-b824-5ca21cc5ba38 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:48.817894 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b07fb1f-c82f-424d-b824-5ca21cc5ba38 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:48.823571 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 284/568] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:50:48 2021] GET /identity/v3/role_assignments?user.id=17c345fc642242469346303afbeda2f6&scope.project.id=f79f19c59cfd43c48871b51d6aaf501f&role.id=0af8b2c9076246e6ac61d13d88d91976 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:50.803879 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6779255-f584-4c22-9777-94769101d20c None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:50.804404 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6779255-f584-4c22-9777-94769101d20c None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:50.804491 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6779255-f584-4c22-9777-94769101d20c None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:50.806096 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 285/569] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:50:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:50:50.811785 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67458cfb-a955-44ad-b68c-952e1670313e None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:50.812150 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67458cfb-a955-44ad-b68c-952e1670313e None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:50.812349 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67458cfb-a955-44ad-b68c-952e1670313e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:50.834300 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-67458cfb-a955-44ad-b68c-952e1670313e None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:50:50.835427 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-67458cfb-a955-44ad-b68c-952e1670313e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:50:50.842516 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 285/570] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:50:50 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:50:50.865875 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6779255-f584-4c22-9777-94769101d20c None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:50.877138 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6779255-f584-4c22-9777-94769101d20c None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:50.880944 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ba009-c545-486f-9282-25ab274e06bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:50.881641 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ba009-c545-486f-9282-25ab274e06bf admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:50.881925 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ba009-c545-486f-9282-25ab274e06bf admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:50.882202 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ba009-c545-486f-9282-25ab274e06bf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:50.893407 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ba009-c545-486f-9282-25ab274e06bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:50.919741 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ba009-c545-486f-9282-25ab274e06bf admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:50.935949 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-7b8ba009-c545-486f-9282-25ab274e06bf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:50:50.936982 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 286/571] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:50:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:50.942467 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67458cfb-a955-44ad-b68c-952e1670313e None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:50.950869 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67458cfb-a955-44ad-b68c-952e1670313e None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:50.954787 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c3f395-0d54-4b69-8e3f-41cfa296aac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:50.955364 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3f395-0d54-4b69-8e3f-41cfa296aac8 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:50.955683 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3f395-0d54-4b69-8e3f-41cfa296aac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:50.955960 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c3f395-0d54-4b69-8e3f-41cfa296aac8 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:50.956637 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c3f395-0d54-4b69-8e3f-41cfa296aac8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:50.956932 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c3f395-0d54-4b69-8e3f-41cfa296aac8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:50.982730 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c3f395-0d54-4b69-8e3f-41cfa296aac8 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:50.995038 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 286/572] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:50:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:50:51.000024 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ba009-c545-486f-9282-25ab274e06bf admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:51.009011 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ba009-c545-486f-9282-25ab274e06bf admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:51.012928 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44de1ee-308b-478e-8e93-3e0cc607222e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:51.013505 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44de1ee-308b-478e-8e93-3e0cc607222e admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:51.013813 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44de1ee-308b-478e-8e93-3e0cc607222e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:51.014090 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44de1ee-308b-478e-8e93-3e0cc607222e admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:51.014726 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44de1ee-308b-478e-8e93-3e0cc607222e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:51.040453 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44de1ee-308b-478e-8e93-3e0cc607222e admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:51.059978 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 287/573] 10.222.0.89 () {60 vars in 1153 bytes} [Wed Oct 27 14:50:50 2021] POST /identity/v3/users => generated 254 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:50:53.009504 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477f8eb-60fa-4e47-b0d0-3593b926c0a6 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:53.010052 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477f8eb-60fa-4e47-b0d0-3593b926c0a6 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:53.010052 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477f8eb-60fa-4e47-b0d0-3593b926c0a6 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:53.011730 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 287/574] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:50:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:50:53.017376 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329e109-3bd1-4723-9a88-134f361338b3 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:53.017753 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329e109-3bd1-4723-9a88-134f361338b3 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:53.017934 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329e109-3bd1-4723-9a88-134f361338b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:53.040156 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-f329e109-3bd1-4723-9a88-134f361338b3 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:50:53.041276 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-f329e109-3bd1-4723-9a88-134f361338b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:50:53.047907 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 288/575] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:50:53 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:50:53.069113 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477f8eb-60fa-4e47-b0d0-3593b926c0a6 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:53.080696 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477f8eb-60fa-4e47-b0d0-3593b926c0a6 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:53.084413 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca57121-0f53-4e95-8be6-01d3f8b2a66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:53.085105 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca57121-0f53-4e95-8be6-01d3f8b2a66a admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:53.085385 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca57121-0f53-4e95-8be6-01d3f8b2a66a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:53.085656 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca57121-0f53-4e95-8be6-01d3f8b2a66a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:53.096973 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca57121-0f53-4e95-8be6-01d3f8b2a66a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:50:53.103110 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-6ca57121-0f53-4e95-8be6-01d3f8b2a66a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 14:50:53.104165 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 288/576] 10.222.0.89 () {56 vars in 1123 bytes} [Wed Oct 27 14:50:53 2021] GET /identity/v3/roles/service => generated 85 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 14:50:53.109325 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329e109-3bd1-4723-9a88-134f361338b3 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:53.117632 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329e109-3bd1-4723-9a88-134f361338b3 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:53.122089 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88887f0c-a2cf-45a0-a89c-d7ed4cbb5379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:53.122666 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88887f0c-a2cf-45a0-a89c-d7ed4cbb5379 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:53.122956 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88887f0c-a2cf-45a0-a89c-d7ed4cbb5379 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:53.123236 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88887f0c-a2cf-45a0-a89c-d7ed4cbb5379 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:53.123979 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88887f0c-a2cf-45a0-a89c-d7ed4cbb5379 admin admin] RBAC: Adding query filter params (name=service) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:53.124278 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88887f0c-a2cf-45a0-a89c-d7ed4cbb5379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:53.149580 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88887f0c-a2cf-45a0-a89c-d7ed4cbb5379 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:53.157695 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 289/577] 10.222.0.89 () {56 vars in 1124 bytes} [Wed Oct 27 14:50:53 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:53.162782 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca57121-0f53-4e95-8be6-01d3f8b2a66a admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:53.174001 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca57121-0f53-4e95-8be6-01d3f8b2a66a admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:53.177818 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e073c-6d0f-438c-8b54-3bda71b60b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:53.178483 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e073c-6d0f-438c-8b54-3bda71b60b1f admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:53.178763 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e073c-6d0f-438c-8b54-3bda71b60b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:53.179034 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e073c-6d0f-438c-8b54-3bda71b60b1f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:53.190228 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e073c-6d0f-438c-8b54-3bda71b60b1f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:53.215726 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440e073c-6d0f-438c-8b54-3bda71b60b1f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:53.232485 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-440e073c-6d0f-438c-8b54-3bda71b60b1f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:50:53.233522 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 289/578] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:50:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:53.238963 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88887f0c-a2cf-45a0-a89c-d7ed4cbb5379 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:53.248683 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88887f0c-a2cf-45a0-a89c-d7ed4cbb5379 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:53.252823 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27046d-ebcd-4913-bda7-914279eebb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:53.253493 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27046d-ebcd-4913-bda7-914279eebb83 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:53.253846 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27046d-ebcd-4913-bda7-914279eebb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:53.254191 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27046d-ebcd-4913-bda7-914279eebb83 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:53.254946 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27046d-ebcd-4913-bda7-914279eebb83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:53.255315 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27046d-ebcd-4913-bda7-914279eebb83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:53.280907 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27046d-ebcd-4913-bda7-914279eebb83 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:53.293566 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 290/579] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:50:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:53.298747 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e073c-6d0f-438c-8b54-3bda71b60b1f admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:53.307953 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440e073c-6d0f-438c-8b54-3bda71b60b1f admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:53.312423 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb49caf-5984-4872-b9f2-f9e2b9c1f14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:53.313137 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb49caf-5984-4872-b9f2-f9e2b9c1f14f admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:53.313422 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb49caf-5984-4872-b9f2-f9e2b9c1f14f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:53.313723 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb49caf-5984-4872-b9f2-f9e2b9c1f14f admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:53.326598 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb49caf-5984-4872-b9f2-f9e2b9c1f14f admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:53.351713 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb49caf-5984-4872-b9f2-f9e2b9c1f14f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:53.369053 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-0cb49caf-5984-4872-b9f2-f9e2b9c1f14f admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 14:50:53.370082 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 290/580] 10.222.0.89 () {56 vars in 1138 bytes} [Wed Oct 27 14:50:53 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:53.375805 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27046d-ebcd-4913-bda7-914279eebb83 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:53.384947 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27046d-ebcd-4913-bda7-914279eebb83 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:53.389530 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970cdc73-827d-448c-b983-c7ff300a4989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:53.390113 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cdc73-827d-448c-b983-c7ff300a4989 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:53.390400 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cdc73-827d-448c-b983-c7ff300a4989 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:53.390680 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970cdc73-827d-448c-b983-c7ff300a4989 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:53.391494 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970cdc73-827d-448c-b983-c7ff300a4989 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:53.391799 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970cdc73-827d-448c-b983-c7ff300a4989 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:53.417265 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970cdc73-827d-448c-b983-c7ff300a4989 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:53.445548 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 291/581] 10.222.0.89 () {56 vars in 1170 bytes} [Wed Oct 27 14:50:53 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:53.451265 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb49caf-5984-4872-b9f2-f9e2b9c1f14f admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:53.460184 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb49caf-5984-4872-b9f2-f9e2b9c1f14f admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:53.464056 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e92e3c-5c61-4f35-9d91-cd22fae58a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:53.464611 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e92e3c-5c61-4f35-9d91-cd22fae58a2a admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:53.464896 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e92e3c-5c61-4f35-9d91-cd22fae58a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:53.465173 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e92e3c-5c61-4f35-9d91-cd22fae58a2a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:53.472554 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e92e3c-5c61-4f35-9d91-cd22fae58a2a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:53.498368 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e92e3c-5c61-4f35-9d91-cd22fae58a2a admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:53.506473 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 291/582] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:50:53 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:50:53.511399 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970cdc73-827d-448c-b983-c7ff300a4989 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:53.520350 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970cdc73-827d-448c-b983-c7ff300a4989 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:53.524310 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa8678-241b-4dbd-a980-7ad6db6c13e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:53.525007 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa8678-241b-4dbd-a980-7ad6db6c13e7 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:53.525293 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa8678-241b-4dbd-a980-7ad6db6c13e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:53.525568 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa8678-241b-4dbd-a980-7ad6db6c13e7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:53.536826 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa8678-241b-4dbd-a980-7ad6db6c13e7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:53.563058 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa8678-241b-4dbd-a980-7ad6db6c13e7 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:53.579529 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-1eaa8678-241b-4dbd-a980-7ad6db6c13e7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:50:53.580559 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 292/583] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:50:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 14:50:53.585688 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e92e3c-5c61-4f35-9d91-cd22fae58a2a admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:53.593919 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e92e3c-5c61-4f35-9d91-cd22fae58a2a admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:53.597868 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2dc724-1b0d-4053-bdfe-67f18faa062b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:53.598433 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2dc724-1b0d-4053-bdfe-67f18faa062b admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:53.598720 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2dc724-1b0d-4053-bdfe-67f18faa062b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:53.598997 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2dc724-1b0d-4053-bdfe-67f18faa062b admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:53.599692 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2dc724-1b0d-4053-bdfe-67f18faa062b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:53.599988 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2dc724-1b0d-4053-bdfe-67f18faa062b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:53.625722 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2dc724-1b0d-4053-bdfe-67f18faa062b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:53.638090 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 292/584] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:50:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:53.642955 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa8678-241b-4dbd-a980-7ad6db6c13e7 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:53.651832 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa8678-241b-4dbd-a980-7ad6db6c13e7 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:53.655735 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb317b3-2dfd-4e88-a388-bf01365ea0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:53.656428 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb317b3-2dfd-4e88-a388-bf01365ea0ca admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:53.656693 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb317b3-2dfd-4e88-a388-bf01365ea0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:53.656968 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb317b3-2dfd-4e88-a388-bf01365ea0ca admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:53.667217 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb317b3-2dfd-4e88-a388-bf01365ea0ca admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:53.692768 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb317b3-2dfd-4e88-a388-bf01365ea0ca admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:53.706506 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-ffb317b3-2dfd-4e88-a388-bf01365ea0ca admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:50:53.707538 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 293/585] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:50:53 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:53.712519 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2dc724-1b0d-4053-bdfe-67f18faa062b admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:53.721903 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2dc724-1b0d-4053-bdfe-67f18faa062b admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:53.725796 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ddfddd-6db8-4fe1-8b07-b62ba0509ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:53.726357 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddfddd-6db8-4fe1-8b07-b62ba0509ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:53.726645 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddfddd-6db8-4fe1-8b07-b62ba0509ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:53.726924 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddfddd-6db8-4fe1-8b07-b62ba0509ea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:53.727680 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ddfddd-6db8-4fe1-8b07-b62ba0509ea0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:53.727981 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ddfddd-6db8-4fe1-8b07-b62ba0509ea0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:53.752810 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ddfddd-6db8-4fe1-8b07-b62ba0509ea0 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:53.765747 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 293/586] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:50:53 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:50:53.770859 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb317b3-2dfd-4e88-a388-bf01365ea0ca admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:53.780331 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb317b3-2dfd-4e88-a388-bf01365ea0ca admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:53.784237 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ad01fe-8ac9-41f4-9f4c-06f859b7023f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:53.784895 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad01fe-8ac9-41f4-9f4c-06f859b7023f admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:53.785187 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad01fe-8ac9-41f4-9f4c-06f859b7023f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:53.785467 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ad01fe-8ac9-41f4-9f4c-06f859b7023f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:53.786229 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad01fe-8ac9-41f4-9f4c-06f859b7023f admin admin] RBAC: Adding query filter params (role.id=0af8b2c9076246e6ac61d13d88d91976, scope.project.id=f79f19c59cfd43c48871b51d6aaf501f, user.id=ed972e6b35be47a8af2e86651ccc6911) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:53.786533 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad01fe-8ac9-41f4-9f4c-06f859b7023f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:53.811730 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ad01fe-8ac9-41f4-9f4c-06f859b7023f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:53.816778 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 294/587] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:50:53 2021] GET /identity/v3/role_assignments?user.id=ed972e6b35be47a8af2e86651ccc6911&scope.project.id=f79f19c59cfd43c48871b51d6aaf501f&role.id=0af8b2c9076246e6ac61d13d88d91976 => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:50:55.739747 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc6eeb-10f3-43f6-b4bc-4e652845cf9d None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:55.740265 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc6eeb-10f3-43f6-b4bc-4e652845cf9d None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:55.740390 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebc6eeb-10f3-43f6-b4bc-4e652845cf9d None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:55.741931 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 294/588] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:50:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:50:55.747695 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cadbe-b79e-4c2e-91b3-98404ae4e4ce None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:55.748107 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cadbe-b79e-4c2e-91b3-98404ae4e4ce None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:55.748255 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3cadbe-b79e-4c2e-91b3-98404ae4e4ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:55.770175 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-7d3cadbe-b79e-4c2e-91b3-98404ae4e4ce None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:50:55.771318 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-7d3cadbe-b79e-4c2e-91b3-98404ae4e4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:50:55.777907 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 295/589] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:50:55 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:50:55.799339 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc6eeb-10f3-43f6-b4bc-4e652845cf9d None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:55.811082 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebc6eeb-10f3-43f6-b4bc-4e652845cf9d None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:55.814833 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cdf951-8c17-4299-91e9-78f397863ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:55.815570 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdf951-8c17-4299-91e9-78f397863ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:55.815854 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdf951-8c17-4299-91e9-78f397863ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:55.816128 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdf951-8c17-4299-91e9-78f397863ff2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:55.826843 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cdf951-8c17-4299-91e9-78f397863ff2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:50:55.833061 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-87cdf951-8c17-4299-91e9-78f397863ff2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 14:50:55.834094 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 295/590] 10.222.0.89 () {56 vars in 1123 bytes} [Wed Oct 27 14:50:55 2021] GET /identity/v3/roles/service => generated 85 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:55.839400 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3cadbe-b79e-4c2e-91b3-98404ae4e4ce None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:55.847900 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3cadbe-b79e-4c2e-91b3-98404ae4e4ce None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:55.851817 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f1639-caea-467f-a17c-1b3ef0211aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:55.852397 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f1639-caea-467f-a17c-1b3ef0211aee admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:55.852685 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f1639-caea-467f-a17c-1b3ef0211aee admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:55.852964 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930f1639-caea-467f-a17c-1b3ef0211aee admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:55.853672 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f1639-caea-467f-a17c-1b3ef0211aee admin admin] RBAC: Adding query filter params (name=service) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:55.853972 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f1639-caea-467f-a17c-1b3ef0211aee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:55.879853 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930f1639-caea-467f-a17c-1b3ef0211aee admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:55.887934 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 296/591] 10.222.0.89 () {56 vars in 1124 bytes} [Wed Oct 27 14:50:55 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:55.892926 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cdf951-8c17-4299-91e9-78f397863ff2 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:55.902283 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cdf951-8c17-4299-91e9-78f397863ff2 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:55.906212 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479a67b-033d-45a6-a277-8ce9b0dd53fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:55.906896 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479a67b-033d-45a6-a277-8ce9b0dd53fe admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:55.907182 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479a67b-033d-45a6-a277-8ce9b0dd53fe admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:55.907488 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479a67b-033d-45a6-a277-8ce9b0dd53fe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:55.919109 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2479a67b-033d-45a6-a277-8ce9b0dd53fe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:55.944599 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2479a67b-033d-45a6-a277-8ce9b0dd53fe admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:55.961321 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-2479a67b-033d-45a6-a277-8ce9b0dd53fe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:50:55.962342 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 296/592] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:50:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:55.967456 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f1639-caea-467f-a17c-1b3ef0211aee admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:55.976646 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930f1639-caea-467f-a17c-1b3ef0211aee admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:55.980605 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb9576-a993-4d66-ac56-a4d38aedefc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:55.981694 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb9576-a993-4d66-ac56-a4d38aedefc0 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:55.981983 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb9576-a993-4d66-ac56-a4d38aedefc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:55.982261 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb9576-a993-4d66-ac56-a4d38aedefc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:55.982938 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb9576-a993-4d66-ac56-a4d38aedefc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:55.983265 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb9576-a993-4d66-ac56-a4d38aedefc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:56.009388 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fb9576-a993-4d66-ac56-a4d38aedefc0 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:56.021876 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 297/593] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:50:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:56.027048 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479a67b-033d-45a6-a277-8ce9b0dd53fe admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:56.036109 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479a67b-033d-45a6-a277-8ce9b0dd53fe admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:56.040274 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437c13d-85f4-46a0-a49d-79308179f9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:56.040983 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437c13d-85f4-46a0-a49d-79308179f9ed admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:56.041269 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437c13d-85f4-46a0-a49d-79308179f9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:56.041548 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437c13d-85f4-46a0-a49d-79308179f9ed admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:56.054294 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437c13d-85f4-46a0-a49d-79308179f9ed admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:56.079999 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437c13d-85f4-46a0-a49d-79308179f9ed admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:56.097774 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-9437c13d-85f4-46a0-a49d-79308179f9ed admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 14:50:56.098790 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 297/594] 10.222.0.89 () {56 vars in 1138 bytes} [Wed Oct 27 14:50:56 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:56.103924 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb9576-a993-4d66-ac56-a4d38aedefc0 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:56.113642 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb9576-a993-4d66-ac56-a4d38aedefc0 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:56.117520 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7eb35-7ff5-4d0a-ad1f-28cba742d0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:56.118097 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7eb35-7ff5-4d0a-ad1f-28cba742d0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:56.118377 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7eb35-7ff5-4d0a-ad1f-28cba742d0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:56.118649 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7eb35-7ff5-4d0a-ad1f-28cba742d0e2 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:56.119456 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7eb35-7ff5-4d0a-ad1f-28cba742d0e2 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:56.119786 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7eb35-7ff5-4d0a-ad1f-28cba742d0e2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:56.144710 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7eb35-7ff5-4d0a-ad1f-28cba742d0e2 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:56.173715 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 298/595] 10.222.0.89 () {56 vars in 1170 bytes} [Wed Oct 27 14:50:56 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:56.178750 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437c13d-85f4-46a0-a49d-79308179f9ed admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:56.187675 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437c13d-85f4-46a0-a49d-79308179f9ed admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:56.191564 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aacc4e-d4c4-426a-b8be-8bf2c0f43ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:56.192250 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aacc4e-d4c4-426a-b8be-8bf2c0f43ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:56.192533 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aacc4e-d4c4-426a-b8be-8bf2c0f43ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:56.192806 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aacc4e-d4c4-426a-b8be-8bf2c0f43ba1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:56.204644 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aacc4e-d4c4-426a-b8be-8bf2c0f43ba1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:56.229979 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aacc4e-d4c4-426a-b8be-8bf2c0f43ba1 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:56.246823 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-f5aacc4e-d4c4-426a-b8be-8bf2c0f43ba1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:50:56.247912 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 298/596] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:50:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:56.253094 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7eb35-7ff5-4d0a-ad1f-28cba742d0e2 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:56.262248 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7eb35-7ff5-4d0a-ad1f-28cba742d0e2 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:56.266145 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0674dc-8621-484f-b6ff-5cf40fffc17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:56.266722 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0674dc-8621-484f-b6ff-5cf40fffc17e admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:56.267009 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0674dc-8621-484f-b6ff-5cf40fffc17e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:56.267288 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0674dc-8621-484f-b6ff-5cf40fffc17e admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:56.268010 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0674dc-8621-484f-b6ff-5cf40fffc17e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:56.268305 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0674dc-8621-484f-b6ff-5cf40fffc17e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:56.294330 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0674dc-8621-484f-b6ff-5cf40fffc17e admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:56.305843 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 299/597] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:50:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:56.310973 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aacc4e-d4c4-426a-b8be-8bf2c0f43ba1 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:56.320035 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aacc4e-d4c4-426a-b8be-8bf2c0f43ba1 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:56.323967 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f136b2-57c1-4d85-95ae-3fe18d7c9c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:56.324659 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f136b2-57c1-4d85-95ae-3fe18d7c9c43 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:56.324945 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f136b2-57c1-4d85-95ae-3fe18d7c9c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:56.325222 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f136b2-57c1-4d85-95ae-3fe18d7c9c43 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:56.333927 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f136b2-57c1-4d85-95ae-3fe18d7c9c43 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:56.360009 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f136b2-57c1-4d85-95ae-3fe18d7c9c43 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:56.373617 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-61f136b2-57c1-4d85-95ae-3fe18d7c9c43 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:50:56.374651 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 299/598] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:50:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:56.379736 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0674dc-8621-484f-b6ff-5cf40fffc17e admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:56.389289 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0674dc-8621-484f-b6ff-5cf40fffc17e admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:56.393318 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b245d-b899-450e-ba49-ee5a4246d39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:56.393890 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b245d-b899-450e-ba49-ee5a4246d39c admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:56.394180 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b245d-b899-450e-ba49-ee5a4246d39c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:56.394465 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b245d-b899-450e-ba49-ee5a4246d39c admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:56.395212 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b245d-b899-450e-ba49-ee5a4246d39c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:56.395549 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b245d-b899-450e-ba49-ee5a4246d39c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:56.421118 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b245d-b899-450e-ba49-ee5a4246d39c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:56.433728 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 300/599] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:50:56 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:56.439480 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f136b2-57c1-4d85-95ae-3fe18d7c9c43 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:56.448722 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f136b2-57c1-4d85-95ae-3fe18d7c9c43 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:56.453132 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f29b8-6b02-4ca2-82d5-1ac4e7cc6530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:56.453937 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f29b8-6b02-4ca2-82d5-1ac4e7cc6530 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:56.454216 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f29b8-6b02-4ca2-82d5-1ac4e7cc6530 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:56.454489 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f29b8-6b02-4ca2-82d5-1ac4e7cc6530 admin admin] PATH_INFO: `/v3/projects/f79f19c59cfd43c48871b51d6aaf501f/users/ed972e6b35be47a8af2e86651ccc6911/roles/0af8b2c9076246e6ac61d13d88d91976` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:56.473350 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f29b8-6b02-4ca2-82d5-1ac4e7cc6530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79f19c59cfd43c48871b51d6aaf501f, user_id=ed972e6b35be47a8af2e86651ccc6911, role_id=0af8b2c9076246e6ac61d13d88d91976)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:56.500380 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f29b8-6b02-4ca2-82d5-1ac4e7cc6530 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:56.512036 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 300/600] 10.222.0.89 () {58 vars in 1460 bytes} [Wed Oct 27 14:50:56 2021] PUT /identity/v3/projects/f79f19c59cfd43c48871b51d6aaf501f/users/ed972e6b35be47a8af2e86651ccc6911/roles/0af8b2c9076246e6ac61d13d88d91976 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:50:58.444531 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ad8cd-5f6c-4546-8ee4-d934d5d09434 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:58.445034 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ad8cd-5f6c-4546-8ee4-d934d5d09434 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:58.445135 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ad8cd-5f6c-4546-8ee4-d934d5d09434 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:58.446761 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 301/601] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:50:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:50:58.452360 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d422ba-91a4-43df-af27-505ce48e909d None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:58.452793 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d422ba-91a4-43df-af27-505ce48e909d None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:58.452925 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d422ba-91a4-43df-af27-505ce48e909d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:58.474414 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-c2d422ba-91a4-43df-af27-505ce48e909d None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:50:58.475542 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-c2d422ba-91a4-43df-af27-505ce48e909d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:50:58.537765 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 301/602] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:50:58 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:50:58.560644 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ad8cd-5f6c-4546-8ee4-d934d5d09434 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:58.571960 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ad8cd-5f6c-4546-8ee4-d934d5d09434 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:58.576495 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc32a6e-08ab-4a4c-a127-fe5d282ab509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:58.577202 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc32a6e-08ab-4a4c-a127-fe5d282ab509 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:58.577489 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc32a6e-08ab-4a4c-a127-fe5d282ab509 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:58.577769 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc32a6e-08ab-4a4c-a127-fe5d282ab509 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:58.588655 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc32a6e-08ab-4a4c-a127-fe5d282ab509 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:50:58.595027 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-9bc32a6e-08ab-4a4c-a127-fe5d282ab509 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 14:50:58.596116 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 302/603] 10.222.0.89 () {56 vars in 1123 bytes} [Wed Oct 27 14:50:58 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:58.601438 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d422ba-91a4-43df-af27-505ce48e909d None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:58.609697 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d422ba-91a4-43df-af27-505ce48e909d None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:58.613618 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dfed54-d58d-4703-b9d7-177237326c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:58.614201 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfed54-d58d-4703-b9d7-177237326c58 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:58.614486 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfed54-d58d-4703-b9d7-177237326c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:58.614765 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dfed54-d58d-4703-b9d7-177237326c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:58.615485 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dfed54-d58d-4703-b9d7-177237326c58 admin admin] RBAC: Adding query filter params (name=service) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:58.615786 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dfed54-d58d-4703-b9d7-177237326c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:58.641565 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dfed54-d58d-4703-b9d7-177237326c58 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:58.649604 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 302/604] 10.222.0.89 () {56 vars in 1124 bytes} [Wed Oct 27 14:50:58 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:58.654727 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc32a6e-08ab-4a4c-a127-fe5d282ab509 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:58.664426 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc32a6e-08ab-4a4c-a127-fe5d282ab509 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:58.668407 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508e232-53b8-4675-b575-7cb69fd9615b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:58.669135 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508e232-53b8-4675-b575-7cb69fd9615b admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:58.669421 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508e232-53b8-4675-b575-7cb69fd9615b admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:58.669699 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508e232-53b8-4675-b575-7cb69fd9615b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:58.680568 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508e232-53b8-4675-b575-7cb69fd9615b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:58.706521 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508e232-53b8-4675-b575-7cb69fd9615b admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:58.723508 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-b508e232-53b8-4675-b575-7cb69fd9615b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:50:58.724537 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 303/605] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:50:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:58.729592 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dfed54-d58d-4703-b9d7-177237326c58 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:58.738939 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dfed54-d58d-4703-b9d7-177237326c58 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:58.742806 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aaaa5f-f312-436f-b494-c33023bc393c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:58.743373 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aaaa5f-f312-436f-b494-c33023bc393c admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:58.743690 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aaaa5f-f312-436f-b494-c33023bc393c admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:58.743971 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aaaa5f-f312-436f-b494-c33023bc393c admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:58.744645 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aaaa5f-f312-436f-b494-c33023bc393c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:58.744942 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aaaa5f-f312-436f-b494-c33023bc393c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:58.770334 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aaaa5f-f312-436f-b494-c33023bc393c admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:58.783126 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 303/606] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:50:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:58.788557 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508e232-53b8-4675-b575-7cb69fd9615b admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:58.797950 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508e232-53b8-4675-b575-7cb69fd9615b admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:58.801897 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db9165-673f-4efe-9748-ad1280452929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:58.802601 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db9165-673f-4efe-9748-ad1280452929 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:58.802890 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db9165-673f-4efe-9748-ad1280452929 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:58.803168 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db9165-673f-4efe-9748-ad1280452929 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:58.816149 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db9165-673f-4efe-9748-ad1280452929 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:58.841306 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db9165-673f-4efe-9748-ad1280452929 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:58.860564 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-93db9165-673f-4efe-9748-ad1280452929 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 14:50:58.861684 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 304/607] 10.222.0.89 () {56 vars in 1138 bytes} [Wed Oct 27 14:50:58 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:58.866789 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aaaa5f-f312-436f-b494-c33023bc393c admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:58.876329 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aaaa5f-f312-436f-b494-c33023bc393c admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:58.880286 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64809a-feed-49bc-8867-4b5989a495ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:58.880863 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64809a-feed-49bc-8867-4b5989a495ef admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:58.881152 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64809a-feed-49bc-8867-4b5989a495ef admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:58.881430 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64809a-feed-49bc-8867-4b5989a495ef admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:58.882209 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64809a-feed-49bc-8867-4b5989a495ef admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:58.882508 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64809a-feed-49bc-8867-4b5989a495ef admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:58.907633 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64809a-feed-49bc-8867-4b5989a495ef admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:58.936557 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 304/608] 10.222.0.89 () {56 vars in 1170 bytes} [Wed Oct 27 14:50:58 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:58.941804 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db9165-673f-4efe-9748-ad1280452929 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:58.950943 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db9165-673f-4efe-9748-ad1280452929 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:58.955100 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a809b-f69f-438b-a3ae-e372edce3918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:58.955748 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a809b-f69f-438b-a3ae-e372edce3918 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:58.956088 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a809b-f69f-438b-a3ae-e372edce3918 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:58.956370 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557a809b-f69f-438b-a3ae-e372edce3918 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:58.964180 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a809b-f69f-438b-a3ae-e372edce3918 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:58.989666 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557a809b-f69f-438b-a3ae-e372edce3918 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:58.998715 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 305/609] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:50:58 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:50:59.004048 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64809a-feed-49bc-8867-4b5989a495ef admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:59.013108 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64809a-feed-49bc-8867-4b5989a495ef admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:59.017107 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e0d9b-6a8e-48a1-a65e-963a72d448fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:59.017817 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e0d9b-6a8e-48a1-a65e-963a72d448fd admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:59.018105 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e0d9b-6a8e-48a1-a65e-963a72d448fd admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:59.018386 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e0d9b-6a8e-48a1-a65e-963a72d448fd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:59.029732 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e0d9b-6a8e-48a1-a65e-963a72d448fd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:59.055584 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e0d9b-6a8e-48a1-a65e-963a72d448fd admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:59.072264 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-377e0d9b-6a8e-48a1-a65e-963a72d448fd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:50:59.073300 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 305/610] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:50:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:50:59.078411 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a809b-f69f-438b-a3ae-e372edce3918 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:59.086704 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557a809b-f69f-438b-a3ae-e372edce3918 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:59.091175 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb91117-7e5c-4073-af81-4b322370c4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:59.091784 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb91117-7e5c-4073-af81-4b322370c4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:59.092069 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb91117-7e5c-4073-af81-4b322370c4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:59.092349 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb91117-7e5c-4073-af81-4b322370c4f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:59.093022 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb91117-7e5c-4073-af81-4b322370c4f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:59.093316 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb91117-7e5c-4073-af81-4b322370c4f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:59.118550 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb91117-7e5c-4073-af81-4b322370c4f6 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:59.130946 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 306/611] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:50:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:59.135830 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e0d9b-6a8e-48a1-a65e-963a72d448fd admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:59.144803 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e0d9b-6a8e-48a1-a65e-963a72d448fd admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:59.148831 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b135da4-9d3a-4293-907f-277dda922272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:59.149650 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b135da4-9d3a-4293-907f-277dda922272 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:59.149869 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b135da4-9d3a-4293-907f-277dda922272 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:59.150213 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b135da4-9d3a-4293-907f-277dda922272 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:59.159817 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b135da4-9d3a-4293-907f-277dda922272 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:59.185548 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b135da4-9d3a-4293-907f-277dda922272 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:59.199726 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-3b135da4-9d3a-4293-907f-277dda922272 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:50:59.200864 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 306/612] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:50:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 14:50:59.206302 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb91117-7e5c-4073-af81-4b322370c4f6 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:59.215892 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb91117-7e5c-4073-af81-4b322370c4f6 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:59.219848 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa1b9d-cc8b-4817-8058-272684824705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:59.220422 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa1b9d-cc8b-4817-8058-272684824705 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:59.220706 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa1b9d-cc8b-4817-8058-272684824705 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:59.220983 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa1b9d-cc8b-4817-8058-272684824705 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:59.221720 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa1b9d-cc8b-4817-8058-272684824705 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:59.222019 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa1b9d-cc8b-4817-8058-272684824705 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:59.247707 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa1b9d-cc8b-4817-8058-272684824705 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:59.260472 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 307/613] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:50:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:50:59.266164 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b135da4-9d3a-4293-907f-277dda922272 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:50:59.275311 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b135da4-9d3a-4293-907f-277dda922272 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:50:59.279786 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c6c8d-4858-4ff4-8820-25c2cdb0ee2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:50:59.280353 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c6c8d-4858-4ff4-8820-25c2cdb0ee2d admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:50:59.280639 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c6c8d-4858-4ff4-8820-25c2cdb0ee2d admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:50:59.280915 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c6c8d-4858-4ff4-8820-25c2cdb0ee2d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:50:59.281692 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c6c8d-4858-4ff4-8820-25c2cdb0ee2d admin admin] RBAC: Adding query filter params (role.id=0af8b2c9076246e6ac61d13d88d91976, scope.project.id=f79f19c59cfd43c48871b51d6aaf501f, user.id=ed972e6b35be47a8af2e86651ccc6911) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:50:59.281996 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c6c8d-4858-4ff4-8820-25c2cdb0ee2d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:50:59.307860 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c6c8d-4858-4ff4-8820-25c2cdb0ee2d admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:50:59.313346 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 307/614] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:50:59 2021] GET /identity/v3/role_assignments?user.id=ed972e6b35be47a8af2e86651ccc6911&scope.project.id=f79f19c59cfd43c48871b51d6aaf501f&role.id=0af8b2c9076246e6ac61d13d88d91976 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:01.276965 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dce2c-6357-4771-944a-9bb685672909 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:01.277364 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dce2c-6357-4771-944a-9bb685672909 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:01.277536 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dce2c-6357-4771-944a-9bb685672909 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:01.279214 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 308/615] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:51:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:51:01.284121 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977b529-e0f7-4af0-9fce-c2a06356db48 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:01.284502 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977b529-e0f7-4af0-9fce-c2a06356db48 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:01.284685 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977b529-e0f7-4af0-9fce-c2a06356db48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:01.307353 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-f977b529-e0f7-4af0-9fce-c2a06356db48 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:51:01.308525 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-f977b529-e0f7-4af0-9fce-c2a06356db48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:51:01.315643 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 308/616] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:51:01 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:51:01.337514 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115dce2c-6357-4771-944a-9bb685672909 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:01.349421 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115dce2c-6357-4771-944a-9bb685672909 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:01.353247 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ab6a3-7eb4-45b2-a3b0-dabd8262af2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:01.353967 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ab6a3-7eb4-45b2-a3b0-dabd8262af2b admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:01.354253 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ab6a3-7eb4-45b2-a3b0-dabd8262af2b admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:01.354535 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8ab6a3-7eb4-45b2-a3b0-dabd8262af2b admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:01.366116 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8ab6a3-7eb4-45b2-a3b0-dabd8262af2b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:51:01.372839 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-fd8ab6a3-7eb4-45b2-a3b0-dabd8262af2b admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 14:51:01.373891 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 309/617] 10.222.0.89 () {56 vars in 1141 bytes} [Wed Oct 27 14:51:01 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:01.379129 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977b529-e0f7-4af0-9fce-c2a06356db48 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:01.387479 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977b529-e0f7-4af0-9fce-c2a06356db48 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:01.391383 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff63f7-f28a-40fd-a924-9572941673c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:01.391992 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff63f7-f28a-40fd-a924-9572941673c8 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:01.392280 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff63f7-f28a-40fd-a924-9572941673c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:01.392559 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff63f7-f28a-40fd-a924-9572941673c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:01.393260 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff63f7-f28a-40fd-a924-9572941673c8 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:01.393560 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff63f7-f28a-40fd-a924-9572941673c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:01.419866 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff63f7-f28a-40fd-a924-9572941673c8 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:01.428168 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 309/618] 10.222.0.89 () {56 vars in 1136 bytes} [Wed Oct 27 14:51:01 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:01.433405 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ab6a3-7eb4-45b2-a3b0-dabd8262af2b admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:01.442800 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8ab6a3-7eb4-45b2-a3b0-dabd8262af2b admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:01.446711 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28609ef-de74-4717-9345-375237494642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:01.447396 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28609ef-de74-4717-9345-375237494642 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:01.447711 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28609ef-de74-4717-9345-375237494642 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:01.447989 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28609ef-de74-4717-9345-375237494642 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:01.458811 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28609ef-de74-4717-9345-375237494642 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:01.484918 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28609ef-de74-4717-9345-375237494642 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:01.502813 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-d28609ef-de74-4717-9345-375237494642 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:51:01.503860 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 310/619] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:51:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:01.509054 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff63f7-f28a-40fd-a924-9572941673c8 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:01.517955 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff63f7-f28a-40fd-a924-9572941673c8 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:01.521880 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747e9e7-8827-4f92-a8c3-cb8f265ab55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:01.522447 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747e9e7-8827-4f92-a8c3-cb8f265ab55a admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:01.522736 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747e9e7-8827-4f92-a8c3-cb8f265ab55a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:01.523016 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3747e9e7-8827-4f92-a8c3-cb8f265ab55a admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:01.523722 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747e9e7-8827-4f92-a8c3-cb8f265ab55a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:01.524021 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747e9e7-8827-4f92-a8c3-cb8f265ab55a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:01.550019 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3747e9e7-8827-4f92-a8c3-cb8f265ab55a admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:01.562537 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 310/620] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:51:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:01.567624 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28609ef-de74-4717-9345-375237494642 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:01.576499 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28609ef-de74-4717-9345-375237494642 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:01.580415 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dca34f-1f75-42ba-bc92-7eb6847b65bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:01.581109 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dca34f-1f75-42ba-bc92-7eb6847b65bf admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:01.581388 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dca34f-1f75-42ba-bc92-7eb6847b65bf admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:01.581660 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dca34f-1f75-42ba-bc92-7eb6847b65bf admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:01.594305 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dca34f-1f75-42ba-bc92-7eb6847b65bf admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:01.619808 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dca34f-1f75-42ba-bc92-7eb6847b65bf admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:01.637012 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-21dca34f-1f75-42ba-bc92-7eb6847b65bf admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 14:51:01.638019 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 311/621] 10.222.0.89 () {56 vars in 1138 bytes} [Wed Oct 27 14:51:01 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 14:51:01.643117 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747e9e7-8827-4f92-a8c3-cb8f265ab55a admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:01.652102 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3747e9e7-8827-4f92-a8c3-cb8f265ab55a admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:01.656544 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2314923-8a9e-4735-8344-230f81643ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:01.657125 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2314923-8a9e-4735-8344-230f81643ead admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:01.657414 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2314923-8a9e-4735-8344-230f81643ead admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:01.657694 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2314923-8a9e-4735-8344-230f81643ead admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:01.658478 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2314923-8a9e-4735-8344-230f81643ead admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:01.658778 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2314923-8a9e-4735-8344-230f81643ead admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:01.684675 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2314923-8a9e-4735-8344-230f81643ead admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:01.712591 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 311/622] 10.222.0.89 () {56 vars in 1170 bytes} [Wed Oct 27 14:51:01 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:01.718266 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dca34f-1f75-42ba-bc92-7eb6847b65bf admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:01.727152 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dca34f-1f75-42ba-bc92-7eb6847b65bf admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:01.731610 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f82636-8166-4b52-a18a-86469041693b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:01.732162 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f82636-8166-4b52-a18a-86469041693b admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:01.732439 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f82636-8166-4b52-a18a-86469041693b admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:01.732708 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f82636-8166-4b52-a18a-86469041693b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:01.740171 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f82636-8166-4b52-a18a-86469041693b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:01.765466 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f82636-8166-4b52-a18a-86469041693b admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:01.773780 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 312/623] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:51:01 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:51:01.779219 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2314923-8a9e-4735-8344-230f81643ead admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:01.788042 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2314923-8a9e-4735-8344-230f81643ead admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:01.792278 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eeab1d-39de-4391-b386-f8e1dd8d0b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:01.793024 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eeab1d-39de-4391-b386-f8e1dd8d0b68 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:01.793295 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eeab1d-39de-4391-b386-f8e1dd8d0b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:01.793577 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eeab1d-39de-4391-b386-f8e1dd8d0b68 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:01.804788 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eeab1d-39de-4391-b386-f8e1dd8d0b68 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:01.830219 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eeab1d-39de-4391-b386-f8e1dd8d0b68 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:01.847010 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-46eeab1d-39de-4391-b386-f8e1dd8d0b68 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:51:01.848060 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 312/624] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:51:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:01.852928 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f82636-8166-4b52-a18a-86469041693b admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:01.861184 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f82636-8166-4b52-a18a-86469041693b admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:01.865226 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b9e0d-79bb-487d-aa3d-5b0f296557ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:01.865790 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b9e0d-79bb-487d-aa3d-5b0f296557ef admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:01.866074 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b9e0d-79bb-487d-aa3d-5b0f296557ef admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:01.866348 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b9e0d-79bb-487d-aa3d-5b0f296557ef admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:01.867013 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b9e0d-79bb-487d-aa3d-5b0f296557ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:01.867305 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b9e0d-79bb-487d-aa3d-5b0f296557ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:01.892428 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56b9e0d-79bb-487d-aa3d-5b0f296557ef admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:01.905444 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 313/625] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:51:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:01.910351 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eeab1d-39de-4391-b386-f8e1dd8d0b68 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:01.919537 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eeab1d-39de-4391-b386-f8e1dd8d0b68 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:01.923506 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e476c-155e-462b-b16a-fddc7bd2dbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:01.924184 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e476c-155e-462b-b16a-fddc7bd2dbf7 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:01.924470 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e476c-155e-462b-b16a-fddc7bd2dbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:01.924746 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e476c-155e-462b-b16a-fddc7bd2dbf7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:01.934800 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e476c-155e-462b-b16a-fddc7bd2dbf7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:01.960220 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e476c-155e-462b-b16a-fddc7bd2dbf7 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:01.973881 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-e90e476c-155e-462b-b16a-fddc7bd2dbf7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:51:01.974899 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 313/626] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:51:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:01.979997 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b9e0d-79bb-487d-aa3d-5b0f296557ef admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:01.988910 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b9e0d-79bb-487d-aa3d-5b0f296557ef admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:01.992858 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a75390-5a16-4c43-b39b-1caef0c7ca16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:01.993420 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a75390-5a16-4c43-b39b-1caef0c7ca16 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:01.993705 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a75390-5a16-4c43-b39b-1caef0c7ca16 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:01.993980 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a75390-5a16-4c43-b39b-1caef0c7ca16 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:01.994709 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a75390-5a16-4c43-b39b-1caef0c7ca16 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:01.995003 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a75390-5a16-4c43-b39b-1caef0c7ca16 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:02.020556 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a75390-5a16-4c43-b39b-1caef0c7ca16 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:02.033656 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 314/627] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:51:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:02.039205 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e476c-155e-462b-b16a-fddc7bd2dbf7 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:02.048061 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e476c-155e-462b-b16a-fddc7bd2dbf7 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:02.052022 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3dd237-d921-4cb9-b50f-52d2d6e0f9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:02.052578 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dd237-d921-4cb9-b50f-52d2d6e0f9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:02.052865 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dd237-d921-4cb9-b50f-52d2d6e0f9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:02.053145 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dd237-d921-4cb9-b50f-52d2d6e0f9f9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:02.053916 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3dd237-d921-4cb9-b50f-52d2d6e0f9f9 admin admin] RBAC: Adding query filter params (role.id=11f4d60c63ce44fbb0b73623a47d4ea5, scope.project.id=f79f19c59cfd43c48871b51d6aaf501f, user.id=ed972e6b35be47a8af2e86651ccc6911) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:02.054217 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3dd237-d921-4cb9-b50f-52d2d6e0f9f9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:02.079606 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3dd237-d921-4cb9-b50f-52d2d6e0f9f9 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:02.084691 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 314/628] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:51:02 2021] GET /identity/v3/role_assignments?user.id=ed972e6b35be47a8af2e86651ccc6911&scope.project.id=f79f19c59cfd43c48871b51d6aaf501f&role.id=11f4d60c63ce44fbb0b73623a47d4ea5 => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:04.005440 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95679b2-05c8-482c-9500-676c2da1f53e None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:04.006022 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95679b2-05c8-482c-9500-676c2da1f53e None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:04.006022 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95679b2-05c8-482c-9500-676c2da1f53e None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:04.007722 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 315/629] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:51:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:51:04.012958 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82348cc7-845d-4ec4-8307-047912cea7a2 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:04.013359 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82348cc7-845d-4ec4-8307-047912cea7a2 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:04.013509 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82348cc7-845d-4ec4-8307-047912cea7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:04.036698 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-82348cc7-845d-4ec4-8307-047912cea7a2 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:51:04.037819 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-82348cc7-845d-4ec4-8307-047912cea7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:51:04.045040 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 315/630] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:51:04 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:51:04.066561 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95679b2-05c8-482c-9500-676c2da1f53e None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:04.077915 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95679b2-05c8-482c-9500-676c2da1f53e None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:04.081774 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318a38d-4398-4947-ba66-f82d6ef1a2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:04.082493 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318a38d-4398-4947-ba66-f82d6ef1a2ef admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:04.082781 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318a38d-4398-4947-ba66-f82d6ef1a2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:04.083064 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318a38d-4398-4947-ba66-f82d6ef1a2ef admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:04.093933 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318a38d-4398-4947-ba66-f82d6ef1a2ef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:51:04.100633 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-3318a38d-4398-4947-ba66-f82d6ef1a2ef admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 14:51:04.101687 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 316/631] 10.222.0.89 () {56 vars in 1141 bytes} [Wed Oct 27 14:51:04 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:04.107411 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82348cc7-845d-4ec4-8307-047912cea7a2 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:04.115581 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82348cc7-845d-4ec4-8307-047912cea7a2 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:04.119395 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574275b6-f8f5-4049-b02a-6bacf7067851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:04.119997 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574275b6-f8f5-4049-b02a-6bacf7067851 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:04.120302 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574275b6-f8f5-4049-b02a-6bacf7067851 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:04.120555 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574275b6-f8f5-4049-b02a-6bacf7067851 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:04.121898 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574275b6-f8f5-4049-b02a-6bacf7067851 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:04.122192 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574275b6-f8f5-4049-b02a-6bacf7067851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:04.146785 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574275b6-f8f5-4049-b02a-6bacf7067851 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:04.154793 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 316/632] 10.222.0.89 () {56 vars in 1136 bytes} [Wed Oct 27 14:51:04 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:04.159792 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318a38d-4398-4947-ba66-f82d6ef1a2ef admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:04.169918 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318a38d-4398-4947-ba66-f82d6ef1a2ef admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:04.173902 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c10f99-7cdf-4145-b4d4-6c2e8cfc17ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:04.174580 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c10f99-7cdf-4145-b4d4-6c2e8cfc17ae admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:04.174866 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c10f99-7cdf-4145-b4d4-6c2e8cfc17ae admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:04.175142 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c10f99-7cdf-4145-b4d4-6c2e8cfc17ae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:04.186614 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c10f99-7cdf-4145-b4d4-6c2e8cfc17ae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:04.211726 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c10f99-7cdf-4145-b4d4-6c2e8cfc17ae admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:04.229223 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-a6c10f99-7cdf-4145-b4d4-6c2e8cfc17ae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:51:04.230297 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 317/633] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:51:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:04.236369 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574275b6-f8f5-4049-b02a-6bacf7067851 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:04.245577 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574275b6-f8f5-4049-b02a-6bacf7067851 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:04.250093 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202f8ae-649b-42ab-8138-1b328b746cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:04.250686 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202f8ae-649b-42ab-8138-1b328b746cce admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:04.250975 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202f8ae-649b-42ab-8138-1b328b746cce admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:04.251255 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0202f8ae-649b-42ab-8138-1b328b746cce admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:04.251979 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202f8ae-649b-42ab-8138-1b328b746cce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:04.252275 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202f8ae-649b-42ab-8138-1b328b746cce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:04.276939 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0202f8ae-649b-42ab-8138-1b328b746cce admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:04.289875 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 317/634] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:51:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:04.295864 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c10f99-7cdf-4145-b4d4-6c2e8cfc17ae admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:04.305022 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c10f99-7cdf-4145-b4d4-6c2e8cfc17ae admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:04.309628 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746141c4-8b5a-49ba-a530-d1ff72cf6824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:04.310392 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746141c4-8b5a-49ba-a530-d1ff72cf6824 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:04.310682 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746141c4-8b5a-49ba-a530-d1ff72cf6824 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:04.310961 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746141c4-8b5a-49ba-a530-d1ff72cf6824 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:04.323400 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746141c4-8b5a-49ba-a530-d1ff72cf6824 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:04.349120 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746141c4-8b5a-49ba-a530-d1ff72cf6824 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:04.367170 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-746141c4-8b5a-49ba-a530-d1ff72cf6824 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 14:51:04.368222 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 318/635] 10.222.0.89 () {56 vars in 1138 bytes} [Wed Oct 27 14:51:04 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:04.373545 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202f8ae-649b-42ab-8138-1b328b746cce admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:04.382585 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0202f8ae-649b-42ab-8138-1b328b746cce admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:04.386541 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e8d1c-d2f5-45f0-b1f9-761fbe51dbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:04.387124 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e8d1c-d2f5-45f0-b1f9-761fbe51dbee admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:04.387411 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e8d1c-d2f5-45f0-b1f9-761fbe51dbee admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:04.387718 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e8d1c-d2f5-45f0-b1f9-761fbe51dbee admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:04.388501 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e8d1c-d2f5-45f0-b1f9-761fbe51dbee admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:04.388801 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e8d1c-d2f5-45f0-b1f9-761fbe51dbee admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:04.414695 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e8d1c-d2f5-45f0-b1f9-761fbe51dbee admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:04.442973 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 318/636] 10.222.0.89 () {56 vars in 1170 bytes} [Wed Oct 27 14:51:04 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:04.448288 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746141c4-8b5a-49ba-a530-d1ff72cf6824 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:04.457357 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746141c4-8b5a-49ba-a530-d1ff72cf6824 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:04.461264 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc292aaa-c04b-4a97-ac30-16d53f73a8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:04.461957 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc292aaa-c04b-4a97-ac30-16d53f73a8aa admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:04.462242 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc292aaa-c04b-4a97-ac30-16d53f73a8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:04.462519 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc292aaa-c04b-4a97-ac30-16d53f73a8aa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:04.474813 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc292aaa-c04b-4a97-ac30-16d53f73a8aa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:04.500382 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc292aaa-c04b-4a97-ac30-16d53f73a8aa admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:04.516506 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-cc292aaa-c04b-4a97-ac30-16d53f73a8aa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:51:04.517474 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 319/637] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:51:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:04.522544 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e8d1c-d2f5-45f0-b1f9-761fbe51dbee admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:04.532022 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e8d1c-d2f5-45f0-b1f9-761fbe51dbee admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:04.535969 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b826694-44d0-4149-a736-f1fe4e9a1f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:04.536544 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b826694-44d0-4149-a736-f1fe4e9a1f34 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:04.536831 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b826694-44d0-4149-a736-f1fe4e9a1f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:04.537108 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b826694-44d0-4149-a736-f1fe4e9a1f34 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:04.537784 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b826694-44d0-4149-a736-f1fe4e9a1f34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:04.538083 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b826694-44d0-4149-a736-f1fe4e9a1f34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:04.563615 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b826694-44d0-4149-a736-f1fe4e9a1f34 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:04.575191 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 319/638] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:51:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:04.580627 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc292aaa-c04b-4a97-ac30-16d53f73a8aa admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:04.589507 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc292aaa-c04b-4a97-ac30-16d53f73a8aa admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:04.593833 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186775b6-ec6d-41f9-9599-e7ebb20beb73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:04.594517 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186775b6-ec6d-41f9-9599-e7ebb20beb73 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:04.594817 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186775b6-ec6d-41f9-9599-e7ebb20beb73 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:04.595092 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186775b6-ec6d-41f9-9599-e7ebb20beb73 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:04.603621 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186775b6-ec6d-41f9-9599-e7ebb20beb73 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:04.628998 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186775b6-ec6d-41f9-9599-e7ebb20beb73 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:04.641836 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-186775b6-ec6d-41f9-9599-e7ebb20beb73 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:51:04.642844 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 320/639] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:51:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:04.648053 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b826694-44d0-4149-a736-f1fe4e9a1f34 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:04.657459 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b826694-44d0-4149-a736-f1fe4e9a1f34 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:04.661396 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa405d-8ab3-4fe8-8cb0-cdb369f25f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:04.661964 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa405d-8ab3-4fe8-8cb0-cdb369f25f59 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:04.662252 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa405d-8ab3-4fe8-8cb0-cdb369f25f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:04.662530 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa405d-8ab3-4fe8-8cb0-cdb369f25f59 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:04.663543 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa405d-8ab3-4fe8-8cb0-cdb369f25f59 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:04.663846 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa405d-8ab3-4fe8-8cb0-cdb369f25f59 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:04.689382 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa405d-8ab3-4fe8-8cb0-cdb369f25f59 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:04.702096 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 320/640] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:51:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:51:04.707308 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186775b6-ec6d-41f9-9599-e7ebb20beb73 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:04.716623 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186775b6-ec6d-41f9-9599-e7ebb20beb73 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:04.720431 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c6b0e-cec3-4bca-9b35-08983d1f249e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:04.721201 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c6b0e-cec3-4bca-9b35-08983d1f249e admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:04.721480 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c6b0e-cec3-4bca-9b35-08983d1f249e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:04.721752 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c6b0e-cec3-4bca-9b35-08983d1f249e admin admin] PATH_INFO: `/v3/projects/f79f19c59cfd43c48871b51d6aaf501f/users/ed972e6b35be47a8af2e86651ccc6911/roles/11f4d60c63ce44fbb0b73623a47d4ea5` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:04.723706 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c6b0e-cec3-4bca-9b35-08983d1f249e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79f19c59cfd43c48871b51d6aaf501f, user_id=ed972e6b35be47a8af2e86651ccc6911, role_id=11f4d60c63ce44fbb0b73623a47d4ea5)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:04.749574 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c6b0e-cec3-4bca-9b35-08983d1f249e admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:04.761090 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 321/641] 10.222.0.89 () {58 vars in 1460 bytes} [Wed Oct 27 14:51:04 2021] PUT /identity/v3/projects/f79f19c59cfd43c48871b51d6aaf501f/users/ed972e6b35be47a8af2e86651ccc6911/roles/11f4d60c63ce44fbb0b73623a47d4ea5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:51:06.685874 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62732115-0d2a-49d6-8f38-ee2dea076aa9 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:06.686392 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62732115-0d2a-49d6-8f38-ee2dea076aa9 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:06.686488 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62732115-0d2a-49d6-8f38-ee2dea076aa9 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:06.688134 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 321/642] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:51:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:51:06.693353 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a01a9-20b0-4914-b3f8-46c54c9e383d None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:06.693782 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a01a9-20b0-4914-b3f8-46c54c9e383d None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:06.693910 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496a01a9-20b0-4914-b3f8-46c54c9e383d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:06.716434 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-496a01a9-20b0-4914-b3f8-46c54c9e383d None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:51:06.717539 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-496a01a9-20b0-4914-b3f8-46c54c9e383d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:51:06.778197 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 322/643] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:51:06 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:51:06.800801 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62732115-0d2a-49d6-8f38-ee2dea076aa9 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:06.812454 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62732115-0d2a-49d6-8f38-ee2dea076aa9 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:06.816201 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac3913-791a-4318-b1f2-9e614837a97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:06.816910 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac3913-791a-4318-b1f2-9e614837a97c admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:06.817192 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac3913-791a-4318-b1f2-9e614837a97c admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:06.817466 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac3913-791a-4318-b1f2-9e614837a97c admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:06.828229 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac3913-791a-4318-b1f2-9e614837a97c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:51:06.834820 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-2cac3913-791a-4318-b1f2-9e614837a97c admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 14:51:06.835892 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 322/644] 10.222.0.89 () {56 vars in 1141 bytes} [Wed Oct 27 14:51:06 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:06.841588 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a01a9-20b0-4914-b3f8-46c54c9e383d None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:06.849956 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496a01a9-20b0-4914-b3f8-46c54c9e383d None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:06.853939 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06873067-e32a-432c-9932-df44a0426934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:06.854524 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06873067-e32a-432c-9932-df44a0426934 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:06.854812 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06873067-e32a-432c-9932-df44a0426934 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:06.855091 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06873067-e32a-432c-9932-df44a0426934 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:06.856447 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06873067-e32a-432c-9932-df44a0426934 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:06.856748 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06873067-e32a-432c-9932-df44a0426934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:06.881581 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06873067-e32a-432c-9932-df44a0426934 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:06.889720 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 323/645] 10.222.0.89 () {56 vars in 1136 bytes} [Wed Oct 27 14:51:06 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:06.894908 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac3913-791a-4318-b1f2-9e614837a97c admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:06.904817 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac3913-791a-4318-b1f2-9e614837a97c admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:06.908765 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a092d9-7e1d-419e-a8ac-e4e37549f1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:06.909455 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a092d9-7e1d-419e-a8ac-e4e37549f1ef admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:06.909740 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a092d9-7e1d-419e-a8ac-e4e37549f1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:06.910017 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a092d9-7e1d-419e-a8ac-e4e37549f1ef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:06.921808 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a092d9-7e1d-419e-a8ac-e4e37549f1ef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:06.946813 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a092d9-7e1d-419e-a8ac-e4e37549f1ef admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:06.963589 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-87a092d9-7e1d-419e-a8ac-e4e37549f1ef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:51:06.964641 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 323/646] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:51:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 14:51:06.971058 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06873067-e32a-432c-9932-df44a0426934 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:06.980224 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06873067-e32a-432c-9932-df44a0426934 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:06.984812 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3be5ad-127a-473d-9616-7460a14d33a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:06.985389 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3be5ad-127a-473d-9616-7460a14d33a4 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:06.985677 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3be5ad-127a-473d-9616-7460a14d33a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:06.985956 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3be5ad-127a-473d-9616-7460a14d33a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:06.986639 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3be5ad-127a-473d-9616-7460a14d33a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:06.986938 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3be5ad-127a-473d-9616-7460a14d33a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:07.012351 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3be5ad-127a-473d-9616-7460a14d33a4 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:07.025977 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 324/647] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:51:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:07.031784 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a092d9-7e1d-419e-a8ac-e4e37549f1ef admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:07.041093 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a092d9-7e1d-419e-a8ac-e4e37549f1ef admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:07.045122 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f244d-e6c6-441f-993e-1ff3e90ea5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:07.045834 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f244d-e6c6-441f-993e-1ff3e90ea5ca admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:07.046119 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f244d-e6c6-441f-993e-1ff3e90ea5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:07.046393 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f244d-e6c6-441f-993e-1ff3e90ea5ca admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:07.058644 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f244d-e6c6-441f-993e-1ff3e90ea5ca admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:07.084496 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f244d-e6c6-441f-993e-1ff3e90ea5ca admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:07.102443 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-5c1f244d-e6c6-441f-993e-1ff3e90ea5ca admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 14:51:07.103493 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 324/648] 10.222.0.89 () {56 vars in 1138 bytes} [Wed Oct 27 14:51:07 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:07.108677 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3be5ad-127a-473d-9616-7460a14d33a4 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:07.117679 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3be5ad-127a-473d-9616-7460a14d33a4 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:07.121664 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52257f95-3c90-44ef-9008-203f5a9a554c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:07.122245 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52257f95-3c90-44ef-9008-203f5a9a554c admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:07.122533 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52257f95-3c90-44ef-9008-203f5a9a554c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:07.122813 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52257f95-3c90-44ef-9008-203f5a9a554c admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:07.123626 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52257f95-3c90-44ef-9008-203f5a9a554c admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:07.123927 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52257f95-3c90-44ef-9008-203f5a9a554c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:07.149336 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52257f95-3c90-44ef-9008-203f5a9a554c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:07.177930 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 325/649] 10.222.0.89 () {56 vars in 1170 bytes} [Wed Oct 27 14:51:07 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:07.183039 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f244d-e6c6-441f-993e-1ff3e90ea5ca admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:07.192066 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f244d-e6c6-441f-993e-1ff3e90ea5ca admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:07.195979 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79d5c8-d903-41a7-8d5d-f94d82ed9d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:07.196538 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79d5c8-d903-41a7-8d5d-f94d82ed9d7b admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:07.196868 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79d5c8-d903-41a7-8d5d-f94d82ed9d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:07.197100 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79d5c8-d903-41a7-8d5d-f94d82ed9d7b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:07.205135 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79d5c8-d903-41a7-8d5d-f94d82ed9d7b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:07.229978 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79d5c8-d903-41a7-8d5d-f94d82ed9d7b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:07.238806 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 325/650] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:51:07 2021] GET /identity/v3/auth/tokens => generated 1616 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:51:07.244151 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52257f95-3c90-44ef-9008-203f5a9a554c admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:07.253725 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52257f95-3c90-44ef-9008-203f5a9a554c admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:07.257717 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d283c6-0d2f-4646-8e64-4b3fd497c505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:07.258849 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d283c6-0d2f-4646-8e64-4b3fd497c505 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:07.258849 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d283c6-0d2f-4646-8e64-4b3fd497c505 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:07.259006 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d283c6-0d2f-4646-8e64-4b3fd497c505 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:07.270286 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d283c6-0d2f-4646-8e64-4b3fd497c505 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:07.296177 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d283c6-0d2f-4646-8e64-4b3fd497c505 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:07.313065 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-f9d283c6-0d2f-4646-8e64-4b3fd497c505 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:51:07.314110 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 326/651] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:51:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:07.319406 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79d5c8-d903-41a7-8d5d-f94d82ed9d7b admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:07.327701 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79d5c8-d903-41a7-8d5d-f94d82ed9d7b admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:07.331667 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb160a8-7798-4541-b2b3-c6628bf4ec48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:07.332236 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb160a8-7798-4541-b2b3-c6628bf4ec48 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:07.332516 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb160a8-7798-4541-b2b3-c6628bf4ec48 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:07.332790 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb160a8-7798-4541-b2b3-c6628bf4ec48 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:07.333458 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb160a8-7798-4541-b2b3-c6628bf4ec48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:07.333751 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb160a8-7798-4541-b2b3-c6628bf4ec48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:07.359277 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb160a8-7798-4541-b2b3-c6628bf4ec48 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:07.371583 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 326/652] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:51:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:07.376542 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d283c6-0d2f-4646-8e64-4b3fd497c505 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:07.385524 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d283c6-0d2f-4646-8e64-4b3fd497c505 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:07.389442 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315f56a-945c-4b18-a298-13639b2bc8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:07.390125 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315f56a-945c-4b18-a298-13639b2bc8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:07.390408 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315f56a-945c-4b18-a298-13639b2bc8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:07.390685 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315f56a-945c-4b18-a298-13639b2bc8a5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:07.399307 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315f56a-945c-4b18-a298-13639b2bc8a5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:07.425335 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315f56a-945c-4b18-a298-13639b2bc8a5 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:07.438877 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-2315f56a-945c-4b18-a298-13639b2bc8a5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:51:07.439930 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 327/653] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:51:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 14:51:07.445392 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb160a8-7798-4541-b2b3-c6628bf4ec48 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:07.455044 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb160a8-7798-4541-b2b3-c6628bf4ec48 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:07.458953 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27f37a-4d5b-4834-9d45-5ec0a767fe61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:07.459566 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27f37a-4d5b-4834-9d45-5ec0a767fe61 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:07.459857 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27f37a-4d5b-4834-9d45-5ec0a767fe61 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:07.460136 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27f37a-4d5b-4834-9d45-5ec0a767fe61 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:07.460872 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27f37a-4d5b-4834-9d45-5ec0a767fe61 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:07.461172 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27f37a-4d5b-4834-9d45-5ec0a767fe61 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:07.486116 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb27f37a-4d5b-4834-9d45-5ec0a767fe61 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:07.499176 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 327/654] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:51:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:07.504494 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315f56a-945c-4b18-a298-13639b2bc8a5 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:07.513846 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315f56a-945c-4b18-a298-13639b2bc8a5 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:07.517739 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0755a-2d45-4fb7-97fc-447bc3f868f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:07.518287 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0755a-2d45-4fb7-97fc-447bc3f868f0 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:07.518579 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0755a-2d45-4fb7-97fc-447bc3f868f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:07.518856 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0755a-2d45-4fb7-97fc-447bc3f868f0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:07.519655 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0755a-2d45-4fb7-97fc-447bc3f868f0 admin admin] RBAC: Adding query filter params (role.id=11f4d60c63ce44fbb0b73623a47d4ea5, scope.project.id=f79f19c59cfd43c48871b51d6aaf501f, user.id=ed972e6b35be47a8af2e86651ccc6911) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:07.519955 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0755a-2d45-4fb7-97fc-447bc3f868f0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:07.545233 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0755a-2d45-4fb7-97fc-447bc3f868f0 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:07.550749 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 328/655] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:51:07 2021] GET /identity/v3/role_assignments?user.id=ed972e6b35be47a8af2e86651ccc6911&scope.project.id=f79f19c59cfd43c48871b51d6aaf501f&role.id=11f4d60c63ce44fbb0b73623a47d4ea5 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:09.476609 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e0e1f-df9e-44c1-80bd-873a674cd91a None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:09.477144 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e0e1f-df9e-44c1-80bd-873a674cd91a None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:09.477241 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e0e1f-df9e-44c1-80bd-873a674cd91a None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:09.478808 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 328/656] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:51:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:51:09.483906 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edb6ab-55a3-4f3f-8421-cb6ed2436d47 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:09.484341 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edb6ab-55a3-4f3f-8421-cb6ed2436d47 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:09.484479 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4edb6ab-55a3-4f3f-8421-cb6ed2436d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:09.506492 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-f4edb6ab-55a3-4f3f-8421-cb6ed2436d47 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:51:09.507704 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-f4edb6ab-55a3-4f3f-8421-cb6ed2436d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:51:09.514688 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 329/657] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:51:09 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:51:09.536054 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e0e1f-df9e-44c1-80bd-873a674cd91a None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:09.547722 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e0e1f-df9e-44c1-80bd-873a674cd91a None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:09.551584 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12832a-3fb5-44cb-a2be-7b1c74d24b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:09.552283 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12832a-3fb5-44cb-a2be-7b1c74d24b04 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:09.552571 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12832a-3fb5-44cb-a2be-7b1c74d24b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:09.552857 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12832a-3fb5-44cb-a2be-7b1c74d24b04 admin admin] PATH_INFO: `/v3/services/image` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:09.553476 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12832a-3fb5-44cb-a2be-7b1c74d24b04 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:09.578671 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12832a-3fb5-44cb-a2be-7b1c74d24b04 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:09.588586 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-2a12832a-3fb5-44cb-a2be-7b1c74d24b04 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 14:51:09.589612 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 329/658] 10.222.0.89 () {56 vars in 1126 bytes} [Wed Oct 27 14:51:09 2021] GET /identity/v3/services/image => generated 86 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 14:51:09.595350 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4edb6ab-55a3-4f3f-8421-cb6ed2436d47 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:09.603629 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4edb6ab-55a3-4f3f-8421-cb6ed2436d47 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:09.607425 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a0b00-fd5a-4d45-a8c9-57648b5c2094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:09.608056 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a0b00-fd5a-4d45-a8c9-57648b5c2094 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:09.608343 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a0b00-fd5a-4d45-a8c9-57648b5c2094 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:09.608616 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a0b00-fd5a-4d45-a8c9-57648b5c2094 admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:09.609272 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a0b00-fd5a-4d45-a8c9-57648b5c2094 admin admin] RBAC: Adding query filter params (name=image) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:09.609562 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a0b00-fd5a-4d45-a8c9-57648b5c2094 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:09.634668 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a0b00-fd5a-4d45-a8c9-57648b5c2094 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:09.639431 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 330/659] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:51:09 2021] GET /identity/v3/services?name=image => generated 122 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:09.644412 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12832a-3fb5-44cb-a2be-7b1c74d24b04 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:09.653304 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12832a-3fb5-44cb-a2be-7b1c74d24b04 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:09.657260 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bc222-3a1a-446b-8597-655a01f8a1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:09.657826 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bc222-3a1a-446b-8597-655a01f8a1d2 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:09.658119 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bc222-3a1a-446b-8597-655a01f8a1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:09.658400 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bc222-3a1a-446b-8597-655a01f8a1d2 admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:09.659056 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335bc222-3a1a-446b-8597-655a01f8a1d2 admin admin] RBAC: Adding query filter params (type=image) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:09.659355 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335bc222-3a1a-446b-8597-655a01f8a1d2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:09.684731 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335bc222-3a1a-446b-8597-655a01f8a1d2 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:09.688856 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 330/660] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:51:09 2021] GET /identity/v3/services?type=image => generated 122 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:11.612328 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8419bf-df84-4f94-a735-270d960161d0 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:11.612823 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8419bf-df84-4f94-a735-270d960161d0 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:11.612823 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8419bf-df84-4f94-a735-270d960161d0 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:11.614480 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 331/661] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:51:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:51:11.619660 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31edb6-0401-4cb2-9686-6516749b0e0b None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:11.620077 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31edb6-0401-4cb2-9686-6516749b0e0b None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:11.620221 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31edb6-0401-4cb2-9686-6516749b0e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:11.642916 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-ab31edb6-0401-4cb2-9686-6516749b0e0b None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:51:11.644048 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-ab31edb6-0401-4cb2-9686-6516749b0e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:51:11.650466 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 331/662] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:51:11 2021] POST /identity/v3/auth/tokens => generated 1616 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:51:11.672347 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8419bf-df84-4f94-a735-270d960161d0 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:11.684233 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8419bf-df84-4f94-a735-270d960161d0 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:11.688060 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d9cb2-606c-4c99-8cba-29f74ec1d3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:11.688630 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d9cb2-606c-4c99-8cba-29f74ec1d3d2 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:11.688918 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d9cb2-606c-4c99-8cba-29f74ec1d3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:11.689200 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d9cb2-606c-4c99-8cba-29f74ec1d3d2 admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:11.689873 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d9cb2-606c-4c99-8cba-29f74ec1d3d2 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:11.714845 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d9cb2-606c-4c99-8cba-29f74ec1d3d2 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:11.726994 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 332/663] 10.222.0.89 () {60 vars in 1162 bytes} [Wed Oct 27 14:51:11 2021] POST /identity/v3/services => generated 242 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:51:13.672243 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aeba28-cb26-4f12-80e8-2093e91e8fc2 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:13.672734 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aeba28-cb26-4f12-80e8-2093e91e8fc2 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:13.672832 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aeba28-cb26-4f12-80e8-2093e91e8fc2 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:13.674451 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 332/664] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:51:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:51:13.679459 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c50e93-6e5a-4364-94f6-8fb12281f153 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:13.679819 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c50e93-6e5a-4364-94f6-8fb12281f153 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:13.680051 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c50e93-6e5a-4364-94f6-8fb12281f153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:13.702020 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-a7c50e93-6e5a-4364-94f6-8fb12281f153 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:51:13.703133 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-a7c50e93-6e5a-4364-94f6-8fb12281f153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:51:13.720222 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 333/665] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:51:13 2021] POST /identity/v3/auth/tokens => generated 1712 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:51:13.741979 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aeba28-cb26-4f12-80e8-2093e91e8fc2 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:13.753259 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aeba28-cb26-4f12-80e8-2093e91e8fc2 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:13.757062 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4365ae53-f741-485b-b236-474534894b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:13.757761 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365ae53-f741-485b-b236-474534894b4d admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:13.758047 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365ae53-f741-485b-b236-474534894b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:13.758326 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4365ae53-f741-485b-b236-474534894b4d admin admin] PATH_INFO: `/v3/services/image` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:13.758946 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4365ae53-f741-485b-b236-474534894b4d admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:13.784856 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4365ae53-f741-485b-b236-474534894b4d admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:13.794991 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-4365ae53-f741-485b-b236-474534894b4d admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 14:51:13.796049 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 333/666] 10.222.0.89 () {56 vars in 1126 bytes} [Wed Oct 27 14:51:13 2021] GET /identity/v3/services/image => generated 86 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:13.801308 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c50e93-6e5a-4364-94f6-8fb12281f153 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:13.809719 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c50e93-6e5a-4364-94f6-8fb12281f153 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:13.813670 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e2468-dedf-4df0-950b-6afa670fb674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:13.814255 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e2468-dedf-4df0-950b-6afa670fb674 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:13.814544 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e2468-dedf-4df0-950b-6afa670fb674 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:13.814823 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e2468-dedf-4df0-950b-6afa670fb674 admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:13.815524 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e2468-dedf-4df0-950b-6afa670fb674 admin admin] RBAC: Adding query filter params (name=image) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:13.815825 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e2468-dedf-4df0-950b-6afa670fb674 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:13.841683 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e2468-dedf-4df0-950b-6afa670fb674 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:13.845984 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 334/667] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:51:13 2021] GET /identity/v3/services?name=image => generated 122 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:13.851134 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4365ae53-f741-485b-b236-474534894b4d admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:13.859953 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4365ae53-f741-485b-b236-474534894b4d admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:13.863923 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec08273-a1f5-4811-887e-017b93d9b9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:13.864486 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec08273-a1f5-4811-887e-017b93d9b9a1 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:13.864775 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec08273-a1f5-4811-887e-017b93d9b9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:13.865056 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec08273-a1f5-4811-887e-017b93d9b9a1 admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:13.865712 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec08273-a1f5-4811-887e-017b93d9b9a1 admin admin] RBAC: Adding query filter params (type=image) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:13.866011 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec08273-a1f5-4811-887e-017b93d9b9a1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:13.891278 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec08273-a1f5-4811-887e-017b93d9b9a1 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:13.895783 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 334/668] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:51:13 2021] GET /identity/v3/services?type=image => generated 350 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:13.900786 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e2468-dedf-4df0-950b-6afa670fb674 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:13.910212 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e2468-dedf-4df0-950b-6afa670fb674 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:13.914395 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5eae39-9b88-451a-9996-8f5d1aab06bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:13.914947 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5eae39-9b88-451a-9996-8f5d1aab06bd admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:13.915235 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5eae39-9b88-451a-9996-8f5d1aab06bd admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:13.915550 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5eae39-9b88-451a-9996-8f5d1aab06bd admin admin] PATH_INFO: `/v3/endpoints` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:13.916278 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5eae39-9b88-451a-9996-8f5d1aab06bd admin admin] RBAC: Adding query filter params (interface=public, service_id=76b4ad2554cd4cbdb904716336c789fe, region_id=RegionOne) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:13.916577 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5eae39-9b88-451a-9996-8f5d1aab06bd admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:13.941295 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5eae39-9b88-451a-9996-8f5d1aab06bd admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:13.946247 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 335/669] 10.222.0.89 () {56 vars in 1272 bytes} [Wed Oct 27 14:51:13 2021] GET /identity/v3/endpoints?service_id=76b4ad2554cd4cbdb904716336c789fe&interface=public®ion_id=RegionOne => generated 194 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:13.951764 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec08273-a1f5-4811-887e-017b93d9b9a1 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:13.960492 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec08273-a1f5-4811-887e-017b93d9b9a1 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:13.964365 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5c384-cd62-496f-a91a-2843963d4399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:13.965520 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5c384-cd62-496f-a91a-2843963d4399 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:13.965803 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5c384-cd62-496f-a91a-2843963d4399 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:13.966079 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5c384-cd62-496f-a91a-2843963d4399 admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:13.966703 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5c384-cd62-496f-a91a-2843963d4399 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:13.991270 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5c384-cd62-496f-a91a-2843963d4399 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:13.996329 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 335/670] 10.222.0.89 () {56 vars in 1108 bytes} [Wed Oct 27 14:51:13 2021] GET /identity/v3/services => generated 1022 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 14:51:15.941912 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c583b77-af29-4295-8297-a21da447d091 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:15.942459 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c583b77-af29-4295-8297-a21da447d091 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:15.942459 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c583b77-af29-4295-8297-a21da447d091 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:15.944179 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 336/671] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:51:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:51:15.949812 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c60b2-d532-44c2-bcc6-bc3d83157fa4 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:15.950211 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c60b2-d532-44c2-bcc6-bc3d83157fa4 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:15.950363 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c60b2-d532-44c2-bcc6-bc3d83157fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:15.973167 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-f61c60b2-d532-44c2-bcc6-bc3d83157fa4 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:51:15.974278 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-f61c60b2-d532-44c2-bcc6-bc3d83157fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:51:15.981224 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 336/672] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:51:15 2021] POST /identity/v3/auth/tokens => generated 1712 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:51:16.003415 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c583b77-af29-4295-8297-a21da447d091 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:16.014998 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c583b77-af29-4295-8297-a21da447d091 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:16.018973 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b088a05-1c4e-4de0-926d-bf137d154dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:16.019708 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b088a05-1c4e-4de0-926d-bf137d154dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:16.019996 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b088a05-1c4e-4de0-926d-bf137d154dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:16.020274 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b088a05-1c4e-4de0-926d-bf137d154dc9 admin admin] PATH_INFO: `/v3/services/image` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:16.020887 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b088a05-1c4e-4de0-926d-bf137d154dc9 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:16.046553 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b088a05-1c4e-4de0-926d-bf137d154dc9 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:16.056552 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-2b088a05-1c4e-4de0-926d-bf137d154dc9 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 14:51:16.057594 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 337/673] 10.222.0.89 () {56 vars in 1126 bytes} [Wed Oct 27 14:51:16 2021] GET /identity/v3/services/image => generated 86 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:16.063759 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c60b2-d532-44c2-bcc6-bc3d83157fa4 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:16.072124 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c60b2-d532-44c2-bcc6-bc3d83157fa4 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:16.075993 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28597d61-3ae0-4aad-8309-28f5405f11e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:16.076572 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28597d61-3ae0-4aad-8309-28f5405f11e1 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:16.076857 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28597d61-3ae0-4aad-8309-28f5405f11e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:16.077133 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28597d61-3ae0-4aad-8309-28f5405f11e1 admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:16.077797 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28597d61-3ae0-4aad-8309-28f5405f11e1 admin admin] RBAC: Adding query filter params (name=image) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:16.078092 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28597d61-3ae0-4aad-8309-28f5405f11e1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:16.102757 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28597d61-3ae0-4aad-8309-28f5405f11e1 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:16.107667 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 337/674] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:51:16 2021] GET /identity/v3/services?name=image => generated 122 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:51:16.112602 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b088a05-1c4e-4de0-926d-bf137d154dc9 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:16.122109 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b088a05-1c4e-4de0-926d-bf137d154dc9 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:16.126137 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1d9d5-f0a1-43b6-9ddb-225d3e26671c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:16.126701 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1d9d5-f0a1-43b6-9ddb-225d3e26671c admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:16.126988 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1d9d5-f0a1-43b6-9ddb-225d3e26671c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:16.127276 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1d9d5-f0a1-43b6-9ddb-225d3e26671c admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:16.129484 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1d9d5-f0a1-43b6-9ddb-225d3e26671c admin admin] RBAC: Adding query filter params (type=image) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:16.129484 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1d9d5-f0a1-43b6-9ddb-225d3e26671c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:16.154079 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1d9d5-f0a1-43b6-9ddb-225d3e26671c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:16.158712 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 338/675] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:51:16 2021] GET /identity/v3/services?type=image => generated 350 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:16.164267 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28597d61-3ae0-4aad-8309-28f5405f11e1 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:16.173782 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28597d61-3ae0-4aad-8309-28f5405f11e1 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:16.177760 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d944f-dfe7-41a8-9235-dbd13ab9514a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:16.178329 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d944f-dfe7-41a8-9235-dbd13ab9514a admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:16.178615 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d944f-dfe7-41a8-9235-dbd13ab9514a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:16.178893 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d944f-dfe7-41a8-9235-dbd13ab9514a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:16.179613 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d944f-dfe7-41a8-9235-dbd13ab9514a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:16.204941 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d944f-dfe7-41a8-9235-dbd13ab9514a admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:16.222619 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 338/676] 10.222.0.89 () {60 vars in 1165 bytes} [Wed Oct 27 14:51:16 2021] POST /identity/v3/endpoints => generated 327 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:51:18.170486 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bf14b-aea3-4acd-8177-978cdeab19c2 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:18.171005 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bf14b-aea3-4acd-8177-978cdeab19c2 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:18.171111 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031bf14b-aea3-4acd-8177-978cdeab19c2 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:18.172766 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 339/677] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:51:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:51:18.177680 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f4151-f994-4de3-bddb-d5a5af54a681 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:18.178119 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f4151-f994-4de3-bddb-d5a5af54a681 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:18.178211 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f4151-f994-4de3-bddb-d5a5af54a681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:18.200859 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-6f1f4151-f994-4de3-bddb-d5a5af54a681 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:51:18.201963 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-6f1f4151-f994-4de3-bddb-d5a5af54a681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:51:18.217344 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 339/678] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:51:18 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:51:18.238525 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bf14b-aea3-4acd-8177-978cdeab19c2 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:18.250730 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031bf14b-aea3-4acd-8177-978cdeab19c2 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:18.254627 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d100ed-a025-4220-8936-4f89abd4232e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:18.255262 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d100ed-a025-4220-8936-4f89abd4232e admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:18.255646 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d100ed-a025-4220-8936-4f89abd4232e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:18.255989 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d100ed-a025-4220-8936-4f89abd4232e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:18.263523 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d100ed-a025-4220-8936-4f89abd4232e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:18.288650 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d100ed-a025-4220-8936-4f89abd4232e admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:18.298177 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 340/679] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:51:18 2021] GET /identity/v3/auth/tokens => generated 1861 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:51:18.303667 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f4151-f994-4de3-bddb-d5a5af54a681 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:18.312687 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f4151-f994-4de3-bddb-d5a5af54a681 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:18.316613 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc4e97-de9f-428f-9b00-e968bc4bad52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:18.317323 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc4e97-de9f-428f-9b00-e968bc4bad52 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:18.317608 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc4e97-de9f-428f-9b00-e968bc4bad52 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:18.317886 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc4e97-de9f-428f-9b00-e968bc4bad52 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:18.318960 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc4e97-de9f-428f-9b00-e968bc4bad52 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:18.343789 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc4e97-de9f-428f-9b00-e968bc4bad52 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:18.345188 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 340/680] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:51:18 2021] GET /identity/v3/domains/default => generated 199 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:20.375294 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb4cfa-1216-474c-9552-319aadedbb20 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:20.375853 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb4cfa-1216-474c-9552-319aadedbb20 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:20.375853 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb4cfa-1216-474c-9552-319aadedbb20 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:20.377551 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 341/681] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:51:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:51:20.382678 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90526689-10a9-4dee-96a6-325032b95ac2 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:20.383091 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90526689-10a9-4dee-96a6-325032b95ac2 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:20.383233 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90526689-10a9-4dee-96a6-325032b95ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:20.405556 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-90526689-10a9-4dee-96a6-325032b95ac2 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:51:20.406677 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-90526689-10a9-4dee-96a6-325032b95ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:51:20.413426 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 341/682] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:51:20 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:51:20.436542 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb4cfa-1216-474c-9552-319aadedbb20 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:20.447821 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb4cfa-1216-474c-9552-319aadedbb20 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:20.452270 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7a026-53a1-4a22-b019-327e3574e959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:20.452961 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7a026-53a1-4a22-b019-327e3574e959 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:20.453243 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7a026-53a1-4a22-b019-327e3574e959 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:20.453515 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7a026-53a1-4a22-b019-327e3574e959 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:20.464672 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7a026-53a1-4a22-b019-327e3574e959 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:20.489996 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7a026-53a1-4a22-b019-327e3574e959 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:20.506674 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-46e7a026-53a1-4a22-b019-327e3574e959 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:51:20.507675 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 342/683] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:51:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:20.513266 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90526689-10a9-4dee-96a6-325032b95ac2 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:20.521589 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90526689-10a9-4dee-96a6-325032b95ac2 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:20.525535 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4c615-a2dd-43e2-98d3-845b0bb07ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:20.526113 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4c615-a2dd-43e2-98d3-845b0bb07ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:20.526399 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4c615-a2dd-43e2-98d3-845b0bb07ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:20.526715 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4c615-a2dd-43e2-98d3-845b0bb07ef3 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:20.527400 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4c615-a2dd-43e2-98d3-845b0bb07ef3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:20.527725 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4c615-a2dd-43e2-98d3-845b0bb07ef3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:20.553131 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4c615-a2dd-43e2-98d3-845b0bb07ef3 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:20.565819 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 342/684] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:51:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:20.570831 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7a026-53a1-4a22-b019-327e3574e959 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:20.579681 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7a026-53a1-4a22-b019-327e3574e959 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:20.583550 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817bc399-c478-4476-bd68-4203cf01709d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:20.584117 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bc399-c478-4476-bd68-4203cf01709d admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:20.584398 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bc399-c478-4476-bd68-4203cf01709d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:20.584671 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bc399-c478-4476-bd68-4203cf01709d admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:20.585301 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817bc399-c478-4476-bd68-4203cf01709d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:20.610701 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817bc399-c478-4476-bd68-4203cf01709d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:20.629640 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 343/685] 10.222.0.89 () {60 vars in 1153 bytes} [Wed Oct 27 14:51:20 2021] POST /identity/v3/users => generated 248 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:51:22.604456 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b634147-0f58-443d-908a-06d3424c1eb4 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:22.605006 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b634147-0f58-443d-908a-06d3424c1eb4 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:22.605006 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b634147-0f58-443d-908a-06d3424c1eb4 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:22.607127 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 343/686] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:51:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:51:22.612242 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b485c-ddde-4bad-ad91-adbe9622b791 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:22.612622 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b485c-ddde-4bad-ad91-adbe9622b791 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:22.612796 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b485c-ddde-4bad-ad91-adbe9622b791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:22.634025 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-564b485c-ddde-4bad-ad91-adbe9622b791 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:51:22.635135 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-564b485c-ddde-4bad-ad91-adbe9622b791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:51:22.641665 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 344/687] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:51:22 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:51:22.663743 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b634147-0f58-443d-908a-06d3424c1eb4 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:22.675739 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b634147-0f58-443d-908a-06d3424c1eb4 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:22.679604 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee112d69-40d7-44bf-aec0-1a4d25f1156b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:22.680305 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee112d69-40d7-44bf-aec0-1a4d25f1156b admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:22.680594 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee112d69-40d7-44bf-aec0-1a4d25f1156b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:22.680873 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee112d69-40d7-44bf-aec0-1a4d25f1156b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:22.691788 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee112d69-40d7-44bf-aec0-1a4d25f1156b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:51:22.698077 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-ee112d69-40d7-44bf-aec0-1a4d25f1156b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 14:51:22.699121 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 344/688] 10.222.0.89 () {56 vars in 1123 bytes} [Wed Oct 27 14:51:22 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:22.704320 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b485c-ddde-4bad-ad91-adbe9622b791 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:22.712591 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b485c-ddde-4bad-ad91-adbe9622b791 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:22.717008 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644a0e2-2dba-4fc3-b7e8-d4eedc4384fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:22.717575 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644a0e2-2dba-4fc3-b7e8-d4eedc4384fc admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:22.717857 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644a0e2-2dba-4fc3-b7e8-d4eedc4384fc admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:22.718129 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644a0e2-2dba-4fc3-b7e8-d4eedc4384fc admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:22.718826 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f644a0e2-2dba-4fc3-b7e8-d4eedc4384fc admin admin] RBAC: Adding query filter params (name=service) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:22.719116 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f644a0e2-2dba-4fc3-b7e8-d4eedc4384fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:22.744321 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f644a0e2-2dba-4fc3-b7e8-d4eedc4384fc admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:22.752403 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 345/689] 10.222.0.89 () {56 vars in 1124 bytes} [Wed Oct 27 14:51:22 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:22.757691 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee112d69-40d7-44bf-aec0-1a4d25f1156b admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:22.767631 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee112d69-40d7-44bf-aec0-1a4d25f1156b admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:22.771604 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06e374-7a7b-4714-973e-42dd864bd5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:22.772283 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06e374-7a7b-4714-973e-42dd864bd5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:22.772569 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06e374-7a7b-4714-973e-42dd864bd5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:22.772851 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d06e374-7a7b-4714-973e-42dd864bd5d5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:22.784381 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06e374-7a7b-4714-973e-42dd864bd5d5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:22.809912 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d06e374-7a7b-4714-973e-42dd864bd5d5 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:22.827382 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-9d06e374-7a7b-4714-973e-42dd864bd5d5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:51:22.828432 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 345/690] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:51:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:22.833586 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644a0e2-2dba-4fc3-b7e8-d4eedc4384fc admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:22.843140 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644a0e2-2dba-4fc3-b7e8-d4eedc4384fc admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:22.847113 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc4829-9a90-4aa9-b553-3f85a68141e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:22.847726 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc4829-9a90-4aa9-b553-3f85a68141e2 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:22.848013 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc4829-9a90-4aa9-b553-3f85a68141e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:22.848289 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bc4829-9a90-4aa9-b553-3f85a68141e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:22.848966 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc4829-9a90-4aa9-b553-3f85a68141e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:22.849263 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc4829-9a90-4aa9-b553-3f85a68141e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:22.874098 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bc4829-9a90-4aa9-b553-3f85a68141e2 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:22.886833 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 346/691] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:51:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:22.891744 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06e374-7a7b-4714-973e-42dd864bd5d5 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:22.900698 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d06e374-7a7b-4714-973e-42dd864bd5d5 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:22.905321 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755d46b-fc43-4a35-bf7b-9702adecaf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:22.906009 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755d46b-fc43-4a35-bf7b-9702adecaf8f admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:22.906299 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755d46b-fc43-4a35-bf7b-9702adecaf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:22.906580 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755d46b-fc43-4a35-bf7b-9702adecaf8f admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:22.919143 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755d46b-fc43-4a35-bf7b-9702adecaf8f admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:22.944422 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755d46b-fc43-4a35-bf7b-9702adecaf8f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:22.962070 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-8755d46b-fc43-4a35-bf7b-9702adecaf8f admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 14:51:22.963096 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 346/692] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:51:22 2021] GET /identity/v3/users/cinder => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:22.968707 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc4829-9a90-4aa9-b553-3f85a68141e2 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:22.977629 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bc4829-9a90-4aa9-b553-3f85a68141e2 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:22.981684 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b0d12-60af-4d93-9591-c8e131c2bde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:22.982278 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b0d12-60af-4d93-9591-c8e131c2bde0 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:22.982561 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b0d12-60af-4d93-9591-c8e131c2bde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:22.982838 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4b0d12-60af-4d93-9591-c8e131c2bde0 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:22.983684 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b0d12-60af-4d93-9591-c8e131c2bde0 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:22.983980 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b0d12-60af-4d93-9591-c8e131c2bde0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:23.009096 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4b0d12-60af-4d93-9591-c8e131c2bde0 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:23.039539 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 347/693] 10.222.0.89 () {56 vars in 1158 bytes} [Wed Oct 27 14:51:22 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:23.044853 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755d46b-fc43-4a35-bf7b-9702adecaf8f admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:23.053788 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755d46b-fc43-4a35-bf7b-9702adecaf8f admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:23.057698 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c52ce4-1846-4cb7-955d-e5eaf91becd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:23.058254 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c52ce4-1846-4cb7-955d-e5eaf91becd6 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:23.058534 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c52ce4-1846-4cb7-955d-e5eaf91becd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:23.058809 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c52ce4-1846-4cb7-955d-e5eaf91becd6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:23.066165 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c52ce4-1846-4cb7-955d-e5eaf91becd6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:23.092105 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c52ce4-1846-4cb7-955d-e5eaf91becd6 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:23.100140 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 347/694] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:51:23 2021] GET /identity/v3/auth/tokens => generated 1861 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:51:23.105357 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b0d12-60af-4d93-9591-c8e131c2bde0 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:23.114285 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4b0d12-60af-4d93-9591-c8e131c2bde0 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:23.118271 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd46c3f-f648-4f1e-b071-7886feb5c281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:23.118967 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd46c3f-f648-4f1e-b071-7886feb5c281 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:23.119254 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd46c3f-f648-4f1e-b071-7886feb5c281 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:23.119568 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd46c3f-f648-4f1e-b071-7886feb5c281 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:23.131287 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd46c3f-f648-4f1e-b071-7886feb5c281 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:23.156588 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd46c3f-f648-4f1e-b071-7886feb5c281 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:23.173044 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-7fd46c3f-f648-4f1e-b071-7886feb5c281 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:51:23.174076 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 348/695] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:51:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:23.179131 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c52ce4-1846-4cb7-955d-e5eaf91becd6 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:23.187769 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c52ce4-1846-4cb7-955d-e5eaf91becd6 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:23.192028 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde973bb-bdb8-4f5f-8d44-294c5dcc1bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:23.192592 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde973bb-bdb8-4f5f-8d44-294c5dcc1bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:23.192874 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde973bb-bdb8-4f5f-8d44-294c5dcc1bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:23.193146 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde973bb-bdb8-4f5f-8d44-294c5dcc1bf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:23.193804 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde973bb-bdb8-4f5f-8d44-294c5dcc1bf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:23.194095 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde973bb-bdb8-4f5f-8d44-294c5dcc1bf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:23.219343 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde973bb-bdb8-4f5f-8d44-294c5dcc1bf4 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:23.231957 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 348/696] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:51:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:23.237151 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd46c3f-f648-4f1e-b071-7886feb5c281 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:23.246853 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd46c3f-f648-4f1e-b071-7886feb5c281 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:23.250885 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de781af6-0c5e-4266-9f33-4060cceb4dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:23.251698 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de781af6-0c5e-4266-9f33-4060cceb4dcb admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:23.252055 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de781af6-0c5e-4266-9f33-4060cceb4dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:23.252409 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de781af6-0c5e-4266-9f33-4060cceb4dcb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:23.261913 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de781af6-0c5e-4266-9f33-4060cceb4dcb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:23.287101 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de781af6-0c5e-4266-9f33-4060cceb4dcb admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:23.300621 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-de781af6-0c5e-4266-9f33-4060cceb4dcb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:51:23.301672 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 349/697] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:51:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:23.306999 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde973bb-bdb8-4f5f-8d44-294c5dcc1bf4 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:23.316459 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde973bb-bdb8-4f5f-8d44-294c5dcc1bf4 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:23.320378 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5dfadd-eb96-4fcb-84f2-7f0190dc22de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:23.320947 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dfadd-eb96-4fcb-84f2-7f0190dc22de admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:23.321229 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dfadd-eb96-4fcb-84f2-7f0190dc22de admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:23.321506 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dfadd-eb96-4fcb-84f2-7f0190dc22de admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:23.322235 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5dfadd-eb96-4fcb-84f2-7f0190dc22de admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:23.322533 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5dfadd-eb96-4fcb-84f2-7f0190dc22de admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:23.348055 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5dfadd-eb96-4fcb-84f2-7f0190dc22de admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:23.360421 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 349/698] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:51:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:23.365810 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de781af6-0c5e-4266-9f33-4060cceb4dcb admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:23.375353 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de781af6-0c5e-4266-9f33-4060cceb4dcb admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:23.379318 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2b707-2b7c-48ff-8e82-0f9e431e1486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:23.380014 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2b707-2b7c-48ff-8e82-0f9e431e1486 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:23.380302 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2b707-2b7c-48ff-8e82-0f9e431e1486 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:23.380583 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2b707-2b7c-48ff-8e82-0f9e431e1486 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:23.381401 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2b707-2b7c-48ff-8e82-0f9e431e1486 admin admin] RBAC: Adding query filter params (role.id=0af8b2c9076246e6ac61d13d88d91976, scope.project.id=f79f19c59cfd43c48871b51d6aaf501f, user.id=0fca8f0282ea40ce9b378260b95b3d01) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:23.381655 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2b707-2b7c-48ff-8e82-0f9e431e1486 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:23.407316 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2b707-2b7c-48ff-8e82-0f9e431e1486 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:23.412472 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 350/699] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:51:23 2021] GET /identity/v3/role_assignments?user.id=0fca8f0282ea40ce9b378260b95b3d01&scope.project.id=f79f19c59cfd43c48871b51d6aaf501f&role.id=0af8b2c9076246e6ac61d13d88d91976 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:51:25.334050 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e43dd-ef66-4c2a-ad80-752b87efae91 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:25.334529 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e43dd-ef66-4c2a-ad80-752b87efae91 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:25.334612 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e43dd-ef66-4c2a-ad80-752b87efae91 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:25.336304 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 350/700] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:51:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:51:25.341855 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2508230-9ee6-44be-9f4e-aefcb08829be None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:25.342268 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2508230-9ee6-44be-9f4e-aefcb08829be None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:25.342417 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2508230-9ee6-44be-9f4e-aefcb08829be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:25.365083 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-c2508230-9ee6-44be-9f4e-aefcb08829be None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:51:25.366200 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-c2508230-9ee6-44be-9f4e-aefcb08829be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:51:25.372829 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 351/701] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:51:25 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:51:25.393900 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e43dd-ef66-4c2a-ad80-752b87efae91 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:25.405722 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e43dd-ef66-4c2a-ad80-752b87efae91 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:25.409662 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85f419-a3a8-48af-9496-41f33096aefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:25.410364 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85f419-a3a8-48af-9496-41f33096aefd admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:25.410649 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85f419-a3a8-48af-9496-41f33096aefd admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:25.410927 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85f419-a3a8-48af-9496-41f33096aefd admin admin] PATH_INFO: `/v3/roles/service` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:25.422589 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85f419-a3a8-48af-9496-41f33096aefd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:51:25.429046 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-9b85f419-a3a8-48af-9496-41f33096aefd admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 14:51:25.430069 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 351/702] 10.222.0.89 () {56 vars in 1123 bytes} [Wed Oct 27 14:51:25 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:25.435413 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2508230-9ee6-44be-9f4e-aefcb08829be None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:25.443747 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2508230-9ee6-44be-9f4e-aefcb08829be None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:25.447847 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd93337-1568-4e14-b245-be2af94e7dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:25.448420 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd93337-1568-4e14-b245-be2af94e7dad admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:25.448728 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd93337-1568-4e14-b245-be2af94e7dad admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:25.449005 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd93337-1568-4e14-b245-be2af94e7dad admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:25.449702 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd93337-1568-4e14-b245-be2af94e7dad admin admin] RBAC: Adding query filter params (name=service) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:25.449996 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd93337-1568-4e14-b245-be2af94e7dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:25.475633 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd93337-1568-4e14-b245-be2af94e7dad admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:25.484328 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 352/703] 10.222.0.89 () {56 vars in 1124 bytes} [Wed Oct 27 14:51:25 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:25.489497 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85f419-a3a8-48af-9496-41f33096aefd admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:25.498928 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85f419-a3a8-48af-9496-41f33096aefd admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:25.502837 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4991e2-d7a8-46d2-8c22-4d959d3b1745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:25.503554 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4991e2-d7a8-46d2-8c22-4d959d3b1745 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:25.503843 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4991e2-d7a8-46d2-8c22-4d959d3b1745 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:25.504122 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4991e2-d7a8-46d2-8c22-4d959d3b1745 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:25.515045 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4991e2-d7a8-46d2-8c22-4d959d3b1745 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:25.540659 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4991e2-d7a8-46d2-8c22-4d959d3b1745 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:25.558144 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-ad4991e2-d7a8-46d2-8c22-4d959d3b1745 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:51:25.559163 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 352/704] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:51:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:25.564295 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd93337-1568-4e14-b245-be2af94e7dad admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:25.573203 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd93337-1568-4e14-b245-be2af94e7dad admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:25.577094 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d79e6-971d-43a1-a83e-daaf1fddc09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:25.577657 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d79e6-971d-43a1-a83e-daaf1fddc09c admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:25.577944 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d79e6-971d-43a1-a83e-daaf1fddc09c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:25.578224 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5d79e6-971d-43a1-a83e-daaf1fddc09c admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:25.578895 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d79e6-971d-43a1-a83e-daaf1fddc09c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:25.579190 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d79e6-971d-43a1-a83e-daaf1fddc09c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:25.604444 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5d79e6-971d-43a1-a83e-daaf1fddc09c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:25.617161 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 353/705] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:51:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:25.622123 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4991e2-d7a8-46d2-8c22-4d959d3b1745 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:25.631105 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4991e2-d7a8-46d2-8c22-4d959d3b1745 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:25.635020 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43628abd-ce7e-4d11-9b3d-750c7170cc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:25.635740 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43628abd-ce7e-4d11-9b3d-750c7170cc2b admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:25.636035 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43628abd-ce7e-4d11-9b3d-750c7170cc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:25.636345 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43628abd-ce7e-4d11-9b3d-750c7170cc2b admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:25.648520 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43628abd-ce7e-4d11-9b3d-750c7170cc2b admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:25.675340 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43628abd-ce7e-4d11-9b3d-750c7170cc2b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:25.692253 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-43628abd-ce7e-4d11-9b3d-750c7170cc2b admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 14:51:25.693273 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 353/706] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:51:25 2021] GET /identity/v3/users/cinder => generated 84 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:25.698463 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d79e6-971d-43a1-a83e-daaf1fddc09c admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:25.707642 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5d79e6-971d-43a1-a83e-daaf1fddc09c admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:25.711651 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5887a88-53e8-4122-a6de-facf2723615c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:25.712228 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5887a88-53e8-4122-a6de-facf2723615c admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:25.712515 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5887a88-53e8-4122-a6de-facf2723615c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:25.712796 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5887a88-53e8-4122-a6de-facf2723615c admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:25.713572 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5887a88-53e8-4122-a6de-facf2723615c admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:25.713872 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5887a88-53e8-4122-a6de-facf2723615c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:25.740005 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5887a88-53e8-4122-a6de-facf2723615c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:25.768278 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 354/707] 10.222.0.89 () {56 vars in 1158 bytes} [Wed Oct 27 14:51:25 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:51:25.773386 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43628abd-ce7e-4d11-9b3d-750c7170cc2b admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:25.782743 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43628abd-ce7e-4d11-9b3d-750c7170cc2b admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:25.786612 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce1fa7-f9f4-4acd-a6ec-d432ef47d72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:25.787287 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce1fa7-f9f4-4acd-a6ec-d432ef47d72b admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:25.787607 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce1fa7-f9f4-4acd-a6ec-d432ef47d72b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:25.788142 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce1fa7-f9f4-4acd-a6ec-d432ef47d72b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:25.801057 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce1fa7-f9f4-4acd-a6ec-d432ef47d72b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:25.826303 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce1fa7-f9f4-4acd-a6ec-d432ef47d72b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:25.842760 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-77ce1fa7-f9f4-4acd-a6ec-d432ef47d72b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:51:25.843799 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 354/708] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:51:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:25.848909 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5887a88-53e8-4122-a6de-facf2723615c admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:25.858020 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5887a88-53e8-4122-a6de-facf2723615c admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:25.862033 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2f9e8-f875-4b37-af10-f61bd2a45ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:25.862617 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2f9e8-f875-4b37-af10-f61bd2a45ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:25.862901 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2f9e8-f875-4b37-af10-f61bd2a45ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:25.863179 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2f9e8-f875-4b37-af10-f61bd2a45ec3 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:25.863921 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2f9e8-f875-4b37-af10-f61bd2a45ec3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:25.864203 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2f9e8-f875-4b37-af10-f61bd2a45ec3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:25.889477 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2f9e8-f875-4b37-af10-f61bd2a45ec3 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:25.901422 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 355/709] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:51:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:25.907523 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce1fa7-f9f4-4acd-a6ec-d432ef47d72b admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:25.916928 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce1fa7-f9f4-4acd-a6ec-d432ef47d72b admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:25.921114 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a76b9-af69-4c5c-ac69-5d71c16abbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:25.921822 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a76b9-af69-4c5c-ac69-5d71c16abbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:25.922107 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a76b9-af69-4c5c-ac69-5d71c16abbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:25.922381 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a76b9-af69-4c5c-ac69-5d71c16abbe3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:25.931159 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a76b9-af69-4c5c-ac69-5d71c16abbe3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:25.956609 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a76b9-af69-4c5c-ac69-5d71c16abbe3 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:25.970159 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-530a76b9-af69-4c5c-ac69-5d71c16abbe3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:51:25.971184 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 355/710] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:51:25 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:25.976385 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2f9e8-f875-4b37-af10-f61bd2a45ec3 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:25.985361 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2f9e8-f875-4b37-af10-f61bd2a45ec3 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:25.989567 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4800e2-8aac-4344-9a81-77b81abd833f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:25.990149 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4800e2-8aac-4344-9a81-77b81abd833f admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:25.990439 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4800e2-8aac-4344-9a81-77b81abd833f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:25.990722 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4800e2-8aac-4344-9a81-77b81abd833f admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:25.991494 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4800e2-8aac-4344-9a81-77b81abd833f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:25.991801 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4800e2-8aac-4344-9a81-77b81abd833f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:26.017371 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4800e2-8aac-4344-9a81-77b81abd833f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:26.030596 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 356/711] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:51:25 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:26.036003 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a76b9-af69-4c5c-ac69-5d71c16abbe3 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:26.045373 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a76b9-af69-4c5c-ac69-5d71c16abbe3 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:26.049371 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ffff71-b1bf-4853-af41-b7863c487084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:26.050163 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ffff71-b1bf-4853-af41-b7863c487084 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:26.050451 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ffff71-b1bf-4853-af41-b7863c487084 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:26.050732 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ffff71-b1bf-4853-af41-b7863c487084 admin admin] PATH_INFO: `/v3/projects/f79f19c59cfd43c48871b51d6aaf501f/users/0fca8f0282ea40ce9b378260b95b3d01/roles/0af8b2c9076246e6ac61d13d88d91976` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:26.070008 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ffff71-b1bf-4853-af41-b7863c487084 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79f19c59cfd43c48871b51d6aaf501f, user_id=0fca8f0282ea40ce9b378260b95b3d01, role_id=0af8b2c9076246e6ac61d13d88d91976)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:26.097417 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ffff71-b1bf-4853-af41-b7863c487084 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:26.109678 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 356/712] 10.222.0.89 () {58 vars in 1460 bytes} [Wed Oct 27 14:51:26 2021] PUT /identity/v3/projects/f79f19c59cfd43c48871b51d6aaf501f/users/0fca8f0282ea40ce9b378260b95b3d01/roles/0af8b2c9076246e6ac61d13d88d91976 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:51:28.087771 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3ae5c-b3c0-40fa-adf3-3293e41d061e None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:28.088293 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3ae5c-b3c0-40fa-adf3-3293e41d061e None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:28.088379 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3ae5c-b3c0-40fa-adf3-3293e41d061e None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:28.089969 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 357/713] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:51:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:51:28.094921 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc24119-9dc4-4237-9f59-078370c626ac None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:28.095346 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc24119-9dc4-4237-9f59-078370c626ac None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:28.095519 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc24119-9dc4-4237-9f59-078370c626ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:28.117723 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-7cc24119-9dc4-4237-9f59-078370c626ac None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:51:28.118854 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-7cc24119-9dc4-4237-9f59-078370c626ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:51:28.181130 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 357/714] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:51:28 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:51:28.204078 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3ae5c-b3c0-40fa-adf3-3293e41d061e None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:28.221957 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3ae5c-b3c0-40fa-adf3-3293e41d061e None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:28.228050 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049ef4c-caad-4f8d-ae07-af0be391493e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:28.233144 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049ef4c-caad-4f8d-ae07-af0be391493e admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:28.233438 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049ef4c-caad-4f8d-ae07-af0be391493e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:28.233716 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6049ef4c-caad-4f8d-ae07-af0be391493e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:28.249157 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6049ef4c-caad-4f8d-ae07-af0be391493e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:51:28.255352 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-6049ef4c-caad-4f8d-ae07-af0be391493e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 14:51:28.256477 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 358/715] 10.222.0.89 () {56 vars in 1123 bytes} [Wed Oct 27 14:51:28 2021] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:28.262150 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc24119-9dc4-4237-9f59-078370c626ac None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:28.270606 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc24119-9dc4-4237-9f59-078370c626ac None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:28.274596 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779ea0b-64c1-45a2-9bb9-fd803716ddde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:28.275183 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779ea0b-64c1-45a2-9bb9-fd803716ddde admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:28.275504 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779ea0b-64c1-45a2-9bb9-fd803716ddde admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:28.275783 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779ea0b-64c1-45a2-9bb9-fd803716ddde admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:28.276527 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779ea0b-64c1-45a2-9bb9-fd803716ddde admin admin] RBAC: Adding query filter params (name=service) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:28.276825 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779ea0b-64c1-45a2-9bb9-fd803716ddde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:28.302409 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779ea0b-64c1-45a2-9bb9-fd803716ddde admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:28.311148 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 358/716] 10.222.0.89 () {56 vars in 1124 bytes} [Wed Oct 27 14:51:28 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:28.316375 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049ef4c-caad-4f8d-ae07-af0be391493e admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:28.326152 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6049ef4c-caad-4f8d-ae07-af0be391493e admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:28.330127 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebef5d0-f6e4-481d-8b56-cfbb880cd3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:28.330824 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebef5d0-f6e4-481d-8b56-cfbb880cd3c6 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:28.331113 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebef5d0-f6e4-481d-8b56-cfbb880cd3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:28.331392 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebef5d0-f6e4-481d-8b56-cfbb880cd3c6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:28.343350 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebef5d0-f6e4-481d-8b56-cfbb880cd3c6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:28.369008 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebef5d0-f6e4-481d-8b56-cfbb880cd3c6 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:28.386000 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-6ebef5d0-f6e4-481d-8b56-cfbb880cd3c6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:51:28.387051 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 359/717] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:51:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:28.392586 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779ea0b-64c1-45a2-9bb9-fd803716ddde admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:28.402105 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779ea0b-64c1-45a2-9bb9-fd803716ddde admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:28.406026 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3a229-ad98-4432-94d1-b475919efb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:28.406599 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3a229-ad98-4432-94d1-b475919efb75 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:28.406893 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3a229-ad98-4432-94d1-b475919efb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:28.407171 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3a229-ad98-4432-94d1-b475919efb75 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:28.407879 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3a229-ad98-4432-94d1-b475919efb75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:28.408176 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3a229-ad98-4432-94d1-b475919efb75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:28.433817 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3a229-ad98-4432-94d1-b475919efb75 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:28.446111 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 359/718] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:51:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:28.451120 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebef5d0-f6e4-481d-8b56-cfbb880cd3c6 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:28.460108 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebef5d0-f6e4-481d-8b56-cfbb880cd3c6 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:28.464586 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78ee6e-0a25-4085-8084-6a0948b83d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:28.465278 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78ee6e-0a25-4085-8084-6a0948b83d0f admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:28.465564 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78ee6e-0a25-4085-8084-6a0948b83d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:28.465843 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78ee6e-0a25-4085-8084-6a0948b83d0f admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:28.478574 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78ee6e-0a25-4085-8084-6a0948b83d0f admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:28.504421 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78ee6e-0a25-4085-8084-6a0948b83d0f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:28.521647 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-ff78ee6e-0a25-4085-8084-6a0948b83d0f admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 14:51:28.522677 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 360/719] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:51:28 2021] GET /identity/v3/users/cinder => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:28.528469 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3a229-ad98-4432-94d1-b475919efb75 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:28.537433 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3a229-ad98-4432-94d1-b475919efb75 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:28.541653 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb6b33-6f0c-40c5-9d92-540a0e85d1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:28.542245 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb6b33-6f0c-40c5-9d92-540a0e85d1d5 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:28.542533 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb6b33-6f0c-40c5-9d92-540a0e85d1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:28.542808 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb6b33-6f0c-40c5-9d92-540a0e85d1d5 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:28.543616 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb6b33-6f0c-40c5-9d92-540a0e85d1d5 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:28.543962 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb6b33-6f0c-40c5-9d92-540a0e85d1d5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:28.569669 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb6b33-6f0c-40c5-9d92-540a0e85d1d5 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:28.598188 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 360/720] 10.222.0.89 () {56 vars in 1158 bytes} [Wed Oct 27 14:51:28 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:51:28.603589 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78ee6e-0a25-4085-8084-6a0948b83d0f admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:28.613269 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78ee6e-0a25-4085-8084-6a0948b83d0f admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:28.617196 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f81c54-1452-41be-91aa-84369841a7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:28.617757 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f81c54-1452-41be-91aa-84369841a7fc admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:28.618040 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f81c54-1452-41be-91aa-84369841a7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:28.618313 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f81c54-1452-41be-91aa-84369841a7fc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:28.625841 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f81c54-1452-41be-91aa-84369841a7fc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:28.650741 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f81c54-1452-41be-91aa-84369841a7fc admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:28.659448 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 361/721] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:51:28 2021] GET /identity/v3/auth/tokens => generated 1861 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:51:28.664804 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb6b33-6f0c-40c5-9d92-540a0e85d1d5 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:28.674309 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb6b33-6f0c-40c5-9d92-540a0e85d1d5 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:28.678239 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4d44a-1fc7-4076-b757-40b829479139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:28.678936 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4d44a-1fc7-4076-b757-40b829479139 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:28.679225 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4d44a-1fc7-4076-b757-40b829479139 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:28.679534 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c4d44a-1fc7-4076-b757-40b829479139 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:28.690758 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4d44a-1fc7-4076-b757-40b829479139 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:28.716369 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c4d44a-1fc7-4076-b757-40b829479139 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:28.733277 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-68c4d44a-1fc7-4076-b757-40b829479139 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:51:28.734302 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 361/722] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:51:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:28.739496 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f81c54-1452-41be-91aa-84369841a7fc admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:28.747802 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f81c54-1452-41be-91aa-84369841a7fc admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:28.751826 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8eed7-d76e-4ba9-833b-43d796493ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:28.752393 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8eed7-d76e-4ba9-833b-43d796493ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:28.752678 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8eed7-d76e-4ba9-833b-43d796493ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:28.752961 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8eed7-d76e-4ba9-833b-43d796493ea9 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:28.753633 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8eed7-d76e-4ba9-833b-43d796493ea9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:28.753929 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8eed7-d76e-4ba9-833b-43d796493ea9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:28.779852 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8eed7-d76e-4ba9-833b-43d796493ea9 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:28.793904 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 362/723] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:51:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:28.798891 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4d44a-1fc7-4076-b757-40b829479139 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:28.807669 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c4d44a-1fc7-4076-b757-40b829479139 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:28.811565 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55eccda-7112-4462-a9cb-cccd70d2ac35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:28.812242 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55eccda-7112-4462-a9cb-cccd70d2ac35 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:28.812521 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55eccda-7112-4462-a9cb-cccd70d2ac35 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:28.812792 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55eccda-7112-4462-a9cb-cccd70d2ac35 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:28.821374 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55eccda-7112-4462-a9cb-cccd70d2ac35 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:28.847683 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55eccda-7112-4462-a9cb-cccd70d2ac35 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:28.861006 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-c55eccda-7112-4462-a9cb-cccd70d2ac35 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:51:28.862006 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 362/724] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:51:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 14:51:28.867684 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8eed7-d76e-4ba9-833b-43d796493ea9 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:28.876841 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8eed7-d76e-4ba9-833b-43d796493ea9 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:28.880787 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21249ee8-12d6-4bcc-903a-5138af8ffc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:28.881362 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21249ee8-12d6-4bcc-903a-5138af8ffc8c admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:28.881646 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21249ee8-12d6-4bcc-903a-5138af8ffc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:28.881924 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21249ee8-12d6-4bcc-903a-5138af8ffc8c admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:28.882663 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21249ee8-12d6-4bcc-903a-5138af8ffc8c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:28.882962 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21249ee8-12d6-4bcc-903a-5138af8ffc8c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:28.909002 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21249ee8-12d6-4bcc-903a-5138af8ffc8c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:28.921876 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 363/725] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:51:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:28.927201 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55eccda-7112-4462-a9cb-cccd70d2ac35 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:28.936041 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55eccda-7112-4462-a9cb-cccd70d2ac35 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:28.939903 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a3a8f-f12d-4a2f-b394-adcd67869100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:28.940459 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a3a8f-f12d-4a2f-b394-adcd67869100 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:28.940741 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a3a8f-f12d-4a2f-b394-adcd67869100 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:28.941013 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a3a8f-f12d-4a2f-b394-adcd67869100 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:28.941773 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a3a8f-f12d-4a2f-b394-adcd67869100 admin admin] RBAC: Adding query filter params (role.id=0af8b2c9076246e6ac61d13d88d91976, scope.project.id=f79f19c59cfd43c48871b51d6aaf501f, user.id=0fca8f0282ea40ce9b378260b95b3d01) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:28.942068 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a3a8f-f12d-4a2f-b394-adcd67869100 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:28.968035 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a3a8f-f12d-4a2f-b394-adcd67869100 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:28.973422 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 363/726] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:51:28 2021] GET /identity/v3/role_assignments?user.id=0fca8f0282ea40ce9b378260b95b3d01&scope.project.id=f79f19c59cfd43c48871b51d6aaf501f&role.id=0af8b2c9076246e6ac61d13d88d91976 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:30.926255 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c2cd6-4949-46b2-81e8-c9104c001ee5 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:30.926814 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c2cd6-4949-46b2-81e8-c9104c001ee5 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:30.926814 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c2cd6-4949-46b2-81e8-c9104c001ee5 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:30.928490 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 364/727] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:51:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:51:30.934229 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a193b-2aff-4052-be21-ac3c1cbec35f None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:30.934644 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a193b-2aff-4052-be21-ac3c1cbec35f None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:30.934791 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a193b-2aff-4052-be21-ac3c1cbec35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:30.957430 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-423a193b-2aff-4052-be21-ac3c1cbec35f None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:51:30.958554 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-423a193b-2aff-4052-be21-ac3c1cbec35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:51:30.965169 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 364/728] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:51:30 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:51:30.986206 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c2cd6-4949-46b2-81e8-c9104c001ee5 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:30.998018 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c2cd6-4949-46b2-81e8-c9104c001ee5 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:31.001821 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92983222-cd49-48d0-b593-8be2c78e2628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:31.002528 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92983222-cd49-48d0-b593-8be2c78e2628 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:31.002806 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92983222-cd49-48d0-b593-8be2c78e2628 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:31.003081 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92983222-cd49-48d0-b593-8be2c78e2628 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:31.003716 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92983222-cd49-48d0-b593-8be2c78e2628 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:31.028215 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92983222-cd49-48d0-b593-8be2c78e2628 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:31.038619 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-92983222-cd49-48d0-b593-8be2c78e2628 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 14:51:31.039743 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 365/729] 10.222.0.89 () {56 vars in 1150 bytes} [Wed Oct 27 14:51:30 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:31.045520 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a193b-2aff-4052-be21-ac3c1cbec35f None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:31.053766 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423a193b-2aff-4052-be21-ac3c1cbec35f None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:31.057713 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724bd478-9b67-4800-a94a-3fd4ba0b3d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:31.058825 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bd478-9b67-4800-a94a-3fd4ba0b3d4a admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:31.059109 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bd478-9b67-4800-a94a-3fd4ba0b3d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:31.059391 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bd478-9b67-4800-a94a-3fd4ba0b3d4a admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:31.060083 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724bd478-9b67-4800-a94a-3fd4ba0b3d4a admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:31.060379 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724bd478-9b67-4800-a94a-3fd4ba0b3d4a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:31.085082 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724bd478-9b67-4800-a94a-3fd4ba0b3d4a admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:31.089388 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 365/730] 10.222.0.89 () {56 vars in 1145 bytes} [Wed Oct 27 14:51:31 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:51:31.094268 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92983222-cd49-48d0-b593-8be2c78e2628 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:31.103032 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92983222-cd49-48d0-b593-8be2c78e2628 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:31.107468 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbefedc6-f2de-495b-9be4-30353e9e70a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:31.108026 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefedc6-f2de-495b-9be4-30353e9e70a3 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:31.108305 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefedc6-f2de-495b-9be4-30353e9e70a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:31.108580 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbefedc6-f2de-495b-9be4-30353e9e70a3 admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:31.109224 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbefedc6-f2de-495b-9be4-30353e9e70a3 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:31.109511 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbefedc6-f2de-495b-9be4-30353e9e70a3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:31.134491 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbefedc6-f2de-495b-9be4-30353e9e70a3 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:31.138653 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 366/731] 10.222.0.89 () {56 vars in 1145 bytes} [Wed Oct 27 14:51:31 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:33.067204 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6852e-4df4-4c4c-ae2c-9e1615be1a78 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:33.067760 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6852e-4df4-4c4c-ae2c-9e1615be1a78 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:33.067760 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6852e-4df4-4c4c-ae2c-9e1615be1a78 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:33.069425 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 366/732] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:51:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:51:33.074939 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68158c79-a5b1-4d43-bbf2-bc31a278eb5a None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:33.075314 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68158c79-a5b1-4d43-bbf2-bc31a278eb5a None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:33.075518 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68158c79-a5b1-4d43-bbf2-bc31a278eb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:33.097240 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-68158c79-a5b1-4d43-bbf2-bc31a278eb5a None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:51:33.098370 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-68158c79-a5b1-4d43-bbf2-bc31a278eb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:51:33.104980 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 367/733] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:51:33 2021] POST /identity/v3/auth/tokens => generated 1861 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:51:33.126423 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6852e-4df4-4c4c-ae2c-9e1615be1a78 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:33.138138 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6852e-4df4-4c4c-ae2c-9e1615be1a78 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:33.141936 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e9f920-b51e-4c1c-9c22-bd14dfdc5fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:33.142497 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9f920-b51e-4c1c-9c22-bd14dfdc5fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:33.142779 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9f920-b51e-4c1c-9c22-bd14dfdc5fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:33.143054 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e9f920-b51e-4c1c-9c22-bd14dfdc5fe2 admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:33.143756 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e9f920-b51e-4c1c-9c22-bd14dfdc5fe2 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:33.168546 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e9f920-b51e-4c1c-9c22-bd14dfdc5fe2 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:33.180347 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 367/734] 10.222.0.89 () {60 vars in 1162 bytes} [Wed Oct 27 14:51:33 2021] POST /identity/v3/services => generated 251 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:51:35.125854 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb0da3-ffa6-447c-917a-545183be784b None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:35.126435 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb0da3-ffa6-447c-917a-545183be784b None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:35.126435 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb0da3-ffa6-447c-917a-545183be784b None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:35.128085 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 368/735] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:51:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:51:35.133185 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48414242-5c9c-489e-a1e6-09bc9554facc None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:35.133576 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48414242-5c9c-489e-a1e6-09bc9554facc None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:35.133750 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48414242-5c9c-489e-a1e6-09bc9554facc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:35.157472 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-48414242-5c9c-489e-a1e6-09bc9554facc None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:51:35.158592 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-48414242-5c9c-489e-a1e6-09bc9554facc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:51:35.174468 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 368/736] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:51:35 2021] POST /identity/v3/auth/tokens => generated 1965 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:51:35.196357 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb0da3-ffa6-447c-917a-545183be784b None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:35.209243 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb0da3-ffa6-447c-917a-545183be784b None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:35.213186 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2333e8-1e08-41eb-9b8c-981b5f703dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:35.214009 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2333e8-1e08-41eb-9b8c-981b5f703dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:35.214301 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2333e8-1e08-41eb-9b8c-981b5f703dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:35.214583 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2333e8-1e08-41eb-9b8c-981b5f703dc7 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:35.215211 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2333e8-1e08-41eb-9b8c-981b5f703dc7 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:35.240164 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2333e8-1e08-41eb-9b8c-981b5f703dc7 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:35.251388 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-4a2333e8-1e08-41eb-9b8c-981b5f703dc7 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 14:51:35.252482 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 369/737] 10.222.0.89 () {56 vars in 1150 bytes} [Wed Oct 27 14:51:35 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:35.258316 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48414242-5c9c-489e-a1e6-09bc9554facc None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:35.267529 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48414242-5c9c-489e-a1e6-09bc9554facc None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:35.271515 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deccd35-c407-4cff-9c18-750bbc346f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:35.272100 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deccd35-c407-4cff-9c18-750bbc346f1a admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:35.272389 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deccd35-c407-4cff-9c18-750bbc346f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:35.272668 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deccd35-c407-4cff-9c18-750bbc346f1a admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:35.273332 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deccd35-c407-4cff-9c18-750bbc346f1a admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:35.273628 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deccd35-c407-4cff-9c18-750bbc346f1a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:35.298902 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deccd35-c407-4cff-9c18-750bbc346f1a admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:35.303279 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 369/738] 10.222.0.89 () {56 vars in 1145 bytes} [Wed Oct 27 14:51:35 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:35.309055 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2333e8-1e08-41eb-9b8c-981b5f703dc7 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:35.318092 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2333e8-1e08-41eb-9b8c-981b5f703dc7 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:35.322189 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7d2a4-a28a-406a-8c7c-cf7f6d5478eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:35.322763 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7d2a4-a28a-406a-8c7c-cf7f6d5478eb admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:35.323051 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7d2a4-a28a-406a-8c7c-cf7f6d5478eb admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:35.324009 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7d2a4-a28a-406a-8c7c-cf7f6d5478eb admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:35.324670 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7d2a4-a28a-406a-8c7c-cf7f6d5478eb admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:35.324968 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7d2a4-a28a-406a-8c7c-cf7f6d5478eb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:35.349517 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7d2a4-a28a-406a-8c7c-cf7f6d5478eb admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:35.353999 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 370/739] 10.222.0.89 () {56 vars in 1145 bytes} [Wed Oct 27 14:51:35 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:51:35.359215 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deccd35-c407-4cff-9c18-750bbc346f1a admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:35.367991 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deccd35-c407-4cff-9c18-750bbc346f1a admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:35.372403 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b83b38-76e3-4a8e-9333-63923fbfdf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:35.372955 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b83b38-76e3-4a8e-9333-63923fbfdf9b admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:35.373236 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b83b38-76e3-4a8e-9333-63923fbfdf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:35.373511 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b83b38-76e3-4a8e-9333-63923fbfdf9b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:35.374234 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b83b38-76e3-4a8e-9333-63923fbfdf9b admin admin] RBAC: Adding query filter params (interface=public, service_id=3383b88fed1946d3a6b8f6f7dd9ae724, region_id=RegionOne) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:35.374528 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b83b38-76e3-4a8e-9333-63923fbfdf9b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:35.399569 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b83b38-76e3-4a8e-9333-63923fbfdf9b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:35.404460 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 370/740] 10.222.0.89 () {56 vars in 1272 bytes} [Wed Oct 27 14:51:35 2021] GET /identity/v3/endpoints?service_id=3383b88fed1946d3a6b8f6f7dd9ae724&interface=public®ion_id=RegionOne => generated 194 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:35.409307 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7d2a4-a28a-406a-8c7c-cf7f6d5478eb admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:35.418253 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7d2a4-a28a-406a-8c7c-cf7f6d5478eb admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:35.422463 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d430a-9fb0-4daf-b905-ac03e18feb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:35.423022 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d430a-9fb0-4daf-b905-ac03e18feb29 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:35.423308 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d430a-9fb0-4daf-b905-ac03e18feb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:35.423626 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d430a-9fb0-4daf-b905-ac03e18feb29 admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:35.424263 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d430a-9fb0-4daf-b905-ac03e18feb29 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:35.449817 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d430a-9fb0-4daf-b905-ac03e18feb29 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:35.455130 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 371/741] 10.222.0.89 () {56 vars in 1108 bytes} [Wed Oct 27 14:51:35 2021] GET /identity/v3/services => generated 1261 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:51:37.385465 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b35260-557b-4894-b88f-c4fe006527f7 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:37.385996 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b35260-557b-4894-b88f-c4fe006527f7 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:37.386085 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b35260-557b-4894-b88f-c4fe006527f7 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:37.387745 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 371/742] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:51:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:51:37.392847 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12268227-a7e9-4404-a63b-22c9172958fd None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:37.393214 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12268227-a7e9-4404-a63b-22c9172958fd None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:37.393416 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12268227-a7e9-4404-a63b-22c9172958fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:37.416049 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-12268227-a7e9-4404-a63b-22c9172958fd None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:51:37.417769 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-12268227-a7e9-4404-a63b-22c9172958fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:51:37.424464 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 372/743] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:51:37 2021] POST /identity/v3/auth/tokens => generated 1965 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:51:37.445911 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b35260-557b-4894-b88f-c4fe006527f7 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:37.457159 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b35260-557b-4894-b88f-c4fe006527f7 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:37.460968 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b009852-7a5a-4374-8791-b2b64dc2aaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:37.461677 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b009852-7a5a-4374-8791-b2b64dc2aaee admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:37.461962 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b009852-7a5a-4374-8791-b2b64dc2aaee admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:37.462237 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b009852-7a5a-4374-8791-b2b64dc2aaee admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:37.462850 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b009852-7a5a-4374-8791-b2b64dc2aaee admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:37.488673 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b009852-7a5a-4374-8791-b2b64dc2aaee admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:37.499088 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-8b009852-7a5a-4374-8791-b2b64dc2aaee admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 14:51:37.500136 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 372/744] 10.222.0.89 () {56 vars in 1150 bytes} [Wed Oct 27 14:51:37 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:37.505585 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12268227-a7e9-4404-a63b-22c9172958fd None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:37.513995 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12268227-a7e9-4404-a63b-22c9172958fd None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:37.517898 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee5987-eba1-4981-9045-d8c276743991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:37.518481 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee5987-eba1-4981-9045-d8c276743991 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:37.518768 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee5987-eba1-4981-9045-d8c276743991 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:37.519047 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ee5987-eba1-4981-9045-d8c276743991 admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:37.519754 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee5987-eba1-4981-9045-d8c276743991 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:37.520052 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee5987-eba1-4981-9045-d8c276743991 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:37.546133 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ee5987-eba1-4981-9045-d8c276743991 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:37.550574 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 373/745] 10.222.0.89 () {56 vars in 1145 bytes} [Wed Oct 27 14:51:37 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:37.555743 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b009852-7a5a-4374-8791-b2b64dc2aaee admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:37.564589 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b009852-7a5a-4374-8791-b2b64dc2aaee admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:37.568482 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ae4f4-d45b-4866-8578-902fc7d21607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:37.569045 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ae4f4-d45b-4866-8578-902fc7d21607 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:37.569330 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ae4f4-d45b-4866-8578-902fc7d21607 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:37.569609 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ae4f4-d45b-4866-8578-902fc7d21607 admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:37.570263 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ae4f4-d45b-4866-8578-902fc7d21607 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:37.570558 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ae4f4-d45b-4866-8578-902fc7d21607 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:37.595731 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ae4f4-d45b-4866-8578-902fc7d21607 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:37.600162 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 373/746] 10.222.0.89 () {56 vars in 1145 bytes} [Wed Oct 27 14:51:37 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:37.605806 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee5987-eba1-4981-9045-d8c276743991 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:37.614564 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ee5987-eba1-4981-9045-d8c276743991 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:37.618484 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93783424-cfbd-43bb-8bec-5495cc93d89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:37.619039 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93783424-cfbd-43bb-8bec-5495cc93d89f admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:37.619325 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93783424-cfbd-43bb-8bec-5495cc93d89f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:37.619638 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93783424-cfbd-43bb-8bec-5495cc93d89f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:37.620363 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93783424-cfbd-43bb-8bec-5495cc93d89f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:37.644846 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93783424-cfbd-43bb-8bec-5495cc93d89f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:37.662810 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 374/747] 10.222.0.89 () {60 vars in 1165 bytes} [Wed Oct 27 14:51:37 2021] POST /identity/v3/endpoints => generated 346 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:51:39.632446 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad206aa5-feb7-4c5d-b3d5-38b0c3f7ad9c None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:39.632962 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad206aa5-feb7-4c5d-b3d5-38b0c3f7ad9c None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:39.632962 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad206aa5-feb7-4c5d-b3d5-38b0c3f7ad9c None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:39.634565 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 374/748] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:51:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:51:39.640249 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a965b6-2908-4a63-84b6-a842658101f9 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:39.640635 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a965b6-2908-4a63-84b6-a842658101f9 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:39.640810 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a965b6-2908-4a63-84b6-a842658101f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:39.662786 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-c6a965b6-2908-4a63-84b6-a842658101f9 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:51:39.663929 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-c6a965b6-2908-4a63-84b6-a842658101f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:51:39.680410 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 375/749] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:51:39 2021] POST /identity/v3/auth/tokens => generated 2151 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:51:39.702748 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad206aa5-feb7-4c5d-b3d5-38b0c3f7ad9c None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:39.713937 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad206aa5-feb7-4c5d-b3d5-38b0c3f7ad9c None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:39.717731 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441dbbd-ec00-43d3-b0c9-f88b84ff50d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:39.718434 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441dbbd-ec00-43d3-b0c9-f88b84ff50d4 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:39.718718 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441dbbd-ec00-43d3-b0c9-f88b84ff50d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:39.718993 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441dbbd-ec00-43d3-b0c9-f88b84ff50d4 admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:39.719636 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441dbbd-ec00-43d3-b0c9-f88b84ff50d4 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:39.744283 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441dbbd-ec00-43d3-b0c9-f88b84ff50d4 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:39.754814 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-1441dbbd-ec00-43d3-b0c9-f88b84ff50d4 admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Oct 27 14:51:39.755863 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 375/750] 10.222.0.89 () {56 vars in 1135 bytes} [Wed Oct 27 14:51:39 2021] GET /identity/v3/services/volumev2 => generated 89 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 14:51:39.761991 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a965b6-2908-4a63-84b6-a842658101f9 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:39.770334 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a965b6-2908-4a63-84b6-a842658101f9 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:39.774266 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a5a47-2acf-45bd-b672-1e8b16f54cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:39.774848 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a5a47-2acf-45bd-b672-1e8b16f54cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:39.775135 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a5a47-2acf-45bd-b672-1e8b16f54cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:39.775414 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a5a47-2acf-45bd-b672-1e8b16f54cd2 admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:39.776111 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a5a47-2acf-45bd-b672-1e8b16f54cd2 admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:39.776516 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a5a47-2acf-45bd-b672-1e8b16f54cd2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:39.801523 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a5a47-2acf-45bd-b672-1e8b16f54cd2 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:39.805882 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 376/751] 10.222.0.89 () {56 vars in 1135 bytes} [Wed Oct 27 14:51:39 2021] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:39.811705 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441dbbd-ec00-43d3-b0c9-f88b84ff50d4 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:39.821320 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441dbbd-ec00-43d3-b0c9-f88b84ff50d4 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:39.825741 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232f04cc-7a45-4e2b-9ebc-e181c0e1d391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:39.826297 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f04cc-7a45-4e2b-9ebc-e181c0e1d391 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:39.826576 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f04cc-7a45-4e2b-9ebc-e181c0e1d391 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:39.826848 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232f04cc-7a45-4e2b-9ebc-e181c0e1d391 admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:39.827535 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f04cc-7a45-4e2b-9ebc-e181c0e1d391 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:39.827827 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f04cc-7a45-4e2b-9ebc-e181c0e1d391 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:39.852619 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232f04cc-7a45-4e2b-9ebc-e181c0e1d391 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:39.856705 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 376/752] 10.222.0.89 () {56 vars in 1135 bytes} [Wed Oct 27 14:51:39 2021] GET /identity/v3/services?type=volumev2 => generated 125 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:51:41.773394 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30510a-2768-44c6-b406-ae54b9d79bc7 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:41.773917 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30510a-2768-44c6-b406-ae54b9d79bc7 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:41.774029 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30510a-2768-44c6-b406-ae54b9d79bc7 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:41.775764 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 377/753] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:51:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:51:41.780831 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17a9b3-effe-4e12-b656-361883e99c44 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:41.781222 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17a9b3-effe-4e12-b656-361883e99c44 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:41.781395 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd17a9b3-effe-4e12-b656-361883e99c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:41.803762 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-cd17a9b3-effe-4e12-b656-361883e99c44 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:51:41.804887 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-cd17a9b3-effe-4e12-b656-361883e99c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:51:41.812070 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 377/754] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:51:41 2021] POST /identity/v3/auth/tokens => generated 2151 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:51:41.833109 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30510a-2768-44c6-b406-ae54b9d79bc7 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:41.844827 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30510a-2768-44c6-b406-ae54b9d79bc7 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:41.848664 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44310015-1366-452c-9232-1e6406098484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:41.849234 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44310015-1366-452c-9232-1e6406098484 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:41.849520 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44310015-1366-452c-9232-1e6406098484 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:41.849795 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44310015-1366-452c-9232-1e6406098484 admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:41.850467 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44310015-1366-452c-9232-1e6406098484 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:41.875723 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44310015-1366-452c-9232-1e6406098484 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:41.888533 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 378/755] 10.222.0.89 () {60 vars in 1162 bytes} [Wed Oct 27 14:51:41 2021] POST /identity/v3/services => generated 251 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:51:43.827222 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905503d-0612-41d5-99d4-2bfa0a7c2df0 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:43.827777 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905503d-0612-41d5-99d4-2bfa0a7c2df0 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:43.827861 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905503d-0612-41d5-99d4-2bfa0a7c2df0 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:43.829465 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 378/756] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:51:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:51:43.834530 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634d84d-19e0-4867-b80e-c0bd313fbb74 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:43.834960 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634d84d-19e0-4867-b80e-c0bd313fbb74 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:43.835102 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634d84d-19e0-4867-b80e-c0bd313fbb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:43.857601 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-9634d84d-19e0-4867-b80e-c0bd313fbb74 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:51:43.858720 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-9634d84d-19e0-4867-b80e-c0bd313fbb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:51:43.874551 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 379/757] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:51:43 2021] POST /identity/v3/auth/tokens => generated 2252 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:51:43.896100 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905503d-0612-41d5-99d4-2bfa0a7c2df0 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:43.907964 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a905503d-0612-41d5-99d4-2bfa0a7c2df0 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:43.911800 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeaaef3-806f-4afd-a86d-c263d9fb1b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:43.912771 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeaaef3-806f-4afd-a86d-c263d9fb1b10 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:43.913055 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeaaef3-806f-4afd-a86d-c263d9fb1b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:43.913332 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeaaef3-806f-4afd-a86d-c263d9fb1b10 admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:43.913948 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeaaef3-806f-4afd-a86d-c263d9fb1b10 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:43.938896 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeaaef3-806f-4afd-a86d-c263d9fb1b10 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:43.949621 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-1aeaaef3-806f-4afd-a86d-c263d9fb1b10 admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Oct 27 14:51:43.950650 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 379/758] 10.222.0.89 () {56 vars in 1135 bytes} [Wed Oct 27 14:51:43 2021] GET /identity/v3/services/volumev2 => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:43.956208 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634d84d-19e0-4867-b80e-c0bd313fbb74 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:43.965326 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634d84d-19e0-4867-b80e-c0bd313fbb74 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:43.969409 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655299e0-d259-492d-8a4d-36f854f6a238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:43.969995 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655299e0-d259-492d-8a4d-36f854f6a238 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:43.970286 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655299e0-d259-492d-8a4d-36f854f6a238 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:43.970565 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655299e0-d259-492d-8a4d-36f854f6a238 admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:43.971239 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655299e0-d259-492d-8a4d-36f854f6a238 admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:43.971572 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655299e0-d259-492d-8a4d-36f854f6a238 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:43.996426 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655299e0-d259-492d-8a4d-36f854f6a238 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:44.001002 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 380/759] 10.222.0.89 () {56 vars in 1135 bytes} [Wed Oct 27 14:51:43 2021] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:44.006493 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeaaef3-806f-4afd-a86d-c263d9fb1b10 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:44.016019 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeaaef3-806f-4afd-a86d-c263d9fb1b10 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:44.019917 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ec7a8-8ee3-4cd8-8ff0-32d609e27433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:44.020491 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ec7a8-8ee3-4cd8-8ff0-32d609e27433 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:44.020775 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ec7a8-8ee3-4cd8-8ff0-32d609e27433 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:44.021050 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ec7a8-8ee3-4cd8-8ff0-32d609e27433 admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:44.021712 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ec7a8-8ee3-4cd8-8ff0-32d609e27433 admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:44.022011 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ec7a8-8ee3-4cd8-8ff0-32d609e27433 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:44.047665 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ec7a8-8ee3-4cd8-8ff0-32d609e27433 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:44.052145 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 380/760] 10.222.0.89 () {56 vars in 1135 bytes} [Wed Oct 27 14:51:44 2021] GET /identity/v3/services?type=volumev2 => generated 362 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:44.057432 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655299e0-d259-492d-8a4d-36f854f6a238 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:44.066345 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655299e0-d259-492d-8a4d-36f854f6a238 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:44.070295 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e0f08-1f5a-4b5e-9416-35545c996f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:44.070855 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e0f08-1f5a-4b5e-9416-35545c996f11 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:44.071140 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e0f08-1f5a-4b5e-9416-35545c996f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:44.071420 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e0f08-1f5a-4b5e-9416-35545c996f11 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:44.072188 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e0f08-1f5a-4b5e-9416-35545c996f11 admin admin] RBAC: Adding query filter params (interface=public, service_id=ed2955dff0dc4025a83fc18edb8373af, region_id=RegionOne) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:44.072488 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e0f08-1f5a-4b5e-9416-35545c996f11 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:44.098253 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e0f08-1f5a-4b5e-9416-35545c996f11 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:44.103171 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 381/761] 10.222.0.89 () {56 vars in 1272 bytes} [Wed Oct 27 14:51:44 2021] GET /identity/v3/endpoints?service_id=ed2955dff0dc4025a83fc18edb8373af&interface=public®ion_id=RegionOne => generated 194 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:44.108069 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ec7a8-8ee3-4cd8-8ff0-32d609e27433 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:44.116802 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ec7a8-8ee3-4cd8-8ff0-32d609e27433 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:44.121235 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf17770-cec7-45a6-ba6d-0d4488f7fedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:44.121791 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf17770-cec7-45a6-ba6d-0d4488f7fedc admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:44.122072 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf17770-cec7-45a6-ba6d-0d4488f7fedc admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:44.122343 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf17770-cec7-45a6-ba6d-0d4488f7fedc admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:44.122968 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf17770-cec7-45a6-ba6d-0d4488f7fedc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:44.148109 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf17770-cec7-45a6-ba6d-0d4488f7fedc admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:44.153721 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 381/762] 10.222.0.89 () {56 vars in 1108 bytes} [Wed Oct 27 14:51:44 2021] GET /identity/v3/services => generated 1500 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 14:51:46.112572 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9303a-4c6a-498a-9701-ab33f7ca6437 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:46.113096 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9303a-4c6a-498a-9701-ab33f7ca6437 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:46.113205 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e9303a-4c6a-498a-9701-ab33f7ca6437 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:46.114796 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 382/763] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:51:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:51:46.120557 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5c91a-04ea-49c5-bb23-efe703c81fe3 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:46.120972 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5c91a-04ea-49c5-bb23-efe703c81fe3 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:46.121120 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5c91a-04ea-49c5-bb23-efe703c81fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:46.142732 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-ccf5c91a-04ea-49c5-bb23-efe703c81fe3 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:51:46.143870 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-ccf5c91a-04ea-49c5-bb23-efe703c81fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:51:46.150351 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 382/764] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:51:46 2021] POST /identity/v3/auth/tokens => generated 2252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:51:46.172684 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9303a-4c6a-498a-9701-ab33f7ca6437 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:46.184697 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e9303a-4c6a-498a-9701-ab33f7ca6437 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:46.188534 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16437a-cc27-40f4-ab0a-ee0369baf0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:46.189238 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16437a-cc27-40f4-ab0a-ee0369baf0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:46.189523 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16437a-cc27-40f4-ab0a-ee0369baf0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:46.189800 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16437a-cc27-40f4-ab0a-ee0369baf0a2 admin admin] PATH_INFO: `/v3/services/volumev2` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:46.190416 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16437a-cc27-40f4-ab0a-ee0369baf0a2 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev2)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:46.215295 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16437a-cc27-40f4-ab0a-ee0369baf0a2 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:46.225484 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-af16437a-cc27-40f4-ab0a-ee0369baf0a2 admin admin] Could not find service: volumev2.: keystone.exception.ServiceNotFound: Could not find service: volumev2. Oct 27 14:51:46.226532 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 383/765] 10.222.0.89 () {56 vars in 1135 bytes} [Wed Oct 27 14:51:46 2021] GET /identity/v3/services/volumev2 => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:46.232474 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5c91a-04ea-49c5-bb23-efe703c81fe3 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:46.240843 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5c91a-04ea-49c5-bb23-efe703c81fe3 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:46.244775 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b084a-0041-470d-91ac-5ad5fd15525f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:46.245996 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b084a-0041-470d-91ac-5ad5fd15525f admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:46.246283 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b084a-0041-470d-91ac-5ad5fd15525f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:46.246558 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b084a-0041-470d-91ac-5ad5fd15525f admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:46.247223 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b084a-0041-470d-91ac-5ad5fd15525f admin admin] RBAC: Adding query filter params (name=volumev2) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:46.247553 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b084a-0041-470d-91ac-5ad5fd15525f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:46.272343 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b084a-0041-470d-91ac-5ad5fd15525f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:46.276940 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 383/766] 10.222.0.89 () {56 vars in 1135 bytes} [Wed Oct 27 14:51:46 2021] GET /identity/v3/services?name=volumev2 => generated 125 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:46.282249 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16437a-cc27-40f4-ab0a-ee0369baf0a2 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:46.291595 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16437a-cc27-40f4-ab0a-ee0369baf0a2 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:46.296050 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcd6cb5-c96e-45b9-a2a4-4892b9894bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:46.296626 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd6cb5-c96e-45b9-a2a4-4892b9894bfc admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:46.296913 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd6cb5-c96e-45b9-a2a4-4892b9894bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:46.297192 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcd6cb5-c96e-45b9-a2a4-4892b9894bfc admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:46.297858 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd6cb5-c96e-45b9-a2a4-4892b9894bfc admin admin] RBAC: Adding query filter params (type=volumev2) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:46.298155 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd6cb5-c96e-45b9-a2a4-4892b9894bfc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:46.323546 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcd6cb5-c96e-45b9-a2a4-4892b9894bfc admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:46.328090 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 384/767] 10.222.0.89 () {56 vars in 1135 bytes} [Wed Oct 27 14:51:46 2021] GET /identity/v3/services?type=volumev2 => generated 362 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:46.333033 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b084a-0041-470d-91ac-5ad5fd15525f admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:46.342418 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b084a-0041-470d-91ac-5ad5fd15525f admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:46.346303 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1420398-32b3-4cc8-96e4-56244601bb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:46.346861 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1420398-32b3-4cc8-96e4-56244601bb4b admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:46.347147 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1420398-32b3-4cc8-96e4-56244601bb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:46.347422 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1420398-32b3-4cc8-96e4-56244601bb4b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:46.348135 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1420398-32b3-4cc8-96e4-56244601bb4b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:46.373308 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1420398-32b3-4cc8-96e4-56244601bb4b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:46.391079 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 384/768] 10.222.0.89 () {60 vars in 1165 bytes} [Wed Oct 27 14:51:46 2021] POST /identity/v3/endpoints => generated 346 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:51:48.339110 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af3cab-49b9-435a-88c7-20563ee4d26d None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:48.339632 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af3cab-49b9-435a-88c7-20563ee4d26d None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:48.339719 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af3cab-49b9-435a-88c7-20563ee4d26d None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:48.341346 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 385/769] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:51:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:51:48.346453 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1b2f8-28c4-48d2-ac3c-0acbce54e140 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:48.346882 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1b2f8-28c4-48d2-ac3c-0acbce54e140 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:48.347013 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df1b2f8-28c4-48d2-ac3c-0acbce54e140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:48.369192 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-2df1b2f8-28c4-48d2-ac3c-0acbce54e140 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:51:48.370971 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-2df1b2f8-28c4-48d2-ac3c-0acbce54e140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:51:48.387365 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 385/770] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:51:48 2021] POST /identity/v3/auth/tokens => generated 2438 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:51:48.408440 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af3cab-49b9-435a-88c7-20563ee4d26d None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:48.420455 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af3cab-49b9-435a-88c7-20563ee4d26d None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:48.424343 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c2254-e1c9-48cb-8440-b2499bbc88ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:48.425048 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c2254-e1c9-48cb-8440-b2499bbc88ed admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:48.425334 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c2254-e1c9-48cb-8440-b2499bbc88ed admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:48.425612 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c2254-e1c9-48cb-8440-b2499bbc88ed admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:48.426254 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c2254-e1c9-48cb-8440-b2499bbc88ed admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:48.451638 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c2254-e1c9-48cb-8440-b2499bbc88ed admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:48.461650 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-2f1c2254-e1c9-48cb-8440-b2499bbc88ed admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 14:51:48.462671 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 386/771] 10.222.0.89 () {56 vars in 1135 bytes} [Wed Oct 27 14:51:48 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:48.468203 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1b2f8-28c4-48d2-ac3c-0acbce54e140 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:48.476420 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df1b2f8-28c4-48d2-ac3c-0acbce54e140 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:48.480914 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf8c84c-f04a-4955-8a19-43cf237b8828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:48.481490 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8c84c-f04a-4955-8a19-43cf237b8828 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:48.481774 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8c84c-f04a-4955-8a19-43cf237b8828 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:48.482051 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8c84c-f04a-4955-8a19-43cf237b8828 admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:48.482713 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8c84c-f04a-4955-8a19-43cf237b8828 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:48.483012 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8c84c-f04a-4955-8a19-43cf237b8828 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:48.508308 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf8c84c-f04a-4955-8a19-43cf237b8828 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:48.512732 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 386/772] 10.222.0.89 () {56 vars in 1135 bytes} [Wed Oct 27 14:51:48 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:48.517902 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c2254-e1c9-48cb-8440-b2499bbc88ed admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:48.527698 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c2254-e1c9-48cb-8440-b2499bbc88ed admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:48.531674 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51242d5-8bd1-4e19-8fdf-1383569fc109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:48.532229 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51242d5-8bd1-4e19-8fdf-1383569fc109 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:48.532515 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51242d5-8bd1-4e19-8fdf-1383569fc109 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:48.532791 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51242d5-8bd1-4e19-8fdf-1383569fc109 admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:48.533444 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51242d5-8bd1-4e19-8fdf-1383569fc109 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:48.533738 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51242d5-8bd1-4e19-8fdf-1383569fc109 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:48.559631 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51242d5-8bd1-4e19-8fdf-1383569fc109 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:48.563767 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 387/773] 10.222.0.89 () {56 vars in 1135 bytes} [Wed Oct 27 14:51:48 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:50.480967 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11da07f-3794-4062-aed5-a0562e1d7b09 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:50.481481 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11da07f-3794-4062-aed5-a0562e1d7b09 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:50.481565 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11da07f-3794-4062-aed5-a0562e1d7b09 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:50.483182 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 387/774] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:51:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:51:50.488110 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87564f8f-1c45-4f2a-ab16-8f8857df8d5a None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:50.488495 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87564f8f-1c45-4f2a-ab16-8f8857df8d5a None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:50.488667 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87564f8f-1c45-4f2a-ab16-8f8857df8d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:50.511036 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-87564f8f-1c45-4f2a-ab16-8f8857df8d5a None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:51:50.512125 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-87564f8f-1c45-4f2a-ab16-8f8857df8d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:51:50.518555 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 388/775] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:51:50 2021] POST /identity/v3/auth/tokens => generated 2438 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:51:50.539718 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11da07f-3794-4062-aed5-a0562e1d7b09 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:50.551377 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11da07f-3794-4062-aed5-a0562e1d7b09 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:50.555218 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e72cc9-632d-4ab4-8861-386c6d57283d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:50.555824 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e72cc9-632d-4ab4-8861-386c6d57283d admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:50.556109 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e72cc9-632d-4ab4-8861-386c6d57283d admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:50.556386 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e72cc9-632d-4ab4-8861-386c6d57283d admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:50.557060 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e72cc9-632d-4ab4-8861-386c6d57283d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:50.582455 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e72cc9-632d-4ab4-8861-386c6d57283d admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:50.595124 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 388/776] 10.222.0.89 () {60 vars in 1162 bytes} [Wed Oct 27 14:51:50 2021] POST /identity/v3/services => generated 251 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:51:52.543209 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e1639-6002-460e-a034-46c89f44bc39 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:52.543740 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e1639-6002-460e-a034-46c89f44bc39 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:52.543740 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e1639-6002-460e-a034-46c89f44bc39 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:52.545404 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 389/777] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:51:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:51:52.550586 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7971e-36ab-41b8-a0c8-1ceefcdabb80 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:52.550960 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7971e-36ab-41b8-a0c8-1ceefcdabb80 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:52.551147 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf7971e-36ab-41b8-a0c8-1ceefcdabb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:52.572679 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-3cf7971e-36ab-41b8-a0c8-1ceefcdabb80 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:51:52.573784 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-3cf7971e-36ab-41b8-a0c8-1ceefcdabb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:51:52.589958 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 389/778] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:51:52 2021] POST /identity/v3/auth/tokens => generated 2539 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:51:52.611462 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e1639-6002-460e-a034-46c89f44bc39 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:52.622897 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e1639-6002-460e-a034-46c89f44bc39 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:52.626765 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0579826-9925-40b8-bfa6-19b7be0d32d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:52.627492 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0579826-9925-40b8-bfa6-19b7be0d32d0 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:52.627783 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0579826-9925-40b8-bfa6-19b7be0d32d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:52.628061 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0579826-9925-40b8-bfa6-19b7be0d32d0 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:52.628681 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0579826-9925-40b8-bfa6-19b7be0d32d0 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:52.653941 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0579826-9925-40b8-bfa6-19b7be0d32d0 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:52.664377 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-e0579826-9925-40b8-bfa6-19b7be0d32d0 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 14:51:52.665400 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 390/779] 10.222.0.89 () {56 vars in 1135 bytes} [Wed Oct 27 14:51:52 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:52.671224 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7971e-36ab-41b8-a0c8-1ceefcdabb80 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:52.679394 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf7971e-36ab-41b8-a0c8-1ceefcdabb80 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:52.683310 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d7958-0e46-42d8-90ad-f7b0c7d50383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:52.683916 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d7958-0e46-42d8-90ad-f7b0c7d50383 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:52.684198 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d7958-0e46-42d8-90ad-f7b0c7d50383 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:52.684470 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d7958-0e46-42d8-90ad-f7b0c7d50383 admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:52.685125 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d7958-0e46-42d8-90ad-f7b0c7d50383 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:52.685417 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d7958-0e46-42d8-90ad-f7b0c7d50383 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:52.710586 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9d7958-0e46-42d8-90ad-f7b0c7d50383 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:52.715702 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 390/780] 10.222.0.89 () {56 vars in 1135 bytes} [Wed Oct 27 14:51:52 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:52.720888 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0579826-9925-40b8-bfa6-19b7be0d32d0 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:52.729813 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0579826-9925-40b8-bfa6-19b7be0d32d0 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:52.733773 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de932d-7b74-480f-ba11-9516e0440dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:52.734333 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de932d-7b74-480f-ba11-9516e0440dad admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:52.734620 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de932d-7b74-480f-ba11-9516e0440dad admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:52.734902 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de932d-7b74-480f-ba11-9516e0440dad admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:52.735593 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de932d-7b74-480f-ba11-9516e0440dad admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:52.735897 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de932d-7b74-480f-ba11-9516e0440dad admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:52.761070 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97de932d-7b74-480f-ba11-9516e0440dad admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:52.765551 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 391/781] 10.222.0.89 () {56 vars in 1135 bytes} [Wed Oct 27 14:51:52 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:52.770743 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d7958-0e46-42d8-90ad-f7b0c7d50383 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:52.779999 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d7958-0e46-42d8-90ad-f7b0c7d50383 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:52.783895 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f8551-67cd-42cb-becd-052c1d9046cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:52.784442 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f8551-67cd-42cb-becd-052c1d9046cb admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:52.784722 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f8551-67cd-42cb-becd-052c1d9046cb admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:52.784994 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f8551-67cd-42cb-becd-052c1d9046cb admin admin] PATH_INFO: `/v3/endpoints` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:52.785713 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f8551-67cd-42cb-becd-052c1d9046cb admin admin] RBAC: Adding query filter params (interface=public, service_id=9fb7a303c44647a9842d95d3852afca6, region_id=RegionOne) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:52.786012 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f8551-67cd-42cb-becd-052c1d9046cb admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:52.810708 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f8551-67cd-42cb-becd-052c1d9046cb admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:52.815684 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 391/782] 10.222.0.89 () {56 vars in 1272 bytes} [Wed Oct 27 14:51:52 2021] GET /identity/v3/endpoints?service_id=9fb7a303c44647a9842d95d3852afca6&interface=public®ion_id=RegionOne => generated 194 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:52.820346 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de932d-7b74-480f-ba11-9516e0440dad admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:52.829612 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de932d-7b74-480f-ba11-9516e0440dad admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:52.833678 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374ff16-716d-480f-8c9d-15e62e2b6ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:52.834232 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374ff16-716d-480f-8c9d-15e62e2b6ca7 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:52.834518 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374ff16-716d-480f-8c9d-15e62e2b6ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:52.834797 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374ff16-716d-480f-8c9d-15e62e2b6ca7 admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:52.835427 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374ff16-716d-480f-8c9d-15e62e2b6ca7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:52.860569 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3374ff16-716d-480f-8c9d-15e62e2b6ca7 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:52.866545 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 392/783] 10.222.0.89 () {56 vars in 1108 bytes} [Wed Oct 27 14:51:52 2021] GET /identity/v3/services => generated 1739 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:51:54.787606 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d74a1-6554-4294-a458-7ba5e10f5b08 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:54.788124 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d74a1-6554-4294-a458-7ba5e10f5b08 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:54.788238 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d74a1-6554-4294-a458-7ba5e10f5b08 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:54.789831 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 392/784] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:51:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:51:54.794944 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec965a29-aa5b-4b84-b711-f6139364e639 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:54.795346 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec965a29-aa5b-4b84-b711-f6139364e639 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:54.795557 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec965a29-aa5b-4b84-b711-f6139364e639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:54.818030 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-ec965a29-aa5b-4b84-b711-f6139364e639 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:51:54.819163 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-ec965a29-aa5b-4b84-b711-f6139364e639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:51:54.826503 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 393/785] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:51:54 2021] POST /identity/v3/auth/tokens => generated 2539 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:51:54.847831 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d74a1-6554-4294-a458-7ba5e10f5b08 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:54.859145 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d74a1-6554-4294-a458-7ba5e10f5b08 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:54.863016 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdda67d-916c-48d5-8813-370d74ef24c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:54.863749 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdda67d-916c-48d5-8813-370d74ef24c9 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:54.864040 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdda67d-916c-48d5-8813-370d74ef24c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:54.864320 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdda67d-916c-48d5-8813-370d74ef24c9 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:54.864935 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdda67d-916c-48d5-8813-370d74ef24c9 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:54.890822 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdda67d-916c-48d5-8813-370d74ef24c9 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:54.900980 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-4cdda67d-916c-48d5-8813-370d74ef24c9 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 14:51:54.902016 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 393/786] 10.222.0.89 () {56 vars in 1135 bytes} [Wed Oct 27 14:51:54 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:54.907353 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec965a29-aa5b-4b84-b711-f6139364e639 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:54.915982 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec965a29-aa5b-4b84-b711-f6139364e639 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:54.920114 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7845e2a-bce8-4405-8aa8-a83007843305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:54.920695 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7845e2a-bce8-4405-8aa8-a83007843305 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:54.920983 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7845e2a-bce8-4405-8aa8-a83007843305 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:54.921262 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7845e2a-bce8-4405-8aa8-a83007843305 admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:54.921931 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7845e2a-bce8-4405-8aa8-a83007843305 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:54.922225 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7845e2a-bce8-4405-8aa8-a83007843305 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:54.947514 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7845e2a-bce8-4405-8aa8-a83007843305 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:54.952638 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 394/787] 10.222.0.89 () {56 vars in 1135 bytes} [Wed Oct 27 14:51:54 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:54.957879 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdda67d-916c-48d5-8813-370d74ef24c9 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:54.966731 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdda67d-916c-48d5-8813-370d74ef24c9 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:54.970700 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb2ec0-606e-4fef-9b20-44cbac62da58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:54.971263 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb2ec0-606e-4fef-9b20-44cbac62da58 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:54.971588 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb2ec0-606e-4fef-9b20-44cbac62da58 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:54.971873 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb2ec0-606e-4fef-9b20-44cbac62da58 admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:54.972530 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb2ec0-606e-4fef-9b20-44cbac62da58 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:54.972832 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb2ec0-606e-4fef-9b20-44cbac62da58 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:54.998530 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fb2ec0-606e-4fef-9b20-44cbac62da58 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:55.003046 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 394/788] 10.222.0.89 () {56 vars in 1135 bytes} [Wed Oct 27 14:51:54 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:51:55.008181 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7845e2a-bce8-4405-8aa8-a83007843305 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:55.016991 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7845e2a-bce8-4405-8aa8-a83007843305 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:55.020966 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc0142-4202-4584-a2a8-e3f5b6d18689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:55.021517 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc0142-4202-4584-a2a8-e3f5b6d18689 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:55.021802 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc0142-4202-4584-a2a8-e3f5b6d18689 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:55.022079 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc0142-4202-4584-a2a8-e3f5b6d18689 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:55.022753 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc0142-4202-4584-a2a8-e3f5b6d18689 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:55.048108 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc0142-4202-4584-a2a8-e3f5b6d18689 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:55.065715 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 395/789] 10.222.0.89 () {60 vars in 1165 bytes} [Wed Oct 27 14:51:55 2021] POST /identity/v3/endpoints => generated 346 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:51:57.004134 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c61b4e-1009-4979-8749-5b962e3d5d3a None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:57.004691 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c61b4e-1009-4979-8749-5b962e3d5d3a None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:57.004691 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c61b4e-1009-4979-8749-5b962e3d5d3a None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:57.006335 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 395/790] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:51:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:51:57.011422 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eee7a9-cdc5-4583-b3f8-916b3b17127c None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:57.011878 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eee7a9-cdc5-4583-b3f8-916b3b17127c None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:57.012006 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eee7a9-cdc5-4583-b3f8-916b3b17127c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:57.034162 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-17eee7a9-cdc5-4583-b3f8-916b3b17127c None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:51:57.035264 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-17eee7a9-cdc5-4583-b3f8-916b3b17127c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:51:57.052086 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 396/791] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:51:57 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:51:57.073887 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c61b4e-1009-4979-8749-5b962e3d5d3a None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:57.085150 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c61b4e-1009-4979-8749-5b962e3d5d3a None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:57.089499 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34d4bc-8f8d-464c-a769-2e67dd57c405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:57.090064 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34d4bc-8f8d-464c-a769-2e67dd57c405 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:57.090349 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34d4bc-8f8d-464c-a769-2e67dd57c405 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:57.090625 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34d4bc-8f8d-464c-a769-2e67dd57c405 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:57.091268 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34d4bc-8f8d-464c-a769-2e67dd57c405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:57.116828 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34d4bc-8f8d-464c-a769-2e67dd57c405 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:57.118152 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.common [None req-0d34d4bc-8f8d-464c-a769-2e67dd57c405 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 27 14:51:57.136033 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.sql.core [None req-0d34d4bc-8f8d-464c-a769-2e67dd57c405 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 27 14:51:57.136033 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 27 14:51:57.136033 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [parameters: {'id': '64d846a73b64412d8478cf0d500112de', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 27 14:51:57.136033 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=65984) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Oct 27 14:51:57.149711 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-0d34d4bc-8f8d-464c-a769-2e67dd57c405 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 64d846a73b64412d8478cf0d500112de.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 64d846a73b64412d8478cf0d500112de. Oct 27 14:51:57.151405 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 396/792] 10.222.0.89 () {60 vars in 1161 bytes} [Wed Oct 27 14:51:57 2021] POST /identity/v3/projects => generated 262 bytes in 78 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:57.157400 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eee7a9-cdc5-4583-b3f8-916b3b17127c None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:57.166194 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eee7a9-cdc5-4583-b3f8-916b3b17127c None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:57.170809 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c9588-e0a0-4dc3-bad4-657dcb899890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:57.171544 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c9588-e0a0-4dc3-bad4-657dcb899890 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:57.171832 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c9588-e0a0-4dc3-bad4-657dcb899890 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:57.172109 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c9588-e0a0-4dc3-bad4-657dcb899890 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:57.179797 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c9588-e0a0-4dc3-bad4-657dcb899890 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:57.205429 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c9588-e0a0-4dc3-bad4-657dcb899890 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:57.219898 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-073c9588-e0a0-4dc3-bad4-657dcb899890 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:51:57.220957 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 397/793] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:51:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:57.226850 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34d4bc-8f8d-464c-a769-2e67dd57c405 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:57.236483 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34d4bc-8f8d-464c-a769-2e67dd57c405 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:57.240591 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f4d03-0afc-4662-bf37-aa4ea6471f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:57.241173 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f4d03-0afc-4662-bf37-aa4ea6471f05 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:57.241465 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f4d03-0afc-4662-bf37-aa4ea6471f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:57.241748 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f4d03-0afc-4662-bf37-aa4ea6471f05 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:57.242518 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f4d03-0afc-4662-bf37-aa4ea6471f05 admin admin] RBAC: Adding query filter params (name=service) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:57.242844 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f4d03-0afc-4662-bf37-aa4ea6471f05 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:57.268952 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f4d03-0afc-4662-bf37-aa4ea6471f05 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:57.285980 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 397/794] 10.222.0.89 () {56 vars in 1133 bytes} [Wed Oct 27 14:51:57 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:51:59.270366 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302146a9-90a6-4fb6-8b2a-c9792190913b None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:59.270819 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302146a9-90a6-4fb6-8b2a-c9792190913b None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:59.270930 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302146a9-90a6-4fb6-8b2a-c9792190913b None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:59.272632 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 398/795] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:51:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:51:59.277699 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541dffc-84fc-485e-959a-a9b65218a8ee None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:59.278107 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541dffc-84fc-485e-959a-a9b65218a8ee None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:59.278253 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0541dffc-84fc-485e-959a-a9b65218a8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:59.300182 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-0541dffc-84fc-485e-959a-a9b65218a8ee None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:51:59.301611 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-0541dffc-84fc-485e-959a-a9b65218a8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:51:59.308690 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 398/796] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:51:59 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:51:59.332081 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302146a9-90a6-4fb6-8b2a-c9792190913b None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:59.343379 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302146a9-90a6-4fb6-8b2a-c9792190913b None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:59.347241 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe6a5a-0f5c-4d90-a83b-54cfcd3b7cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:59.347847 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe6a5a-0f5c-4d90-a83b-54cfcd3b7cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:59.348133 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe6a5a-0f5c-4d90-a83b-54cfcd3b7cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:59.348409 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe6a5a-0f5c-4d90-a83b-54cfcd3b7cf8 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:59.349052 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe6a5a-0f5c-4d90-a83b-54cfcd3b7cf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:59.375128 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe6a5a-0f5c-4d90-a83b-54cfcd3b7cf8 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:59.376437 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.common [None req-febe6a5a-0f5c-4d90-a83b-54cfcd3b7cf8 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 27 14:51:59.388038 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.sql.core [None req-febe6a5a-0f5c-4d90-a83b-54cfcd3b7cf8 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 27 14:51:59.388038 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 27 14:51:59.388038 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [parameters: {'user_id': '214cf365696b4249a3e1a7fe073b7048', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 27 14:51:59.388038 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=65985) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Oct 27 14:51:59.400968 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-febe6a5a-0f5c-4d90-a83b-54cfcd3b7cf8 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 27 14:51:59.402153 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 399/797] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 14:51:59 2021] POST /identity/v3/users => generated 160 bytes in 70 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:59.408051 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541dffc-84fc-485e-959a-a9b65218a8ee None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:59.416781 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0541dffc-84fc-485e-959a-a9b65218a8ee None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:59.420768 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08865f9e-6153-41c0-9a88-a63f23d07473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:59.421476 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08865f9e-6153-41c0-9a88-a63f23d07473 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:59.421761 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08865f9e-6153-41c0-9a88-a63f23d07473 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:59.422034 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08865f9e-6153-41c0-9a88-a63f23d07473 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:59.434579 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08865f9e-6153-41c0-9a88-a63f23d07473 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:59.460569 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08865f9e-6153-41c0-9a88-a63f23d07473 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:59.477513 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-08865f9e-6153-41c0-9a88-a63f23d07473 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 14:51:59.478538 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 399/798] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:51:59 2021] GET /identity/v3/users/cinder => generated 84 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:51:59.484890 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe6a5a-0f5c-4d90-a83b-54cfcd3b7cf8 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:51:59.496759 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe6a5a-0f5c-4d90-a83b-54cfcd3b7cf8 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:51:59.500799 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0584f0f-5c6c-4dac-a6a2-c57f598c0b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:51:59.501378 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0584f0f-5c6c-4dac-a6a2-c57f598c0b14 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:51:59.501667 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0584f0f-5c6c-4dac-a6a2-c57f598c0b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:51:59.501949 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0584f0f-5c6c-4dac-a6a2-c57f598c0b14 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:51:59.502698 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0584f0f-5c6c-4dac-a6a2-c57f598c0b14 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:51:59.502997 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0584f0f-5c6c-4dac-a6a2-c57f598c0b14 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:51:59.528230 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0584f0f-5c6c-4dac-a6a2-c57f598c0b14 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:51:59.561122 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 400/799] 10.222.0.89 () {56 vars in 1122 bytes} [Wed Oct 27 14:51:59 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:01.595781 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23608789-0102-4c18-9118-eae203c33956 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:01.596270 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23608789-0102-4c18-9118-eae203c33956 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:01.596270 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23608789-0102-4c18-9118-eae203c33956 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:01.597930 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 400/800] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:52:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:52:01.603040 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4439bee-5a11-44c1-a7db-225ca5d34b51 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:01.603414 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4439bee-5a11-44c1-a7db-225ca5d34b51 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:01.603632 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4439bee-5a11-44c1-a7db-225ca5d34b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:01.626004 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-f4439bee-5a11-44c1-a7db-225ca5d34b51 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:52:01.627489 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-f4439bee-5a11-44c1-a7db-225ca5d34b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:52:01.634227 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 401/801] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:52:01 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:52:01.657690 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23608789-0102-4c18-9118-eae203c33956 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:01.669856 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23608789-0102-4c18-9118-eae203c33956 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:01.673654 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caeb8b7-41d0-496f-ba77-85cf50d723ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:01.674349 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caeb8b7-41d0-496f-ba77-85cf50d723ed admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:01.674631 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caeb8b7-41d0-496f-ba77-85cf50d723ed admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:01.674902 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caeb8b7-41d0-496f-ba77-85cf50d723ed admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:01.686865 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caeb8b7-41d0-496f-ba77-85cf50d723ed admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:01.712380 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caeb8b7-41d0-496f-ba77-85cf50d723ed admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:01.729107 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-6caeb8b7-41d0-496f-ba77-85cf50d723ed admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:52:01.730136 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 401/802] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:52:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:01.735978 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4439bee-5a11-44c1-a7db-225ca5d34b51 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:01.744457 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4439bee-5a11-44c1-a7db-225ca5d34b51 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:01.748435 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8cd921-fd2f-46d4-80b7-fa18cc23c9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:01.749044 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cd921-fd2f-46d4-80b7-fa18cc23c9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:01.749330 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cd921-fd2f-46d4-80b7-fa18cc23c9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:01.749609 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cd921-fd2f-46d4-80b7-fa18cc23c9c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:01.750295 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8cd921-fd2f-46d4-80b7-fa18cc23c9c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:01.750590 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8cd921-fd2f-46d4-80b7-fa18cc23c9c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:01.776320 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8cd921-fd2f-46d4-80b7-fa18cc23c9c8 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:01.788894 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 402/803] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:52:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:01.794038 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caeb8b7-41d0-496f-ba77-85cf50d723ed admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:01.802871 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caeb8b7-41d0-496f-ba77-85cf50d723ed admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:01.806756 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f313cc-2ef2-4cef-9db6-e7e5e5ead8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:01.807327 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f313cc-2ef2-4cef-9db6-e7e5e5ead8b1 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:01.807640 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f313cc-2ef2-4cef-9db6-e7e5e5ead8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:01.807914 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f313cc-2ef2-4cef-9db6-e7e5e5ead8b1 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:01.808544 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f313cc-2ef2-4cef-9db6-e7e5e5ead8b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:01.833963 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f313cc-2ef2-4cef-9db6-e7e5e5ead8b1 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:01.854158 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 402/804] 10.222.0.89 () {60 vars in 1153 bytes} [Wed Oct 27 14:52:01 2021] POST /identity/v3/users => generated 249 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:52:03.826594 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231f5a9-d5e0-4ead-8f86-37b609fb8f69 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:03.827115 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231f5a9-d5e0-4ead-8f86-37b609fb8f69 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:03.827221 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231f5a9-d5e0-4ead-8f86-37b609fb8f69 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:03.828871 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 403/805] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:52:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:52:03.833891 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65816d0a-7e83-4782-bf78-7290782a1b73 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:03.834323 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65816d0a-7e83-4782-bf78-7290782a1b73 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:03.834445 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65816d0a-7e83-4782-bf78-7290782a1b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:03.857655 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-65816d0a-7e83-4782-bf78-7290782a1b73 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:52:03.858788 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-65816d0a-7e83-4782-bf78-7290782a1b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:52:03.865333 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 403/806] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:52:03 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:52:03.888428 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231f5a9-d5e0-4ead-8f86-37b609fb8f69 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:03.899848 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231f5a9-d5e0-4ead-8f86-37b609fb8f69 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:03.903763 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfa81d-4486-4000-8d9e-10afbc7c310a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:03.904474 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfa81d-4486-4000-8d9e-10afbc7c310a admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:03.904762 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfa81d-4486-4000-8d9e-10afbc7c310a admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:03.905043 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfa81d-4486-4000-8d9e-10afbc7c310a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:03.916294 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cfa81d-4486-4000-8d9e-10afbc7c310a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:52:03.922575 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-46cfa81d-4486-4000-8d9e-10afbc7c310a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 14:52:03.923658 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 404/807] 10.222.0.89 () {56 vars in 1123 bytes} [Wed Oct 27 14:52:03 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:03.929159 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65816d0a-7e83-4782-bf78-7290782a1b73 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:03.937859 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65816d0a-7e83-4782-bf78-7290782a1b73 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:03.941805 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01697af4-91b3-43e7-a379-7f418cdc6b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:03.942410 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01697af4-91b3-43e7-a379-7f418cdc6b0a admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:03.942692 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01697af4-91b3-43e7-a379-7f418cdc6b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:03.942966 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01697af4-91b3-43e7-a379-7f418cdc6b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:03.943699 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01697af4-91b3-43e7-a379-7f418cdc6b0a admin admin] RBAC: Adding query filter params (name=service) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:03.943993 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01697af4-91b3-43e7-a379-7f418cdc6b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:03.969306 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01697af4-91b3-43e7-a379-7f418cdc6b0a admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:03.977384 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 404/808] 10.222.0.89 () {56 vars in 1124 bytes} [Wed Oct 27 14:52:03 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:03.983210 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfa81d-4486-4000-8d9e-10afbc7c310a admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:03.992822 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfa81d-4486-4000-8d9e-10afbc7c310a admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:03.997490 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3d6d0-f3a6-4fc5-8fb4-6f71f19c3817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:03.998187 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3d6d0-f3a6-4fc5-8fb4-6f71f19c3817 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:03.998477 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3d6d0-f3a6-4fc5-8fb4-6f71f19c3817 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:03.998755 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f3d6d0-f3a6-4fc5-8fb4-6f71f19c3817 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:04.009979 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f3d6d0-f3a6-4fc5-8fb4-6f71f19c3817 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:04.038460 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f3d6d0-f3a6-4fc5-8fb4-6f71f19c3817 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:04.055911 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-f6f3d6d0-f3a6-4fc5-8fb4-6f71f19c3817 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:52:04.057609 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 405/809] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:52:03 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:04.063188 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01697af4-91b3-43e7-a379-7f418cdc6b0a admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:04.072183 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01697af4-91b3-43e7-a379-7f418cdc6b0a admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:04.076210 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b6dcf-b33c-4227-8a96-5181ad401232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:04.076834 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b6dcf-b33c-4227-8a96-5181ad401232 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:04.077071 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b6dcf-b33c-4227-8a96-5181ad401232 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:04.077346 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b6dcf-b33c-4227-8a96-5181ad401232 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:04.078025 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b6dcf-b33c-4227-8a96-5181ad401232 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:04.078319 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b6dcf-b33c-4227-8a96-5181ad401232 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:04.103194 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b6dcf-b33c-4227-8a96-5181ad401232 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:04.115933 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 405/810] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:52:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:04.121693 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3d6d0-f3a6-4fc5-8fb4-6f71f19c3817 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:04.130685 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f3d6d0-f3a6-4fc5-8fb4-6f71f19c3817 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:04.134698 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c654bf-b3cf-4d9f-8e6f-73ee5f2b91f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:04.135396 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c654bf-b3cf-4d9f-8e6f-73ee5f2b91f3 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:04.135714 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c654bf-b3cf-4d9f-8e6f-73ee5f2b91f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:04.135994 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c654bf-b3cf-4d9f-8e6f-73ee5f2b91f3 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:04.148328 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c654bf-b3cf-4d9f-8e6f-73ee5f2b91f3 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:04.174737 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c654bf-b3cf-4d9f-8e6f-73ee5f2b91f3 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:04.192404 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-a6c654bf-b3cf-4d9f-8e6f-73ee5f2b91f3 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 27 14:52:04.193603 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 406/811] 10.222.0.89 () {56 vars in 1123 bytes} [Wed Oct 27 14:52:04 2021] GET /identity/v3/users/neutron => generated 85 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:04.199350 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b6dcf-b33c-4227-8a96-5181ad401232 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:04.208533 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b6dcf-b33c-4227-8a96-5181ad401232 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:04.212618 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92d37f-80c0-4de1-977e-d437cb84960c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:04.213205 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92d37f-80c0-4de1-977e-d437cb84960c admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:04.213498 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92d37f-80c0-4de1-977e-d437cb84960c admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:04.213777 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92d37f-80c0-4de1-977e-d437cb84960c admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:04.215462 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92d37f-80c0-4de1-977e-d437cb84960c admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:04.215778 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92d37f-80c0-4de1-977e-d437cb84960c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:04.242478 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92d37f-80c0-4de1-977e-d437cb84960c admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:04.271630 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 406/812] 10.222.0.89 () {56 vars in 1160 bytes} [Wed Oct 27 14:52:04 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:04.277174 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c654bf-b3cf-4d9f-8e6f-73ee5f2b91f3 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:04.286338 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c654bf-b3cf-4d9f-8e6f-73ee5f2b91f3 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:04.290521 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076347b6-d502-42e6-94f7-49aad8514c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:04.291089 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076347b6-d502-42e6-94f7-49aad8514c89 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:04.291901 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076347b6-d502-42e6-94f7-49aad8514c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:04.292179 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076347b6-d502-42e6-94f7-49aad8514c89 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:04.299733 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076347b6-d502-42e6-94f7-49aad8514c89 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:04.325235 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076347b6-d502-42e6-94f7-49aad8514c89 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:04.334521 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 407/813] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:52:04 2021] GET /identity/v3/auth/tokens => generated 2725 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:52:04.340672 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92d37f-80c0-4de1-977e-d437cb84960c admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:04.349866 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92d37f-80c0-4de1-977e-d437cb84960c admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:04.354560 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3469c-b477-4e51-bc7f-e9f7d84ec1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:04.355268 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3469c-b477-4e51-bc7f-e9f7d84ec1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:04.355597 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3469c-b477-4e51-bc7f-e9f7d84ec1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:04.355879 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3469c-b477-4e51-bc7f-e9f7d84ec1d7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:04.367118 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3469c-b477-4e51-bc7f-e9f7d84ec1d7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:04.392133 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3469c-b477-4e51-bc7f-e9f7d84ec1d7 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:04.408892 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-7aa3469c-b477-4e51-bc7f-e9f7d84ec1d7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:52:04.409934 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 407/814] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:52:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:04.415488 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076347b6-d502-42e6-94f7-49aad8514c89 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:04.424428 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076347b6-d502-42e6-94f7-49aad8514c89 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:04.428471 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ff40c-386a-4e46-b676-a59ffbf40e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:04.429048 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ff40c-386a-4e46-b676-a59ffbf40e3d admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:04.429336 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ff40c-386a-4e46-b676-a59ffbf40e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:04.429616 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ff40c-386a-4e46-b676-a59ffbf40e3d admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:04.430290 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ff40c-386a-4e46-b676-a59ffbf40e3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:04.430585 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ff40c-386a-4e46-b676-a59ffbf40e3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:04.455222 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ff40c-386a-4e46-b676-a59ffbf40e3d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:04.467969 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 408/815] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:52:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:52:04.473057 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3469c-b477-4e51-bc7f-e9f7d84ec1d7 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:04.482545 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3469c-b477-4e51-bc7f-e9f7d84ec1d7 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:04.486735 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572af3fe-94fc-48f2-a4fb-d242088ce5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:04.487421 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572af3fe-94fc-48f2-a4fb-d242088ce5bc admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:04.487742 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572af3fe-94fc-48f2-a4fb-d242088ce5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:04.488022 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572af3fe-94fc-48f2-a4fb-d242088ce5bc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:04.496769 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572af3fe-94fc-48f2-a4fb-d242088ce5bc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:04.522121 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572af3fe-94fc-48f2-a4fb-d242088ce5bc admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:04.535873 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-572af3fe-94fc-48f2-a4fb-d242088ce5bc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:52:04.536935 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 408/816] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:52:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:04.543140 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ff40c-386a-4e46-b676-a59ffbf40e3d admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:04.552223 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ff40c-386a-4e46-b676-a59ffbf40e3d admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:04.556166 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd78bb57-efb4-4951-92b4-efa9d106a757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:04.556739 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78bb57-efb4-4951-92b4-efa9d106a757 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:04.557034 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78bb57-efb4-4951-92b4-efa9d106a757 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:04.557313 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd78bb57-efb4-4951-92b4-efa9d106a757 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:04.558054 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78bb57-efb4-4951-92b4-efa9d106a757 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:04.558352 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78bb57-efb4-4951-92b4-efa9d106a757 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:04.583385 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd78bb57-efb4-4951-92b4-efa9d106a757 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:04.596472 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 409/817] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:52:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:52:04.601871 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572af3fe-94fc-48f2-a4fb-d242088ce5bc admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:04.611415 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572af3fe-94fc-48f2-a4fb-d242088ce5bc admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:04.615392 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb6258-38d9-4767-9a9b-bb37582cf1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:04.615980 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb6258-38d9-4767-9a9b-bb37582cf1ea admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:04.616268 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb6258-38d9-4767-9a9b-bb37582cf1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:04.616551 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb6258-38d9-4767-9a9b-bb37582cf1ea admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:04.617322 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb6258-38d9-4767-9a9b-bb37582cf1ea admin admin] RBAC: Adding query filter params (role.id=0af8b2c9076246e6ac61d13d88d91976, scope.project.id=f79f19c59cfd43c48871b51d6aaf501f, user.id=ab1b41f8980348fc878e492e26078e33) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:04.617626 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb6258-38d9-4767-9a9b-bb37582cf1ea admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:04.642544 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beb6258-38d9-4767-9a9b-bb37582cf1ea admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:04.647955 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 409/818] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:52:04 2021] GET /identity/v3/role_assignments?user.id=ab1b41f8980348fc878e492e26078e33&scope.project.id=f79f19c59cfd43c48871b51d6aaf501f&role.id=0af8b2c9076246e6ac61d13d88d91976 => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:06.584340 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2b3dc-29a4-4ba3-a73a-11f7b68225d1 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:06.584832 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2b3dc-29a4-4ba3-a73a-11f7b68225d1 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:06.584832 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2b3dc-29a4-4ba3-a73a-11f7b68225d1 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:06.586490 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 410/819] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:52:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:52:06.592358 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51bb61-a59d-4cc7-bb46-3be5fb5f9234 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:06.592799 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51bb61-a59d-4cc7-bb46-3be5fb5f9234 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:06.592925 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51bb61-a59d-4cc7-bb46-3be5fb5f9234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:06.614842 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-2e51bb61-a59d-4cc7-bb46-3be5fb5f9234 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:52:06.616090 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-2e51bb61-a59d-4cc7-bb46-3be5fb5f9234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:52:06.623185 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 410/820] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:52:06 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:52:06.645455 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2b3dc-29a4-4ba3-a73a-11f7b68225d1 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:06.656860 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2b3dc-29a4-4ba3-a73a-11f7b68225d1 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:06.660739 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08e75b-6a0e-46a6-b135-9a2e67cc4f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:06.661444 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08e75b-6a0e-46a6-b135-9a2e67cc4f73 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:06.661732 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08e75b-6a0e-46a6-b135-9a2e67cc4f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:06.662266 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08e75b-6a0e-46a6-b135-9a2e67cc4f73 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:06.673114 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08e75b-6a0e-46a6-b135-9a2e67cc4f73 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:52:06.679351 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-dd08e75b-6a0e-46a6-b135-9a2e67cc4f73 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 14:52:06.680433 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 411/821] 10.222.0.89 () {56 vars in 1123 bytes} [Wed Oct 27 14:52:06 2021] GET /identity/v3/roles/service => generated 85 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:06.686356 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51bb61-a59d-4cc7-bb46-3be5fb5f9234 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:06.694818 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51bb61-a59d-4cc7-bb46-3be5fb5f9234 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:06.699421 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677ae65-06ea-4c21-85e9-f556ebe222b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:06.700025 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677ae65-06ea-4c21-85e9-f556ebe222b8 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:06.700308 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677ae65-06ea-4c21-85e9-f556ebe222b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:06.700608 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677ae65-06ea-4c21-85e9-f556ebe222b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:06.701334 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677ae65-06ea-4c21-85e9-f556ebe222b8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:06.701631 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677ae65-06ea-4c21-85e9-f556ebe222b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:06.726589 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9677ae65-06ea-4c21-85e9-f556ebe222b8 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:06.734689 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 411/822] 10.222.0.89 () {56 vars in 1124 bytes} [Wed Oct 27 14:52:06 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:06.740002 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08e75b-6a0e-46a6-b135-9a2e67cc4f73 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:06.749943 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08e75b-6a0e-46a6-b135-9a2e67cc4f73 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:06.753959 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f708c-5314-4544-95cd-bb96ca382ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:06.754643 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f708c-5314-4544-95cd-bb96ca382ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:06.754931 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f708c-5314-4544-95cd-bb96ca382ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:06.755210 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3f708c-5314-4544-95cd-bb96ca382ca2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:06.766666 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f708c-5314-4544-95cd-bb96ca382ca2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:06.792146 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3f708c-5314-4544-95cd-bb96ca382ca2 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:06.809586 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-fe3f708c-5314-4544-95cd-bb96ca382ca2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:52:06.810615 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 412/823] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:52:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 14:52:06.815773 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677ae65-06ea-4c21-85e9-f556ebe222b8 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:06.825247 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677ae65-06ea-4c21-85e9-f556ebe222b8 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:06.829237 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207ce29-37d3-4dd9-a2fb-177334584f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:06.829802 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207ce29-37d3-4dd9-a2fb-177334584f87 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:06.830088 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207ce29-37d3-4dd9-a2fb-177334584f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:06.830366 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207ce29-37d3-4dd9-a2fb-177334584f87 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:06.831035 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207ce29-37d3-4dd9-a2fb-177334584f87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:06.831331 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207ce29-37d3-4dd9-a2fb-177334584f87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:06.856175 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1207ce29-37d3-4dd9-a2fb-177334584f87 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:06.868304 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 412/824] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:52:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:06.873848 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f708c-5314-4544-95cd-bb96ca382ca2 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:06.882786 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3f708c-5314-4544-95cd-bb96ca382ca2 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:06.887380 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8ace4-e3fa-418b-9494-9e16cf8058d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:06.888108 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8ace4-e3fa-418b-9494-9e16cf8058d1 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:06.888397 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8ace4-e3fa-418b-9494-9e16cf8058d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:06.888680 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8ace4-e3fa-418b-9494-9e16cf8058d1 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:06.902540 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8ace4-e3fa-418b-9494-9e16cf8058d1 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:06.927868 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8ace4-e3fa-418b-9494-9e16cf8058d1 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:06.945450 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-71f8ace4-e3fa-418b-9494-9e16cf8058d1 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 27 14:52:06.946472 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 413/825] 10.222.0.89 () {56 vars in 1123 bytes} [Wed Oct 27 14:52:06 2021] GET /identity/v3/users/neutron => generated 85 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:06.952335 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207ce29-37d3-4dd9-a2fb-177334584f87 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:06.961452 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207ce29-37d3-4dd9-a2fb-177334584f87 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:06.965488 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3771150-4339-4d81-83f1-30d238646e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:06.966066 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3771150-4339-4d81-83f1-30d238646e2f admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:06.966357 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3771150-4339-4d81-83f1-30d238646e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:06.966635 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3771150-4339-4d81-83f1-30d238646e2f admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:06.967413 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3771150-4339-4d81-83f1-30d238646e2f admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:06.967741 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3771150-4339-4d81-83f1-30d238646e2f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:06.993164 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3771150-4339-4d81-83f1-30d238646e2f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:07.021215 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 413/826] 10.222.0.89 () {56 vars in 1160 bytes} [Wed Oct 27 14:52:06 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:07.026348 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8ace4-e3fa-418b-9494-9e16cf8058d1 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:07.035217 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8ace4-e3fa-418b-9494-9e16cf8058d1 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:07.039408 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f17b9e-be85-41c7-8c56-253e43a2a93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:07.040127 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f17b9e-be85-41c7-8c56-253e43a2a93b admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:07.040407 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f17b9e-be85-41c7-8c56-253e43a2a93b admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:07.040684 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f17b9e-be85-41c7-8c56-253e43a2a93b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:07.052923 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f17b9e-be85-41c7-8c56-253e43a2a93b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:07.078066 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f17b9e-be85-41c7-8c56-253e43a2a93b admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:07.094389 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-94f17b9e-be85-41c7-8c56-253e43a2a93b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:52:07.095642 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 414/827] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:52:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:07.100531 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3771150-4339-4d81-83f1-30d238646e2f admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:07.109984 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3771150-4339-4d81-83f1-30d238646e2f admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:07.113914 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707ed4e-021a-4bea-96f2-6b21c6dbcec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:07.114484 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707ed4e-021a-4bea-96f2-6b21c6dbcec5 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:07.114770 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707ed4e-021a-4bea-96f2-6b21c6dbcec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:07.115048 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707ed4e-021a-4bea-96f2-6b21c6dbcec5 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:07.115762 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707ed4e-021a-4bea-96f2-6b21c6dbcec5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:07.116055 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707ed4e-021a-4bea-96f2-6b21c6dbcec5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:07.141292 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707ed4e-021a-4bea-96f2-6b21c6dbcec5 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:07.153491 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 414/828] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:52:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:07.158444 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f17b9e-be85-41c7-8c56-253e43a2a93b admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:07.168148 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f17b9e-be85-41c7-8c56-253e43a2a93b admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:07.172153 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cee2f2-fbeb-4846-8a6e-df7d8db69dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:07.172844 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cee2f2-fbeb-4846-8a6e-df7d8db69dcb admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:07.173133 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cee2f2-fbeb-4846-8a6e-df7d8db69dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:07.173415 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cee2f2-fbeb-4846-8a6e-df7d8db69dcb admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:07.182668 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cee2f2-fbeb-4846-8a6e-df7d8db69dcb admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:07.208020 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cee2f2-fbeb-4846-8a6e-df7d8db69dcb admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:07.221216 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-29cee2f2-fbeb-4846-8a6e-df7d8db69dcb admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:52:07.226460 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 415/829] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:52:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:07.227524 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707ed4e-021a-4bea-96f2-6b21c6dbcec5 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:07.237050 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707ed4e-021a-4bea-96f2-6b21c6dbcec5 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:07.241074 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b0301-7a5e-4330-bf2b-370f68bdf1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:07.241646 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b0301-7a5e-4330-bf2b-370f68bdf1a0 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:07.241933 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b0301-7a5e-4330-bf2b-370f68bdf1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:07.242210 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b0301-7a5e-4330-bf2b-370f68bdf1a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:07.242942 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b0301-7a5e-4330-bf2b-370f68bdf1a0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:07.243240 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b0301-7a5e-4330-bf2b-370f68bdf1a0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:07.268868 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b0301-7a5e-4330-bf2b-370f68bdf1a0 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:07.281635 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 415/830] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:52:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:07.287417 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cee2f2-fbeb-4846-8a6e-df7d8db69dcb admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:07.297018 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cee2f2-fbeb-4846-8a6e-df7d8db69dcb admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:07.301006 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af7b65e-e585-48f5-9082-1a403a02d578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:07.301807 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7b65e-e585-48f5-9082-1a403a02d578 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:07.302095 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7b65e-e585-48f5-9082-1a403a02d578 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:07.302376 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af7b65e-e585-48f5-9082-1a403a02d578 admin admin] PATH_INFO: `/v3/projects/f79f19c59cfd43c48871b51d6aaf501f/users/ab1b41f8980348fc878e492e26078e33/roles/0af8b2c9076246e6ac61d13d88d91976` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:07.322383 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7b65e-e585-48f5-9082-1a403a02d578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79f19c59cfd43c48871b51d6aaf501f, user_id=ab1b41f8980348fc878e492e26078e33, role_id=0af8b2c9076246e6ac61d13d88d91976)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:07.349062 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af7b65e-e585-48f5-9082-1a403a02d578 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:07.362752 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 416/831] 10.222.0.89 () {58 vars in 1460 bytes} [Wed Oct 27 14:52:07 2021] PUT /identity/v3/projects/f79f19c59cfd43c48871b51d6aaf501f/users/ab1b41f8980348fc878e492e26078e33/roles/0af8b2c9076246e6ac61d13d88d91976 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:52:09.277582 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b91c2-18be-4e87-9593-22a24fae40fe None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:09.277971 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b91c2-18be-4e87-9593-22a24fae40fe None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:09.278148 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b91c2-18be-4e87-9593-22a24fae40fe None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:09.279943 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 416/832] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:52:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:52:09.285487 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98522d-d165-4cd6-9c77-5475d8201a3e None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:09.285487 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98522d-d165-4cd6-9c77-5475d8201a3e None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:09.286039 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98522d-d165-4cd6-9c77-5475d8201a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:09.309036 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-4a98522d-d165-4cd6-9c77-5475d8201a3e None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:52:09.310186 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-4a98522d-d165-4cd6-9c77-5475d8201a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:52:09.372581 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 417/833] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:52:09 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:52:09.394833 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b91c2-18be-4e87-9593-22a24fae40fe None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:09.406661 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b91c2-18be-4e87-9593-22a24fae40fe None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:09.410547 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683570e3-b0cd-4175-9747-b6d1679a803c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:09.411250 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683570e3-b0cd-4175-9747-b6d1679a803c admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:09.411563 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683570e3-b0cd-4175-9747-b6d1679a803c admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:09.411843 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683570e3-b0cd-4175-9747-b6d1679a803c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:09.423643 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683570e3-b0cd-4175-9747-b6d1679a803c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:52:09.429826 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-683570e3-b0cd-4175-9747-b6d1679a803c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 14:52:09.430874 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 417/834] 10.222.0.89 () {56 vars in 1123 bytes} [Wed Oct 27 14:52:09 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:09.436366 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98522d-d165-4cd6-9c77-5475d8201a3e None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:09.444726 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98522d-d165-4cd6-9c77-5475d8201a3e None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:09.448760 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07310299-44fd-479f-868f-1a9a77670163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:09.449340 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07310299-44fd-479f-868f-1a9a77670163 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:09.449636 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07310299-44fd-479f-868f-1a9a77670163 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:09.449916 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07310299-44fd-479f-868f-1a9a77670163 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:09.450625 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07310299-44fd-479f-868f-1a9a77670163 admin admin] RBAC: Adding query filter params (name=service) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:09.450923 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07310299-44fd-479f-868f-1a9a77670163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:09.476254 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07310299-44fd-479f-868f-1a9a77670163 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:09.485001 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 418/835] 10.222.0.89 () {56 vars in 1124 bytes} [Wed Oct 27 14:52:09 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:09.490312 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683570e3-b0cd-4175-9747-b6d1679a803c admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:09.501606 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683570e3-b0cd-4175-9747-b6d1679a803c admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:09.505674 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bb9d8-2518-4f29-94dd-9df41d1e1a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:09.506366 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bb9d8-2518-4f29-94dd-9df41d1e1a33 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:09.506651 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bb9d8-2518-4f29-94dd-9df41d1e1a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:09.506928 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bb9d8-2518-4f29-94dd-9df41d1e1a33 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:09.517865 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bb9d8-2518-4f29-94dd-9df41d1e1a33 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:09.544105 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bb9d8-2518-4f29-94dd-9df41d1e1a33 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:09.560899 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-816bb9d8-2518-4f29-94dd-9df41d1e1a33 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:52:09.561932 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 418/836] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:52:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:09.567221 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07310299-44fd-479f-868f-1a9a77670163 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:09.576214 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07310299-44fd-479f-868f-1a9a77670163 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:09.580222 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d242d57-caf9-480a-ab97-9014dec7cfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:09.580794 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d242d57-caf9-480a-ab97-9014dec7cfd2 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:09.581084 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d242d57-caf9-480a-ab97-9014dec7cfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:09.581366 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d242d57-caf9-480a-ab97-9014dec7cfd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:09.582039 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d242d57-caf9-480a-ab97-9014dec7cfd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:09.582336 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d242d57-caf9-480a-ab97-9014dec7cfd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:09.608181 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d242d57-caf9-480a-ab97-9014dec7cfd2 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:09.620500 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 419/837] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:52:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:09.625525 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bb9d8-2518-4f29-94dd-9df41d1e1a33 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:09.634357 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bb9d8-2518-4f29-94dd-9df41d1e1a33 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:09.638790 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498c70b-c832-4620-a2bf-c451e2edf2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:09.639508 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498c70b-c832-4620-a2bf-c451e2edf2aa admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:09.639796 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498c70b-c832-4620-a2bf-c451e2edf2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:09.640071 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498c70b-c832-4620-a2bf-c451e2edf2aa admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:09.652898 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498c70b-c832-4620-a2bf-c451e2edf2aa admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:09.678201 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1498c70b-c832-4620-a2bf-c451e2edf2aa admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:09.695088 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-1498c70b-c832-4620-a2bf-c451e2edf2aa admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 27 14:52:09.696118 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 419/838] 10.222.0.89 () {56 vars in 1123 bytes} [Wed Oct 27 14:52:09 2021] GET /identity/v3/users/neutron => generated 85 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:09.701929 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d242d57-caf9-480a-ab97-9014dec7cfd2 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:09.710855 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d242d57-caf9-480a-ab97-9014dec7cfd2 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:09.715408 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21507968-77bb-4849-b1f6-e0d6f26ca771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:09.716006 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21507968-77bb-4849-b1f6-e0d6f26ca771 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:09.716288 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21507968-77bb-4849-b1f6-e0d6f26ca771 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:09.716565 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21507968-77bb-4849-b1f6-e0d6f26ca771 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:09.717344 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21507968-77bb-4849-b1f6-e0d6f26ca771 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:09.717637 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21507968-77bb-4849-b1f6-e0d6f26ca771 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:09.742489 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21507968-77bb-4849-b1f6-e0d6f26ca771 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:09.770588 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 420/839] 10.222.0.89 () {56 vars in 1160 bytes} [Wed Oct 27 14:52:09 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:52:09.776417 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498c70b-c832-4620-a2bf-c451e2edf2aa admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:09.785342 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498c70b-c832-4620-a2bf-c451e2edf2aa admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:09.789643 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea4e9c-eb36-48f4-8e91-a5430c526fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:09.790198 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea4e9c-eb36-48f4-8e91-a5430c526fec admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:09.790483 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea4e9c-eb36-48f4-8e91-a5430c526fec admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:09.790757 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea4e9c-eb36-48f4-8e91-a5430c526fec admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:09.798182 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea4e9c-eb36-48f4-8e91-a5430c526fec admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:09.823368 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea4e9c-eb36-48f4-8e91-a5430c526fec admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:09.832406 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 420/840] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:52:09 2021] GET /identity/v3/auth/tokens => generated 2725 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:52:09.837693 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21507968-77bb-4849-b1f6-e0d6f26ca771 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:09.847227 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21507968-77bb-4849-b1f6-e0d6f26ca771 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:09.851186 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d34ecd-4daf-4b64-83c7-3d4d886aa9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:09.851911 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d34ecd-4daf-4b64-83c7-3d4d886aa9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:09.852194 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d34ecd-4daf-4b64-83c7-3d4d886aa9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:09.852467 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d34ecd-4daf-4b64-83c7-3d4d886aa9e2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:09.863511 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d34ecd-4daf-4b64-83c7-3d4d886aa9e2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:09.888897 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d34ecd-4daf-4b64-83c7-3d4d886aa9e2 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:09.905533 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-f7d34ecd-4daf-4b64-83c7-3d4d886aa9e2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:52:09.906560 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 421/841] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:52:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:09.912186 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea4e9c-eb36-48f4-8e91-a5430c526fec admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:09.920415 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea4e9c-eb36-48f4-8e91-a5430c526fec admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:09.924444 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ad420-8b9c-4302-b423-1225052f7946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:09.925013 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ad420-8b9c-4302-b423-1225052f7946 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:09.925299 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ad420-8b9c-4302-b423-1225052f7946 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:09.925576 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ad420-8b9c-4302-b423-1225052f7946 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:09.926246 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ad420-8b9c-4302-b423-1225052f7946 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:09.926539 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ad420-8b9c-4302-b423-1225052f7946 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:09.951726 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ad420-8b9c-4302-b423-1225052f7946 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:09.964602 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 421/842] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:52:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:09.969521 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d34ecd-4daf-4b64-83c7-3d4d886aa9e2 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:09.978291 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d34ecd-4daf-4b64-83c7-3d4d886aa9e2 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:09.982244 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22449d-1788-407c-9624-5561a7c29096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:09.982921 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22449d-1788-407c-9624-5561a7c29096 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:09.983214 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22449d-1788-407c-9624-5561a7c29096 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:09.983506 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22449d-1788-407c-9624-5561a7c29096 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:09.992008 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22449d-1788-407c-9624-5561a7c29096 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:10.018072 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22449d-1788-407c-9624-5561a7c29096 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:10.031196 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-2d22449d-1788-407c-9624-5561a7c29096 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:52:10.032194 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 422/843] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:52:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:10.037824 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ad420-8b9c-4302-b423-1225052f7946 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:10.047097 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ad420-8b9c-4302-b423-1225052f7946 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:10.051154 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262a10e-e23a-4550-87f0-393af85da588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:10.051778 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262a10e-e23a-4550-87f0-393af85da588 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:10.052067 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262a10e-e23a-4550-87f0-393af85da588 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:10.052347 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262a10e-e23a-4550-87f0-393af85da588 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:10.053086 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262a10e-e23a-4550-87f0-393af85da588 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:10.053390 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262a10e-e23a-4550-87f0-393af85da588 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:10.079541 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262a10e-e23a-4550-87f0-393af85da588 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:10.092203 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 422/844] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:52:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:10.097800 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22449d-1788-407c-9624-5561a7c29096 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:10.106807 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22449d-1788-407c-9624-5561a7c29096 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:10.110728 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e087ab9-e2e2-457f-9425-e4fa8cd24613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:10.111292 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e087ab9-e2e2-457f-9425-e4fa8cd24613 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:10.111610 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e087ab9-e2e2-457f-9425-e4fa8cd24613 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:10.111881 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e087ab9-e2e2-457f-9425-e4fa8cd24613 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:10.112644 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e087ab9-e2e2-457f-9425-e4fa8cd24613 admin admin] RBAC: Adding query filter params (role.id=0af8b2c9076246e6ac61d13d88d91976, scope.project.id=f79f19c59cfd43c48871b51d6aaf501f, user.id=ab1b41f8980348fc878e492e26078e33) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:10.112938 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e087ab9-e2e2-457f-9425-e4fa8cd24613 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:10.139000 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e087ab9-e2e2-457f-9425-e4fa8cd24613 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:10.144487 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 423/845] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:52:10 2021] GET /identity/v3/role_assignments?user.id=ab1b41f8980348fc878e492e26078e33&scope.project.id=f79f19c59cfd43c48871b51d6aaf501f&role.id=0af8b2c9076246e6ac61d13d88d91976 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:12.082325 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef53bfd-0874-4a84-a6ec-9e5c73a16e54 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:12.082875 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef53bfd-0874-4a84-a6ec-9e5c73a16e54 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:12.082875 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef53bfd-0874-4a84-a6ec-9e5c73a16e54 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:12.084608 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 423/846] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:52:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:52:12.090082 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65b47c-ba52-4701-80e1-6c1c277d3776 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:12.090475 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65b47c-ba52-4701-80e1-6c1c277d3776 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:12.090636 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e65b47c-ba52-4701-80e1-6c1c277d3776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:12.114052 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-8e65b47c-ba52-4701-80e1-6c1c277d3776 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:52:12.115165 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-8e65b47c-ba52-4701-80e1-6c1c277d3776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:52:12.121787 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 424/847] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:52:12 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:52:12.143166 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef53bfd-0874-4a84-a6ec-9e5c73a16e54 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:12.155147 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef53bfd-0874-4a84-a6ec-9e5c73a16e54 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:12.159002 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55890139-3a02-45f5-b3ee-d3f8713323d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:12.159847 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55890139-3a02-45f5-b3ee-d3f8713323d7 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:12.160134 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55890139-3a02-45f5-b3ee-d3f8713323d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:12.160418 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55890139-3a02-45f5-b3ee-d3f8713323d7 admin admin] PATH_INFO: `/v3/services/network` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:12.161040 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55890139-3a02-45f5-b3ee-d3f8713323d7 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:12.185997 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55890139-3a02-45f5-b3ee-d3f8713323d7 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:12.196446 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-55890139-3a02-45f5-b3ee-d3f8713323d7 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 14:52:12.198285 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 424/848] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:52:12 2021] GET /identity/v3/services/network => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:12.204545 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65b47c-ba52-4701-80e1-6c1c277d3776 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:12.213558 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e65b47c-ba52-4701-80e1-6c1c277d3776 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:12.217504 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200f330-4612-445a-bc81-fa5159084a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:12.218091 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200f330-4612-445a-bc81-fa5159084a26 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:12.218375 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200f330-4612-445a-bc81-fa5159084a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:12.218650 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200f330-4612-445a-bc81-fa5159084a26 admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:12.219315 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200f330-4612-445a-bc81-fa5159084a26 admin admin] RBAC: Adding query filter params (name=network) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:12.219643 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200f330-4612-445a-bc81-fa5159084a26 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:12.244888 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200f330-4612-445a-bc81-fa5159084a26 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:12.249620 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 425/849] 10.222.0.89 () {56 vars in 1133 bytes} [Wed Oct 27 14:52:12 2021] GET /identity/v3/services?name=network => generated 124 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:12.255001 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55890139-3a02-45f5-b3ee-d3f8713323d7 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:12.264720 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55890139-3a02-45f5-b3ee-d3f8713323d7 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:12.268787 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2b8f9-35da-4d9e-8baf-00b7eed56024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:12.269362 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2b8f9-35da-4d9e-8baf-00b7eed56024 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:12.269649 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2b8f9-35da-4d9e-8baf-00b7eed56024 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:12.269927 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2b8f9-35da-4d9e-8baf-00b7eed56024 admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:12.270593 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2b8f9-35da-4d9e-8baf-00b7eed56024 admin admin] RBAC: Adding query filter params (type=network) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:12.270891 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2b8f9-35da-4d9e-8baf-00b7eed56024 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:12.296074 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c2b8f9-35da-4d9e-8baf-00b7eed56024 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:12.300455 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 425/850] 10.222.0.89 () {56 vars in 1133 bytes} [Wed Oct 27 14:52:12 2021] GET /identity/v3/services?type=network => generated 124 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:14.230670 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66495d1-f448-4b3d-9cf1-70e6c92ff498 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:14.231199 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66495d1-f448-4b3d-9cf1-70e6c92ff498 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:14.231291 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66495d1-f448-4b3d-9cf1-70e6c92ff498 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:14.232925 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 426/851] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:52:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:52:14.238140 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225f4b0-15b1-44d6-b0f9-be7bad1e167d None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:14.238573 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225f4b0-15b1-44d6-b0f9-be7bad1e167d None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:14.238708 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5225f4b0-15b1-44d6-b0f9-be7bad1e167d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:14.261278 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-5225f4b0-15b1-44d6-b0f9-be7bad1e167d None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:52:14.262409 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-5225f4b0-15b1-44d6-b0f9-be7bad1e167d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:52:14.269099 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 426/852] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:52:14 2021] POST /identity/v3/auth/tokens => generated 2725 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:52:14.291365 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66495d1-f448-4b3d-9cf1-70e6c92ff498 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:14.302908 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66495d1-f448-4b3d-9cf1-70e6c92ff498 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:14.306806 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6089ce6-a391-4573-abac-6a087420e156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:14.307390 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6089ce6-a391-4573-abac-6a087420e156 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:14.307701 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6089ce6-a391-4573-abac-6a087420e156 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:14.307978 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6089ce6-a391-4573-abac-6a087420e156 admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:14.308652 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6089ce6-a391-4573-abac-6a087420e156 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:14.333716 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6089ce6-a391-4573-abac-6a087420e156 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:14.346973 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 427/853] 10.222.0.89 () {60 vars in 1162 bytes} [Wed Oct 27 14:52:14 2021] POST /identity/v3/services => generated 240 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:52:16.298077 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b3846-5870-44eb-83c5-97791a357cc6 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:16.298549 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b3846-5870-44eb-83c5-97791a357cc6 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:16.298663 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b3846-5870-44eb-83c5-97791a357cc6 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:16.300345 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 427/854] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:52:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:52:16.305539 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e08b22-f392-480b-a46a-a1ac29dd6485 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:16.305952 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e08b22-f392-480b-a46a-a1ac29dd6485 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:16.306102 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e08b22-f392-480b-a46a-a1ac29dd6485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:16.329058 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-c1e08b22-f392-480b-a46a-a1ac29dd6485 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:52:16.330186 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-c1e08b22-f392-480b-a46a-a1ac29dd6485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:52:16.346522 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 428/855] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:52:16 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:52:16.368764 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b3846-5870-44eb-83c5-97791a357cc6 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:16.383529 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b3846-5870-44eb-83c5-97791a357cc6 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:16.387382 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f5290-fe38-4c54-88c2-6150d616d096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:16.388116 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f5290-fe38-4c54-88c2-6150d616d096 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:16.388406 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f5290-fe38-4c54-88c2-6150d616d096 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:16.388687 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4f5290-fe38-4c54-88c2-6150d616d096 admin admin] PATH_INFO: `/v3/services/network` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:16.389308 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f5290-fe38-4c54-88c2-6150d616d096 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:16.414280 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4f5290-fe38-4c54-88c2-6150d616d096 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:16.424928 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-8b4f5290-fe38-4c54-88c2-6150d616d096 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 14:52:16.425959 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 428/856] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:52:16 2021] GET /identity/v3/services/network => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:16.432201 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e08b22-f392-480b-a46a-a1ac29dd6485 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:16.440650 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e08b22-f392-480b-a46a-a1ac29dd6485 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:16.444667 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed3654-6584-4e0a-a85d-c3c23b4b9556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:16.445254 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed3654-6584-4e0a-a85d-c3c23b4b9556 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:16.445540 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed3654-6584-4e0a-a85d-c3c23b4b9556 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:16.445819 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed3654-6584-4e0a-a85d-c3c23b4b9556 admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:16.446485 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed3654-6584-4e0a-a85d-c3c23b4b9556 admin admin] RBAC: Adding query filter params (name=network) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:16.446780 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed3654-6584-4e0a-a85d-c3c23b4b9556 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:16.471335 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ed3654-6584-4e0a-a85d-c3c23b4b9556 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:16.475958 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 429/857] 10.222.0.89 () {56 vars in 1133 bytes} [Wed Oct 27 14:52:16 2021] GET /identity/v3/services?name=network => generated 124 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:16.481655 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f5290-fe38-4c54-88c2-6150d616d096 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:16.490468 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4f5290-fe38-4c54-88c2-6150d616d096 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:16.495123 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51808cd5-75e8-4cec-ba4f-2f0bfd5a47b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:16.495724 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51808cd5-75e8-4cec-ba4f-2f0bfd5a47b6 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:16.496011 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51808cd5-75e8-4cec-ba4f-2f0bfd5a47b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:16.496290 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51808cd5-75e8-4cec-ba4f-2f0bfd5a47b6 admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:16.496948 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51808cd5-75e8-4cec-ba4f-2f0bfd5a47b6 admin admin] RBAC: Adding query filter params (type=network) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:16.497246 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51808cd5-75e8-4cec-ba4f-2f0bfd5a47b6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:16.522030 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51808cd5-75e8-4cec-ba4f-2f0bfd5a47b6 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:16.526458 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 429/858] 10.222.0.89 () {56 vars in 1133 bytes} [Wed Oct 27 14:52:16 2021] GET /identity/v3/services?type=network => generated 350 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:16.531682 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed3654-6584-4e0a-a85d-c3c23b4b9556 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:16.541280 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ed3654-6584-4e0a-a85d-c3c23b4b9556 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:16.545264 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa91e07-dfd2-46ba-adf7-cf036a59ef54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:16.545817 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa91e07-dfd2-46ba-adf7-cf036a59ef54 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:16.546097 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa91e07-dfd2-46ba-adf7-cf036a59ef54 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:16.546371 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa91e07-dfd2-46ba-adf7-cf036a59ef54 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:16.547094 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa91e07-dfd2-46ba-adf7-cf036a59ef54 admin admin] RBAC: Adding query filter params (interface=public, service_id=ea2ce77bcdbc4e9eb8e30d546832a903, region_id=RegionOne) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:16.547390 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa91e07-dfd2-46ba-adf7-cf036a59ef54 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:16.572367 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa91e07-dfd2-46ba-adf7-cf036a59ef54 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:16.577298 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 430/859] 10.222.0.89 () {56 vars in 1272 bytes} [Wed Oct 27 14:52:16 2021] GET /identity/v3/endpoints?service_id=ea2ce77bcdbc4e9eb8e30d546832a903&interface=public®ion_id=RegionOne => generated 194 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:16.582231 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51808cd5-75e8-4cec-ba4f-2f0bfd5a47b6 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:16.591001 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51808cd5-75e8-4cec-ba4f-2f0bfd5a47b6 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:16.595016 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924a408-a294-4ebe-9d94-71762a77d434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:16.595616 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924a408-a294-4ebe-9d94-71762a77d434 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:16.595905 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924a408-a294-4ebe-9d94-71762a77d434 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:16.596187 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924a408-a294-4ebe-9d94-71762a77d434 admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:16.596818 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1924a408-a294-4ebe-9d94-71762a77d434 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:16.623537 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1924a408-a294-4ebe-9d94-71762a77d434 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:16.629890 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 430/860] 10.222.0.89 () {56 vars in 1108 bytes} [Wed Oct 27 14:52:16 2021] GET /identity/v3/services => generated 1967 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:52:18.555897 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa5582-d17f-4a09-b620-b8b28309a8ac None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:18.556888 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa5582-d17f-4a09-b620-b8b28309a8ac None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:18.556888 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa5582-d17f-4a09-b620-b8b28309a8ac None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:18.558553 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 431/861] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:52:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:52:18.563564 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39263216-e3b1-497d-8dda-ee67fd21f6ef None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:18.563941 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39263216-e3b1-497d-8dda-ee67fd21f6ef None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:18.564129 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39263216-e3b1-497d-8dda-ee67fd21f6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:18.586494 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-39263216-e3b1-497d-8dda-ee67fd21f6ef None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:52:18.587677 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-39263216-e3b1-497d-8dda-ee67fd21f6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:52:18.594266 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 431/862] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:52:18 2021] POST /identity/v3/auth/tokens => generated 2824 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:52:18.615954 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa5582-d17f-4a09-b620-b8b28309a8ac None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:18.629195 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa5582-d17f-4a09-b620-b8b28309a8ac None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:18.633039 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ed06e-c537-40e2-b0b8-9f90e8c3b684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:18.633732 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ed06e-c537-40e2-b0b8-9f90e8c3b684 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:18.634011 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ed06e-c537-40e2-b0b8-9f90e8c3b684 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:18.634281 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ed06e-c537-40e2-b0b8-9f90e8c3b684 admin admin] PATH_INFO: `/v3/services/network` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:18.635005 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ed06e-c537-40e2-b0b8-9f90e8c3b684 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:18.659424 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ed06e-c537-40e2-b0b8-9f90e8c3b684 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:18.670056 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-fa6ed06e-c537-40e2-b0b8-9f90e8c3b684 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 14:52:18.671075 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 432/863] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:52:18 2021] GET /identity/v3/services/network => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:18.676498 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39263216-e3b1-497d-8dda-ee67fd21f6ef None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:18.685391 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39263216-e3b1-497d-8dda-ee67fd21f6ef None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:18.689422 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98dd408-c1e9-49a0-b263-daa599c283b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:18.690002 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98dd408-c1e9-49a0-b263-daa599c283b9 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:18.690289 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98dd408-c1e9-49a0-b263-daa599c283b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:18.690568 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98dd408-c1e9-49a0-b263-daa599c283b9 admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:18.691229 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98dd408-c1e9-49a0-b263-daa599c283b9 admin admin] RBAC: Adding query filter params (name=network) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:18.691569 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98dd408-c1e9-49a0-b263-daa599c283b9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:18.716250 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98dd408-c1e9-49a0-b263-daa599c283b9 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:18.720992 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 432/864] 10.222.0.89 () {56 vars in 1133 bytes} [Wed Oct 27 14:52:18 2021] GET /identity/v3/services?name=network => generated 124 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:18.725911 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ed06e-c537-40e2-b0b8-9f90e8c3b684 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:18.735184 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ed06e-c537-40e2-b0b8-9f90e8c3b684 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:18.739216 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c49fa-09e2-4872-9a8c-b88e811c91a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:18.739803 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c49fa-09e2-4872-9a8c-b88e811c91a0 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:18.740086 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c49fa-09e2-4872-9a8c-b88e811c91a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:18.740360 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c49fa-09e2-4872-9a8c-b88e811c91a0 admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:18.741009 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c49fa-09e2-4872-9a8c-b88e811c91a0 admin admin] RBAC: Adding query filter params (type=network) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:18.741297 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c49fa-09e2-4872-9a8c-b88e811c91a0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:18.766292 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c49fa-09e2-4872-9a8c-b88e811c91a0 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:18.770742 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 433/865] 10.222.0.89 () {56 vars in 1133 bytes} [Wed Oct 27 14:52:18 2021] GET /identity/v3/services?type=network => generated 350 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:18.775753 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98dd408-c1e9-49a0-b263-daa599c283b9 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:18.784448 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98dd408-c1e9-49a0-b263-daa599c283b9 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:18.788714 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9741746b-45c0-4066-9cd2-4b2a62e1c56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:18.789266 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741746b-45c0-4066-9cd2-4b2a62e1c56f admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:18.789552 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741746b-45c0-4066-9cd2-4b2a62e1c56f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:18.789832 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9741746b-45c0-4066-9cd2-4b2a62e1c56f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:18.790511 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9741746b-45c0-4066-9cd2-4b2a62e1c56f admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:18.816193 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9741746b-45c0-4066-9cd2-4b2a62e1c56f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:18.833132 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 433/866] 10.222.0.89 () {60 vars in 1165 bytes} [Wed Oct 27 14:52:18 2021] POST /identity/v3/endpoints => generated 327 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:52:20.833399 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bfc56-dcc6-4a78-ac43-64336541d04c None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:20.833950 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bfc56-dcc6-4a78-ac43-64336541d04c None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:20.833950 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bfc56-dcc6-4a78-ac43-64336541d04c None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:20.835635 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 434/867] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:52:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:52:20.841152 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47de66-155c-4440-8f33-393081528913 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:20.841570 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47de66-155c-4440-8f33-393081528913 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:20.841727 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47de66-155c-4440-8f33-393081528913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:20.864188 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-be47de66-155c-4440-8f33-393081528913 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:52:20.865321 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-be47de66-155c-4440-8f33-393081528913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:52:20.882528 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 434/868] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:52:20 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:52:20.905562 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bfc56-dcc6-4a78-ac43-64336541d04c None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:20.917273 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bfc56-dcc6-4a78-ac43-64336541d04c None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:20.921189 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fa6a0-6cb5-4cc2-8702-0aa79b748225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:20.921765 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fa6a0-6cb5-4cc2-8702-0aa79b748225 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:20.922047 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fa6a0-6cb5-4cc2-8702-0aa79b748225 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:20.922322 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fa6a0-6cb5-4cc2-8702-0aa79b748225 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:20.923024 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fa6a0-6cb5-4cc2-8702-0aa79b748225 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:20.948186 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fa6a0-6cb5-4cc2-8702-0aa79b748225 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:20.953843 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.sql.core [None req-c86fa6a0-6cb5-4cc2-8702-0aa79b748225 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 27 14:52:20.953843 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 27 14:52:20.953843 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [parameters: {'id': '66cc3bfef1914f3f84203522a67af39f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 27 14:52:20.953843 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: (Background on this error at: http://sqlalche.me/e/13/gkpj) {{(pid=65985) wrapper /opt/stack/keystone/keystone/common/sql/core.py:523}} Oct 27 14:52:20.959527 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-c86fa6a0-6cb5-4cc2-8702-0aa79b748225 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 27 14:52:20.960618 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 435/869] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 14:52:20 2021] POST /identity/v3/roles => generated 144 bytes in 55 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 27 14:52:20.966878 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47de66-155c-4440-8f33-393081528913 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:20.975398 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47de66-155c-4440-8f33-393081528913 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:20.979572 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631af6c-c851-4a68-b3b6-7e8cf6124279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:20.980295 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631af6c-c851-4a68-b3b6-7e8cf6124279 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:20.980583 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631af6c-c851-4a68-b3b6-7e8cf6124279 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:20.980863 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631af6c-c851-4a68-b3b6-7e8cf6124279 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:20.991784 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631af6c-c851-4a68-b3b6-7e8cf6124279 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:52:20.998265 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-8631af6c-c851-4a68-b3b6-7e8cf6124279 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 14:52:20.999310 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 435/870] 10.222.0.89 () {56 vars in 1135 bytes} [Wed Oct 27 14:52:20 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:21.004593 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fa6a0-6cb5-4cc2-8702-0aa79b748225 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:21.014060 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fa6a0-6cb5-4cc2-8702-0aa79b748225 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:21.018009 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25a45b0-304d-41b1-9767-05cb9c458de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:21.018578 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a45b0-304d-41b1-9767-05cb9c458de0 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:21.018860 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a45b0-304d-41b1-9767-05cb9c458de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:21.019132 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25a45b0-304d-41b1-9767-05cb9c458de0 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:21.019857 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a45b0-304d-41b1-9767-05cb9c458de0 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:21.020147 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a45b0-304d-41b1-9767-05cb9c458de0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:21.045462 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25a45b0-304d-41b1-9767-05cb9c458de0 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:21.053547 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 436/871] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:52:21 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:52:22.990635 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55c75d-10fb-4859-bbb5-436c6eb92403 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:22.991164 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55c75d-10fb-4859-bbb5-436c6eb92403 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:22.991252 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55c75d-10fb-4859-bbb5-436c6eb92403 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:22.992913 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 436/872] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:52:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:52:22.998497 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7ef33-aaa4-4816-b6b5-51a566209779 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:22.998896 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7ef33-aaa4-4816-b6b5-51a566209779 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:22.999049 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7ef33-aaa4-4816-b6b5-51a566209779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:23.021358 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-13e7ef33-aaa4-4816-b6b5-51a566209779 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:52:23.022468 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-13e7ef33-aaa4-4816-b6b5-51a566209779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:52:23.029068 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 437/873] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:52:22 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:52:23.052077 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55c75d-10fb-4859-bbb5-436c6eb92403 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:23.064520 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55c75d-10fb-4859-bbb5-436c6eb92403 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:23.068410 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad396083-4455-456a-9943-d3c28d707f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:23.069111 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad396083-4455-456a-9943-d3c28d707f81 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:23.069398 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad396083-4455-456a-9943-d3c28d707f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:23.069676 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad396083-4455-456a-9943-d3c28d707f81 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:23.083100 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad396083-4455-456a-9943-d3c28d707f81 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:23.109052 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad396083-4455-456a-9943-d3c28d707f81 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:23.126520 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-ad396083-4455-456a-9943-d3c28d707f81 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:52:23.127588 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 437/874] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:52:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:23.133242 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7ef33-aaa4-4816-b6b5-51a566209779 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:23.141738 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7ef33-aaa4-4816-b6b5-51a566209779 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:23.145703 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ed655-0643-4ed6-aa33-ee9286b19e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:23.146277 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ed655-0643-4ed6-aa33-ee9286b19e6f admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:23.146558 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ed655-0643-4ed6-aa33-ee9286b19e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:23.146832 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ed655-0643-4ed6-aa33-ee9286b19e6f admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:23.147544 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ed655-0643-4ed6-aa33-ee9286b19e6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:23.147838 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ed655-0643-4ed6-aa33-ee9286b19e6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:23.173179 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ed655-0643-4ed6-aa33-ee9286b19e6f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:23.185936 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 438/875] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:52:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:23.191120 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad396083-4455-456a-9943-d3c28d707f81 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:23.200204 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad396083-4455-456a-9943-d3c28d707f81 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:23.204235 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a6f12-0dea-43c7-9abf-cd859f02ed95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:23.204812 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a6f12-0dea-43c7-9abf-cd859f02ed95 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:23.205100 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a6f12-0dea-43c7-9abf-cd859f02ed95 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:23.205376 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a6f12-0dea-43c7-9abf-cd859f02ed95 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:23.206015 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a6f12-0dea-43c7-9abf-cd859f02ed95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:23.231541 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a6f12-0dea-43c7-9abf-cd859f02ed95 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:23.251184 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 438/876] 10.222.0.89 () {60 vars in 1153 bytes} [Wed Oct 27 14:52:23 2021] POST /identity/v3/users => generated 247 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:52:25.202131 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dac644-7960-4d6a-94c4-a4c7d3858f97 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:25.202659 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dac644-7960-4d6a-94c4-a4c7d3858f97 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:25.202786 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dac644-7960-4d6a-94c4-a4c7d3858f97 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:25.204420 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 439/877] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:52:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:52:25.209565 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39876490-6ade-4328-9e7f-23ac45ac90eb None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:25.209943 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39876490-6ade-4328-9e7f-23ac45ac90eb None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:25.210128 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39876490-6ade-4328-9e7f-23ac45ac90eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:25.233518 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-39876490-6ade-4328-9e7f-23ac45ac90eb None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:52:25.234650 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-39876490-6ade-4328-9e7f-23ac45ac90eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:52:25.241406 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 439/878] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:52:25 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:52:25.263760 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dac644-7960-4d6a-94c4-a4c7d3858f97 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:25.275762 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dac644-7960-4d6a-94c4-a4c7d3858f97 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:25.279710 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c237518-b6ca-4875-b7e7-fc94fc25bb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:25.280417 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c237518-b6ca-4875-b7e7-fc94fc25bb74 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:25.280704 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c237518-b6ca-4875-b7e7-fc94fc25bb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:25.280980 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c237518-b6ca-4875-b7e7-fc94fc25bb74 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:25.292759 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c237518-b6ca-4875-b7e7-fc94fc25bb74 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:52:25.299039 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-5c237518-b6ca-4875-b7e7-fc94fc25bb74 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 14:52:25.300133 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 440/879] 10.222.0.89 () {56 vars in 1123 bytes} [Wed Oct 27 14:52:25 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 14:52:25.305630 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39876490-6ade-4328-9e7f-23ac45ac90eb None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:25.313926 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39876490-6ade-4328-9e7f-23ac45ac90eb None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:25.317906 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c7205-e4c7-4369-a608-2a6acb4aef04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:25.318482 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c7205-e4c7-4369-a608-2a6acb4aef04 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:25.318765 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c7205-e4c7-4369-a608-2a6acb4aef04 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:25.319040 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c7205-e4c7-4369-a608-2a6acb4aef04 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:25.319781 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c7205-e4c7-4369-a608-2a6acb4aef04 admin admin] RBAC: Adding query filter params (name=service) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:25.320075 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c7205-e4c7-4369-a608-2a6acb4aef04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:25.345090 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c7205-e4c7-4369-a608-2a6acb4aef04 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:25.353770 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 440/880] 10.222.0.89 () {56 vars in 1124 bytes} [Wed Oct 27 14:52:25 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:25.359032 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c237518-b6ca-4875-b7e7-fc94fc25bb74 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:25.368439 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c237518-b6ca-4875-b7e7-fc94fc25bb74 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:25.372501 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcf41a-74f7-4318-8353-643babaf3842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:25.373189 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcf41a-74f7-4318-8353-643babaf3842 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:25.373478 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcf41a-74f7-4318-8353-643babaf3842 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:25.373756 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbcf41a-74f7-4318-8353-643babaf3842 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:25.385116 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbcf41a-74f7-4318-8353-643babaf3842 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:25.410649 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbcf41a-74f7-4318-8353-643babaf3842 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:25.427988 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-edbcf41a-74f7-4318-8353-643babaf3842 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:52:25.429014 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 441/881] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:52:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:25.434155 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c7205-e4c7-4369-a608-2a6acb4aef04 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:25.442937 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c7205-e4c7-4369-a608-2a6acb4aef04 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:25.447396 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a20a5-884f-4996-871a-5c4f47e57b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:25.447984 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a20a5-884f-4996-871a-5c4f47e57b29 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:25.448265 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a20a5-884f-4996-871a-5c4f47e57b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:25.448537 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a20a5-884f-4996-871a-5c4f47e57b29 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:25.449199 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a20a5-884f-4996-871a-5c4f47e57b29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:25.449492 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a20a5-884f-4996-871a-5c4f47e57b29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:25.478513 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a20a5-884f-4996-871a-5c4f47e57b29 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:25.492249 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 441/882] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:52:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:25.497713 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcf41a-74f7-4318-8353-643babaf3842 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:25.506833 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbcf41a-74f7-4318-8353-643babaf3842 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:25.511402 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fe8a2-6452-4e96-aa69-9277ff6e229c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:25.512144 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fe8a2-6452-4e96-aa69-9277ff6e229c admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:25.512432 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fe8a2-6452-4e96-aa69-9277ff6e229c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:25.512712 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95fe8a2-6452-4e96-aa69-9277ff6e229c admin admin] PATH_INFO: `/v3/users/swift` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:25.525862 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95fe8a2-6452-4e96-aa69-9277ff6e229c admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:25.551253 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95fe8a2-6452-4e96-aa69-9277ff6e229c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:25.568175 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-a95fe8a2-6452-4e96-aa69-9277ff6e229c admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 14:52:25.569199 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 442/883] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:52:25 2021] GET /identity/v3/users/swift => generated 83 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:25.575080 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a20a5-884f-4996-871a-5c4f47e57b29 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:25.584060 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a20a5-884f-4996-871a-5c4f47e57b29 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:25.588825 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53055a0c-7f72-4926-a482-13f269c4af88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:25.589406 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53055a0c-7f72-4926-a482-13f269c4af88 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:25.589687 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53055a0c-7f72-4926-a482-13f269c4af88 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:25.589960 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53055a0c-7f72-4926-a482-13f269c4af88 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:25.590745 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53055a0c-7f72-4926-a482-13f269c4af88 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:25.591042 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53055a0c-7f72-4926-a482-13f269c4af88 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:25.616297 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53055a0c-7f72-4926-a482-13f269c4af88 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:25.644268 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 442/884] 10.222.0.89 () {56 vars in 1156 bytes} [Wed Oct 27 14:52:25 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:25.649568 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fe8a2-6452-4e96-aa69-9277ff6e229c admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:25.659122 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95fe8a2-6452-4e96-aa69-9277ff6e229c admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:25.663360 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2545bc-c742-441e-98aa-8cc0eb613736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:25.663941 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2545bc-c742-441e-98aa-8cc0eb613736 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:25.664221 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2545bc-c742-441e-98aa-8cc0eb613736 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:25.664492 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2545bc-c742-441e-98aa-8cc0eb613736 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:25.671854 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2545bc-c742-441e-98aa-8cc0eb613736 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:25.696554 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2545bc-c742-441e-98aa-8cc0eb613736 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:25.706145 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 443/885] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:52:25 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:52:25.711506 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53055a0c-7f72-4926-a482-13f269c4af88 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:25.721248 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53055a0c-7f72-4926-a482-13f269c4af88 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:25.725352 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95293f81-2782-4a23-8898-750c8e41de37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:25.726056 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95293f81-2782-4a23-8898-750c8e41de37 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:25.726343 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95293f81-2782-4a23-8898-750c8e41de37 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:25.726625 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95293f81-2782-4a23-8898-750c8e41de37 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:25.737894 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95293f81-2782-4a23-8898-750c8e41de37 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:25.764037 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95293f81-2782-4a23-8898-750c8e41de37 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:25.780215 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-95293f81-2782-4a23-8898-750c8e41de37 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:52:25.781264 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 443/886] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:52:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:25.786534 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2545bc-c742-441e-98aa-8cc0eb613736 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:25.795090 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2545bc-c742-441e-98aa-8cc0eb613736 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:25.799176 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb53af0-57e5-457d-b258-7dee18bfa6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:25.799778 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb53af0-57e5-457d-b258-7dee18bfa6ff admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:25.800061 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb53af0-57e5-457d-b258-7dee18bfa6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:25.800334 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb53af0-57e5-457d-b258-7dee18bfa6ff admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:25.801004 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb53af0-57e5-457d-b258-7dee18bfa6ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:25.801297 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb53af0-57e5-457d-b258-7dee18bfa6ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:25.827104 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb53af0-57e5-457d-b258-7dee18bfa6ff admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:25.839411 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 444/887] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:52:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:25.844320 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95293f81-2782-4a23-8898-750c8e41de37 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:25.853190 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95293f81-2782-4a23-8898-750c8e41de37 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:25.857230 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2f142-4eb7-4494-989b-d05fde7611ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:25.857917 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2f142-4eb7-4494-989b-d05fde7611ea admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:25.858204 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2f142-4eb7-4494-989b-d05fde7611ea admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:25.858482 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2f142-4eb7-4494-989b-d05fde7611ea admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:25.867092 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2f142-4eb7-4494-989b-d05fde7611ea admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:25.893096 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2f142-4eb7-4494-989b-d05fde7611ea admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:25.906217 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-dad2f142-4eb7-4494-989b-d05fde7611ea admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:52:25.907242 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 444/888] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:52:25 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:25.912809 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb53af0-57e5-457d-b258-7dee18bfa6ff admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:25.921791 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb53af0-57e5-457d-b258-7dee18bfa6ff admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:25.925815 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46169be1-515f-4253-bc1f-6be43659f139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:25.926380 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46169be1-515f-4253-bc1f-6be43659f139 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:25.926665 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46169be1-515f-4253-bc1f-6be43659f139 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:25.926942 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46169be1-515f-4253-bc1f-6be43659f139 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:25.927714 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46169be1-515f-4253-bc1f-6be43659f139 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:25.928015 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46169be1-515f-4253-bc1f-6be43659f139 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:25.954001 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46169be1-515f-4253-bc1f-6be43659f139 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:25.966443 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 445/889] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:52:25 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:25.971846 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2f142-4eb7-4494-989b-d05fde7611ea admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:25.980880 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2f142-4eb7-4494-989b-d05fde7611ea admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:25.984915 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d510e4fd-bc83-47be-a3fc-507951f15d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:25.985475 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510e4fd-bc83-47be-a3fc-507951f15d85 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:25.985762 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510e4fd-bc83-47be-a3fc-507951f15d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:25.986039 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d510e4fd-bc83-47be-a3fc-507951f15d85 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:25.986835 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510e4fd-bc83-47be-a3fc-507951f15d85 admin admin] RBAC: Adding query filter params (role.id=0af8b2c9076246e6ac61d13d88d91976, scope.project.id=f79f19c59cfd43c48871b51d6aaf501f, user.id=ffba82bc9ddf42069a813b932bd310ba) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:25.987137 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510e4fd-bc83-47be-a3fc-507951f15d85 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:26.013387 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d510e4fd-bc83-47be-a3fc-507951f15d85 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:26.018484 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 445/890] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:52:25 2021] GET /identity/v3/role_assignments?user.id=ffba82bc9ddf42069a813b932bd310ba&scope.project.id=f79f19c59cfd43c48871b51d6aaf501f&role.id=0af8b2c9076246e6ac61d13d88d91976 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:27.937584 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68460e9a-9ed9-406b-951a-96e3305c1777 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:27.938106 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68460e9a-9ed9-406b-951a-96e3305c1777 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:27.938198 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68460e9a-9ed9-406b-951a-96e3305c1777 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:27.939850 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 446/891] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:52:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:52:27.944949 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c02e54-3bbc-4b47-914f-ec46e45bd63e None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:27.945349 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c02e54-3bbc-4b47-914f-ec46e45bd63e None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:27.945505 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c02e54-3bbc-4b47-914f-ec46e45bd63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:27.968552 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-d3c02e54-3bbc-4b47-914f-ec46e45bd63e None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:52:27.969669 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-d3c02e54-3bbc-4b47-914f-ec46e45bd63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:52:27.976307 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 446/892] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:52:27 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:52:27.998240 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68460e9a-9ed9-406b-951a-96e3305c1777 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:28.010197 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68460e9a-9ed9-406b-951a-96e3305c1777 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:28.014089 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0c20f-f9ad-425b-8aab-6a722c3a0447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:28.014789 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0c20f-f9ad-425b-8aab-6a722c3a0447 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:28.015072 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0c20f-f9ad-425b-8aab-6a722c3a0447 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:28.015345 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0c20f-f9ad-425b-8aab-6a722c3a0447 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:28.026272 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0c20f-f9ad-425b-8aab-6a722c3a0447 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:52:28.032542 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-42e0c20f-f9ad-425b-8aab-6a722c3a0447 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 14:52:28.033591 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 447/893] 10.222.0.89 () {56 vars in 1123 bytes} [Wed Oct 27 14:52:27 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:28.039524 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c02e54-3bbc-4b47-914f-ec46e45bd63e None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:28.047947 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c02e54-3bbc-4b47-914f-ec46e45bd63e None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:28.051983 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4efa18-a348-434b-a8a5-bbce3f54484f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:28.052567 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4efa18-a348-434b-a8a5-bbce3f54484f admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:28.052858 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4efa18-a348-434b-a8a5-bbce3f54484f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:28.053141 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4efa18-a348-434b-a8a5-bbce3f54484f admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:28.053845 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4efa18-a348-434b-a8a5-bbce3f54484f admin admin] RBAC: Adding query filter params (name=service) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:28.054146 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4efa18-a348-434b-a8a5-bbce3f54484f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:28.080403 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4efa18-a348-434b-a8a5-bbce3f54484f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:28.088584 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 447/894] 10.222.0.89 () {56 vars in 1124 bytes} [Wed Oct 27 14:52:28 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:28.093789 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0c20f-f9ad-425b-8aab-6a722c3a0447 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:28.103150 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0c20f-f9ad-425b-8aab-6a722c3a0447 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:28.107139 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b9009-7cde-441a-b12a-f26417276d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:28.107854 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b9009-7cde-441a-b12a-f26417276d05 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:28.108137 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b9009-7cde-441a-b12a-f26417276d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:28.108412 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b9009-7cde-441a-b12a-f26417276d05 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:28.119719 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b9009-7cde-441a-b12a-f26417276d05 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:28.145179 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1b9009-7cde-441a-b12a-f26417276d05 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:28.163399 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-9f1b9009-7cde-441a-b12a-f26417276d05 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:52:28.164444 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 448/895] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:52:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:28.169723 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4efa18-a348-434b-a8a5-bbce3f54484f admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:28.178601 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4efa18-a348-434b-a8a5-bbce3f54484f admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:28.183102 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33803cbf-3181-4355-ac02-575bdde44d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:28.183702 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33803cbf-3181-4355-ac02-575bdde44d9e admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:28.183992 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33803cbf-3181-4355-ac02-575bdde44d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:28.184272 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33803cbf-3181-4355-ac02-575bdde44d9e admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:28.184948 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33803cbf-3181-4355-ac02-575bdde44d9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:28.185246 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33803cbf-3181-4355-ac02-575bdde44d9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:28.210622 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33803cbf-3181-4355-ac02-575bdde44d9e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:28.223038 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 448/896] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:52:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:28.228483 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b9009-7cde-441a-b12a-f26417276d05 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:28.237559 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b9009-7cde-441a-b12a-f26417276d05 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:28.241689 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9f4f2-4c3f-48d9-914f-ccb8452e02c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:28.242395 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9f4f2-4c3f-48d9-914f-ccb8452e02c7 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:28.242682 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9f4f2-4c3f-48d9-914f-ccb8452e02c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:28.242960 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9f4f2-4c3f-48d9-914f-ccb8452e02c7 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:28.256046 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9f4f2-4c3f-48d9-914f-ccb8452e02c7 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:28.281563 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9f4f2-4c3f-48d9-914f-ccb8452e02c7 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:28.298983 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-bae9f4f2-4c3f-48d9-914f-ccb8452e02c7 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 14:52:28.300079 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 449/897] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:52:28 2021] GET /identity/v3/users/swift => generated 83 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 14:52:28.305671 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33803cbf-3181-4355-ac02-575bdde44d9e admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:28.315245 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33803cbf-3181-4355-ac02-575bdde44d9e admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:28.319330 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5e0c2-e977-474f-9089-b8f8588da0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:28.319949 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5e0c2-e977-474f-9089-b8f8588da0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:28.320242 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5e0c2-e977-474f-9089-b8f8588da0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:28.320525 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca5e0c2-e977-474f-9089-b8f8588da0a7 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:28.321311 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5e0c2-e977-474f-9089-b8f8588da0a7 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:28.322285 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5e0c2-e977-474f-9089-b8f8588da0a7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:28.347327 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca5e0c2-e977-474f-9089-b8f8588da0a7 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:28.376187 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 449/898] 10.222.0.89 () {56 vars in 1156 bytes} [Wed Oct 27 14:52:28 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:28.381475 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9f4f2-4c3f-48d9-914f-ccb8452e02c7 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:28.390514 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9f4f2-4c3f-48d9-914f-ccb8452e02c7 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:28.394531 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81850f15-4cc2-4268-bb6d-87397f640113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:28.395226 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81850f15-4cc2-4268-bb6d-87397f640113 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:28.395552 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81850f15-4cc2-4268-bb6d-87397f640113 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:28.395830 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81850f15-4cc2-4268-bb6d-87397f640113 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:28.407743 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81850f15-4cc2-4268-bb6d-87397f640113 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:28.433831 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81850f15-4cc2-4268-bb6d-87397f640113 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:28.450138 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-81850f15-4cc2-4268-bb6d-87397f640113 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:52:28.451164 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 450/899] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:52:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 14:52:28.456367 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5e0c2-e977-474f-9089-b8f8588da0a7 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:28.465390 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca5e0c2-e977-474f-9089-b8f8588da0a7 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:28.469397 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8552e-c62a-4ead-a849-000064ede8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:28.469973 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8552e-c62a-4ead-a849-000064ede8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:28.470259 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8552e-c62a-4ead-a849-000064ede8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:28.470540 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d8552e-c62a-4ead-a849-000064ede8e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:28.471218 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8552e-c62a-4ead-a849-000064ede8e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:28.471553 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8552e-c62a-4ead-a849-000064ede8e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:28.497348 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d8552e-c62a-4ead-a849-000064ede8e2 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:28.509729 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 450/900] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:52:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:28.514650 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81850f15-4cc2-4268-bb6d-87397f640113 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:28.523506 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81850f15-4cc2-4268-bb6d-87397f640113 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:28.527427 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c48da-b737-447b-83f6-865843a27325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:28.528132 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c48da-b737-447b-83f6-865843a27325 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:28.528413 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c48da-b737-447b-83f6-865843a27325 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:28.528685 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c48da-b737-447b-83f6-865843a27325 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:28.537505 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c48da-b737-447b-83f6-865843a27325 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:28.563570 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c48da-b737-447b-83f6-865843a27325 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:28.576433 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-f97c48da-b737-447b-83f6-865843a27325 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:52:28.577447 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 451/901] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:52:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:28.582741 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8552e-c62a-4ead-a849-000064ede8e2 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:28.591654 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d8552e-c62a-4ead-a849-000064ede8e2 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:28.595672 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eeb73f-7226-45c0-8bc1-760daa56bdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:28.596243 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eeb73f-7226-45c0-8bc1-760daa56bdf7 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:28.596531 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eeb73f-7226-45c0-8bc1-760daa56bdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:28.596810 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eeb73f-7226-45c0-8bc1-760daa56bdf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:28.597547 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eeb73f-7226-45c0-8bc1-760daa56bdf7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:28.597847 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eeb73f-7226-45c0-8bc1-760daa56bdf7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:28.624056 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eeb73f-7226-45c0-8bc1-760daa56bdf7 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:28.636572 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 451/902] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:52:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:28.641873 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c48da-b737-447b-83f6-865843a27325 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:28.650617 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c48da-b737-447b-83f6-865843a27325 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:28.654559 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f540319-3e78-4bfd-908e-1c51cf101e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:28.655334 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f540319-3e78-4bfd-908e-1c51cf101e46 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:28.655641 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f540319-3e78-4bfd-908e-1c51cf101e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:28.655920 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f540319-3e78-4bfd-908e-1c51cf101e46 admin admin] PATH_INFO: `/v3/projects/f79f19c59cfd43c48871b51d6aaf501f/users/ffba82bc9ddf42069a813b932bd310ba/roles/0af8b2c9076246e6ac61d13d88d91976` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:28.675745 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f540319-3e78-4bfd-908e-1c51cf101e46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79f19c59cfd43c48871b51d6aaf501f, user_id=ffba82bc9ddf42069a813b932bd310ba, role_id=0af8b2c9076246e6ac61d13d88d91976)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:28.702014 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f540319-3e78-4bfd-908e-1c51cf101e46 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:28.715284 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 452/903] 10.222.0.89 () {58 vars in 1460 bytes} [Wed Oct 27 14:52:28 2021] PUT /identity/v3/projects/f79f19c59cfd43c48871b51d6aaf501f/users/ffba82bc9ddf42069a813b932bd310ba/roles/0af8b2c9076246e6ac61d13d88d91976 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:52:30.611322 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a42a57-3a14-4c16-8174-dfc5d8eed2c1 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:30.611849 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a42a57-3a14-4c16-8174-dfc5d8eed2c1 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:30.611849 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a42a57-3a14-4c16-8174-dfc5d8eed2c1 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:30.613506 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 452/904] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:52:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:52:30.618499 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e0770-4449-4416-ad65-3c1234f45b69 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:30.618912 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e0770-4449-4416-ad65-3c1234f45b69 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:30.619067 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e0770-4449-4416-ad65-3c1234f45b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:30.641493 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-9c1e0770-4449-4416-ad65-3c1234f45b69 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:52:30.642617 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-9c1e0770-4449-4416-ad65-3c1234f45b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:52:30.705074 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 453/905] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:52:30 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:52:30.727710 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a42a57-3a14-4c16-8174-dfc5d8eed2c1 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:30.739316 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a42a57-3a14-4c16-8174-dfc5d8eed2c1 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:30.743153 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04832c0a-7628-4aec-ae56-ebc66f670df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:30.743924 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04832c0a-7628-4aec-ae56-ebc66f670df5 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:30.744206 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04832c0a-7628-4aec-ae56-ebc66f670df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:30.744477 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04832c0a-7628-4aec-ae56-ebc66f670df5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:30.755204 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04832c0a-7628-4aec-ae56-ebc66f670df5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:52:30.761960 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-04832c0a-7628-4aec-ae56-ebc66f670df5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 14:52:30.763007 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 453/906] 10.222.0.89 () {56 vars in 1123 bytes} [Wed Oct 27 14:52:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:30.768797 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e0770-4449-4416-ad65-3c1234f45b69 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:30.777766 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e0770-4449-4416-ad65-3c1234f45b69 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:30.781792 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca571fb-40e6-487d-b784-20aaa7ab3813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:30.782379 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca571fb-40e6-487d-b784-20aaa7ab3813 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:30.782665 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca571fb-40e6-487d-b784-20aaa7ab3813 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:30.782941 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca571fb-40e6-487d-b784-20aaa7ab3813 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:30.783744 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca571fb-40e6-487d-b784-20aaa7ab3813 admin admin] RBAC: Adding query filter params (name=service) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:30.784042 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca571fb-40e6-487d-b784-20aaa7ab3813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:30.809044 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca571fb-40e6-487d-b784-20aaa7ab3813 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:30.817112 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 454/907] 10.222.0.89 () {56 vars in 1124 bytes} [Wed Oct 27 14:52:30 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:30.822800 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04832c0a-7628-4aec-ae56-ebc66f670df5 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:30.832125 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04832c0a-7628-4aec-ae56-ebc66f670df5 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:30.836081 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d5855-5b81-4b0d-9aa2-1f8a6c21cda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:30.836754 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d5855-5b81-4b0d-9aa2-1f8a6c21cda0 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:30.837159 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d5855-5b81-4b0d-9aa2-1f8a6c21cda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:30.837942 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d5855-5b81-4b0d-9aa2-1f8a6c21cda0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:30.848709 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d5855-5b81-4b0d-9aa2-1f8a6c21cda0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:30.873711 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d5855-5b81-4b0d-9aa2-1f8a6c21cda0 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:30.892492 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-e61d5855-5b81-4b0d-9aa2-1f8a6c21cda0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:52:30.893560 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 454/908] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:52:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:30.898980 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca571fb-40e6-487d-b784-20aaa7ab3813 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:30.908522 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca571fb-40e6-487d-b784-20aaa7ab3813 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:30.912803 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6245c42-2d4e-46e8-b461-ba0681d9011e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:30.913373 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6245c42-2d4e-46e8-b461-ba0681d9011e admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:30.913660 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6245c42-2d4e-46e8-b461-ba0681d9011e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:30.913939 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6245c42-2d4e-46e8-b461-ba0681d9011e admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:30.914615 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6245c42-2d4e-46e8-b461-ba0681d9011e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:30.914910 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6245c42-2d4e-46e8-b461-ba0681d9011e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:30.939931 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6245c42-2d4e-46e8-b461-ba0681d9011e admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:30.952665 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 455/909] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:52:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:30.957817 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d5855-5b81-4b0d-9aa2-1f8a6c21cda0 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:30.967372 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d5855-5b81-4b0d-9aa2-1f8a6c21cda0 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:30.971405 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e1e70-0fd1-46d2-91b4-41b50b99d346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:30.972148 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e1e70-0fd1-46d2-91b4-41b50b99d346 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:30.972435 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e1e70-0fd1-46d2-91b4-41b50b99d346 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:30.972713 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e1e70-0fd1-46d2-91b4-41b50b99d346 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:31.060544 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e1e70-0fd1-46d2-91b4-41b50b99d346 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:31.085604 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e1e70-0fd1-46d2-91b4-41b50b99d346 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:31.105104 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-260e1e70-0fd1-46d2-91b4-41b50b99d346 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 14:52:31.106169 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 455/910] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:52:30 2021] GET /identity/v3/users/swift => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:31.112046 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6245c42-2d4e-46e8-b461-ba0681d9011e admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:31.121397 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6245c42-2d4e-46e8-b461-ba0681d9011e admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:31.125452 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d9d8c-191f-4de6-b13c-c379e84e5f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:31.125989 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d9d8c-191f-4de6-b13c-c379e84e5f10 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:31.126278 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d9d8c-191f-4de6-b13c-c379e84e5f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:31.126554 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d9d8c-191f-4de6-b13c-c379e84e5f10 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:31.127343 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d9d8c-191f-4de6-b13c-c379e84e5f10 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:31.127671 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d9d8c-191f-4de6-b13c-c379e84e5f10 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:31.153175 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d9d8c-191f-4de6-b13c-c379e84e5f10 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:31.181966 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 456/911] 10.222.0.89 () {56 vars in 1156 bytes} [Wed Oct 27 14:52:31 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:31.187380 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e1e70-0fd1-46d2-91b4-41b50b99d346 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:31.196409 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e1e70-0fd1-46d2-91b4-41b50b99d346 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:31.200624 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120a79c-1324-4682-b52f-7f1072b4354d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:31.201188 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120a79c-1324-4682-b52f-7f1072b4354d admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:31.201476 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120a79c-1324-4682-b52f-7f1072b4354d admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:31.201755 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e120a79c-1324-4682-b52f-7f1072b4354d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:31.209214 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e120a79c-1324-4682-b52f-7f1072b4354d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:31.235114 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e120a79c-1324-4682-b52f-7f1072b4354d admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:31.243584 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 456/912] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:52:31 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:52:31.249217 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d9d8c-191f-4de6-b13c-c379e84e5f10 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:31.258466 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d9d8c-191f-4de6-b13c-c379e84e5f10 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:31.262463 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe35d457-5dad-4e06-88a3-77cd6399ccdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:31.263177 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35d457-5dad-4e06-88a3-77cd6399ccdc admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:31.263490 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35d457-5dad-4e06-88a3-77cd6399ccdc admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:31.263774 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe35d457-5dad-4e06-88a3-77cd6399ccdc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:31.275052 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe35d457-5dad-4e06-88a3-77cd6399ccdc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:31.301478 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe35d457-5dad-4e06-88a3-77cd6399ccdc admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:31.317897 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-fe35d457-5dad-4e06-88a3-77cd6399ccdc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:52:31.318951 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 457/913] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:52:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:31.324865 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120a79c-1324-4682-b52f-7f1072b4354d admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:31.333159 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e120a79c-1324-4682-b52f-7f1072b4354d admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:31.337107 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b45ce-99da-4bb8-9f98-1d83a39ff73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:31.337676 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b45ce-99da-4bb8-9f98-1d83a39ff73b admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:31.337958 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b45ce-99da-4bb8-9f98-1d83a39ff73b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:31.338833 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b45ce-99da-4bb8-9f98-1d83a39ff73b admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:31.339544 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b45ce-99da-4bb8-9f98-1d83a39ff73b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:31.339838 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b45ce-99da-4bb8-9f98-1d83a39ff73b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:31.364375 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b45ce-99da-4bb8-9f98-1d83a39ff73b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:31.376965 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 457/914] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:52:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:31.381951 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe35d457-5dad-4e06-88a3-77cd6399ccdc admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:31.391427 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe35d457-5dad-4e06-88a3-77cd6399ccdc admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:31.395622 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e6578-1987-4161-babb-6cdd61681bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:31.396321 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e6578-1987-4161-babb-6cdd61681bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:31.396605 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e6578-1987-4161-babb-6cdd61681bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:31.396881 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9e6578-1987-4161-babb-6cdd61681bb8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:31.407808 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e6578-1987-4161-babb-6cdd61681bb8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:31.432867 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9e6578-1987-4161-babb-6cdd61681bb8 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:31.445784 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-fd9e6578-1987-4161-babb-6cdd61681bb8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:52:31.446804 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 458/915] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:52:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:31.452664 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b45ce-99da-4bb8-9f98-1d83a39ff73b admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:31.461610 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b45ce-99da-4bb8-9f98-1d83a39ff73b admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:31.466113 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b879d-c092-497d-95a8-02d4f791aa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:31.466684 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b879d-c092-497d-95a8-02d4f791aa15 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:31.466968 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b879d-c092-497d-95a8-02d4f791aa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:31.467245 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b879d-c092-497d-95a8-02d4f791aa15 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:31.468012 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b879d-c092-497d-95a8-02d4f791aa15 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:31.468313 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b879d-c092-497d-95a8-02d4f791aa15 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:31.493192 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b879d-c092-497d-95a8-02d4f791aa15 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:31.505670 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 458/916] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:52:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:31.511517 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e6578-1987-4161-babb-6cdd61681bb8 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:31.520374 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9e6578-1987-4161-babb-6cdd61681bb8 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:31.524347 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecc868-90a9-4e0f-b9d9-f3fd526a1dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:31.524900 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecc868-90a9-4e0f-b9d9-f3fd526a1dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:31.525180 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecc868-90a9-4e0f-b9d9-f3fd526a1dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:31.525450 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecc868-90a9-4e0f-b9d9-f3fd526a1dd8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:31.526817 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecc868-90a9-4e0f-b9d9-f3fd526a1dd8 admin admin] RBAC: Adding query filter params (role.id=0af8b2c9076246e6ac61d13d88d91976, scope.project.id=f79f19c59cfd43c48871b51d6aaf501f, user.id=ffba82bc9ddf42069a813b932bd310ba) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:31.527113 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecc868-90a9-4e0f-b9d9-f3fd526a1dd8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:31.552204 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecc868-90a9-4e0f-b9d9-f3fd526a1dd8 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:31.557653 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 459/917] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:52:31 2021] GET /identity/v3/role_assignments?user.id=ffba82bc9ddf42069a813b932bd310ba&scope.project.id=f79f19c59cfd43c48871b51d6aaf501f&role.id=0af8b2c9076246e6ac61d13d88d91976 => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:33.546336 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14477c2e-0dd8-4315-9a69-3c1e9d13c639 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:33.546834 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14477c2e-0dd8-4315-9a69-3c1e9d13c639 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:33.546834 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14477c2e-0dd8-4315-9a69-3c1e9d13c639 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:33.548489 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 459/918] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:52:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:52:33.553480 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11014ccf-c982-41e4-8eaf-de9e70b8b319 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:33.553910 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11014ccf-c982-41e4-8eaf-de9e70b8b319 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:33.554027 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11014ccf-c982-41e4-8eaf-de9e70b8b319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:33.652497 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-11014ccf-c982-41e4-8eaf-de9e70b8b319 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:52:33.653650 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-11014ccf-c982-41e4-8eaf-de9e70b8b319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:52:33.660417 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 460/919] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:52:33 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:52:33.682896 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14477c2e-0dd8-4315-9a69-3c1e9d13c639 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:33.694178 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14477c2e-0dd8-4315-9a69-3c1e9d13c639 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:33.698525 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ed534-a2fa-4a27-a37d-6b5d3c8a537c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:33.699226 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ed534-a2fa-4a27-a37d-6b5d3c8a537c admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:33.699542 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ed534-a2fa-4a27-a37d-6b5d3c8a537c admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:33.699818 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ed534-a2fa-4a27-a37d-6b5d3c8a537c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:33.710492 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ed534-a2fa-4a27-a37d-6b5d3c8a537c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:52:33.717285 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-c32ed534-a2fa-4a27-a37d-6b5d3c8a537c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 14:52:33.718328 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 460/920] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:52:33 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:33.723878 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11014ccf-c982-41e4-8eaf-de9e70b8b319 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:33.732226 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11014ccf-c982-41e4-8eaf-de9e70b8b319 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:33.736267 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1de35-7707-4bc2-bdf7-c7b2864cc737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:33.736852 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1de35-7707-4bc2-bdf7-c7b2864cc737 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:33.737138 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1de35-7707-4bc2-bdf7-c7b2864cc737 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:33.737414 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1de35-7707-4bc2-bdf7-c7b2864cc737 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:33.738121 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1de35-7707-4bc2-bdf7-c7b2864cc737 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:33.738416 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1de35-7707-4bc2-bdf7-c7b2864cc737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:33.765309 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1de35-7707-4bc2-bdf7-c7b2864cc737 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:33.773950 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 461/921] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:52:33 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:52:33.779930 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ed534-a2fa-4a27-a37d-6b5d3c8a537c admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:33.789488 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ed534-a2fa-4a27-a37d-6b5d3c8a537c admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:33.793424 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1626f-b6f2-47f8-8ea9-597817cc4533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:33.794104 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1626f-b6f2-47f8-8ea9-597817cc4533 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:33.794388 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1626f-b6f2-47f8-8ea9-597817cc4533 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:33.794662 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1626f-b6f2-47f8-8ea9-597817cc4533 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:33.805479 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1626f-b6f2-47f8-8ea9-597817cc4533 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:33.830693 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1626f-b6f2-47f8-8ea9-597817cc4533 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:33.848015 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-43a1626f-b6f2-47f8-8ea9-597817cc4533 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:52:33.849036 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 461/922] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:52:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:33.854384 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1de35-7707-4bc2-bdf7-c7b2864cc737 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:33.863485 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1de35-7707-4bc2-bdf7-c7b2864cc737 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:33.867533 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ba07e-1824-48df-acfb-72e374ac2e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:33.868104 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ba07e-1824-48df-acfb-72e374ac2e2d admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:33.868390 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ba07e-1824-48df-acfb-72e374ac2e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:33.868667 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ba07e-1824-48df-acfb-72e374ac2e2d admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:33.869342 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ba07e-1824-48df-acfb-72e374ac2e2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:33.869637 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ba07e-1824-48df-acfb-72e374ac2e2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:33.894613 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89ba07e-1824-48df-acfb-72e374ac2e2d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:33.907514 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 462/923] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:52:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:33.912852 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1626f-b6f2-47f8-8ea9-597817cc4533 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:33.921693 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1626f-b6f2-47f8-8ea9-597817cc4533 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:33.925654 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97655b-ce6d-4149-88db-43e1cb7bedb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:33.926334 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97655b-ce6d-4149-88db-43e1cb7bedb9 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:33.926617 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97655b-ce6d-4149-88db-43e1cb7bedb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:33.926891 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97655b-ce6d-4149-88db-43e1cb7bedb9 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:33.938926 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97655b-ce6d-4149-88db-43e1cb7bedb9 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:33.964967 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97655b-ce6d-4149-88db-43e1cb7bedb9 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:33.981719 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-4b97655b-ce6d-4149-88db-43e1cb7bedb9 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 14:52:33.982732 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 462/924] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:52:33 2021] GET /identity/v3/users/swift => generated 83 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:33.988108 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ba07e-1824-48df-acfb-72e374ac2e2d admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:33.997578 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89ba07e-1824-48df-acfb-72e374ac2e2d admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:34.001663 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d8621-9ab2-42cd-aebc-9d4a97ced182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:34.002240 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d8621-9ab2-42cd-aebc-9d4a97ced182 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:34.002526 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d8621-9ab2-42cd-aebc-9d4a97ced182 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:34.002803 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576d8621-9ab2-42cd-aebc-9d4a97ced182 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:34.003629 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d8621-9ab2-42cd-aebc-9d4a97ced182 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:34.003932 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d8621-9ab2-42cd-aebc-9d4a97ced182 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:34.029533 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576d8621-9ab2-42cd-aebc-9d4a97ced182 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:34.058084 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 463/925] 10.222.0.89 () {56 vars in 1156 bytes} [Wed Oct 27 14:52:33 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:52:34.063629 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97655b-ce6d-4149-88db-43e1cb7bedb9 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:34.073333 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97655b-ce6d-4149-88db-43e1cb7bedb9 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:34.077341 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9529a7-4d76-47a6-8ab1-4f6ea5075a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:34.077900 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9529a7-4d76-47a6-8ab1-4f6ea5075a29 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:34.078186 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9529a7-4d76-47a6-8ab1-4f6ea5075a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:34.078464 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9529a7-4d76-47a6-8ab1-4f6ea5075a29 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:34.085893 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9529a7-4d76-47a6-8ab1-4f6ea5075a29 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:34.110707 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9529a7-4d76-47a6-8ab1-4f6ea5075a29 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:34.120444 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 463/926] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:52:34 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:52:34.125631 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d8621-9ab2-42cd-aebc-9d4a97ced182 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:34.134565 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576d8621-9ab2-42cd-aebc-9d4a97ced182 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:34.139256 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cdded-e9f5-4388-b07f-85a956a06594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:34.139984 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cdded-e9f5-4388-b07f-85a956a06594 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:34.140273 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cdded-e9f5-4388-b07f-85a956a06594 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:34.140555 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8cdded-e9f5-4388-b07f-85a956a06594 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:34.151688 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8cdded-e9f5-4388-b07f-85a956a06594 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:34.176789 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8cdded-e9f5-4388-b07f-85a956a06594 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:34.193624 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-2c8cdded-e9f5-4388-b07f-85a956a06594 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:52:34.194667 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 464/927] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:52:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:34.200601 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9529a7-4d76-47a6-8ab1-4f6ea5075a29 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:34.208784 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9529a7-4d76-47a6-8ab1-4f6ea5075a29 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:34.212814 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0ae3a-5d17-494c-8604-a2b2d1cc334d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:34.213387 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0ae3a-5d17-494c-8604-a2b2d1cc334d admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:34.213676 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0ae3a-5d17-494c-8604-a2b2d1cc334d admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:34.213957 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af0ae3a-5d17-494c-8604-a2b2d1cc334d admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:34.214632 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af0ae3a-5d17-494c-8604-a2b2d1cc334d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:34.214931 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af0ae3a-5d17-494c-8604-a2b2d1cc334d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:34.239686 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af0ae3a-5d17-494c-8604-a2b2d1cc334d admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:34.252915 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 464/928] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:52:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:34.258522 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cdded-e9f5-4388-b07f-85a956a06594 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:34.268406 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8cdded-e9f5-4388-b07f-85a956a06594 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:34.272415 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a548e3a-1f85-4f31-bf9e-dde0a788e36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:34.273117 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a548e3a-1f85-4f31-bf9e-dde0a788e36c admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:34.273404 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a548e3a-1f85-4f31-bf9e-dde0a788e36c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:34.273680 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a548e3a-1f85-4f31-bf9e-dde0a788e36c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:34.282355 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a548e3a-1f85-4f31-bf9e-dde0a788e36c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:34.308183 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a548e3a-1f85-4f31-bf9e-dde0a788e36c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:34.321210 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-3a548e3a-1f85-4f31-bf9e-dde0a788e36c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:52:34.322249 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 465/929] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:52:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:34.328339 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0ae3a-5d17-494c-8604-a2b2d1cc334d admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:34.337323 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af0ae3a-5d17-494c-8604-a2b2d1cc334d admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:34.341323 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d2058-27cf-43fd-8d92-acd9ce5e599c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:34.341896 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d2058-27cf-43fd-8d92-acd9ce5e599c admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:34.342182 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d2058-27cf-43fd-8d92-acd9ce5e599c admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:34.342459 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d2058-27cf-43fd-8d92-acd9ce5e599c admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:34.343191 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d2058-27cf-43fd-8d92-acd9ce5e599c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:34.343525 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d2058-27cf-43fd-8d92-acd9ce5e599c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:34.368925 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d2058-27cf-43fd-8d92-acd9ce5e599c admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:34.382095 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 465/930] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:52:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:34.387770 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a548e3a-1f85-4f31-bf9e-dde0a788e36c admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:34.396790 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a548e3a-1f85-4f31-bf9e-dde0a788e36c admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:34.400810 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67607159-6296-4bde-9248-da9755f44713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:34.401371 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67607159-6296-4bde-9248-da9755f44713 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:34.401659 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67607159-6296-4bde-9248-da9755f44713 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:34.401940 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67607159-6296-4bde-9248-da9755f44713 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:34.402711 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67607159-6296-4bde-9248-da9755f44713 admin admin] RBAC: Adding query filter params (role.id=c243fbeb99ae4f51910f72ddc1773778, scope.project.id=f79f19c59cfd43c48871b51d6aaf501f, user.id=ffba82bc9ddf42069a813b932bd310ba) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:34.403012 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67607159-6296-4bde-9248-da9755f44713 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:34.428720 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67607159-6296-4bde-9248-da9755f44713 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:34.434445 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 466/931] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:52:34 2021] GET /identity/v3/role_assignments?user.id=ffba82bc9ddf42069a813b932bd310ba&scope.project.id=f79f19c59cfd43c48871b51d6aaf501f&role.id=c243fbeb99ae4f51910f72ddc1773778 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:36.358714 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b63725-276f-4254-ab61-bb069be64859 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:36.359179 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b63725-276f-4254-ab61-bb069be64859 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:36.359264 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b63725-276f-4254-ab61-bb069be64859 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:36.360980 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 466/932] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:52:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:52:36.366033 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf5f7c-c629-495d-b474-300ce0a529b1 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:36.366417 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf5f7c-c629-495d-b474-300ce0a529b1 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:36.366598 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf5f7c-c629-495d-b474-300ce0a529b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:36.389829 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-cbdf5f7c-c629-495d-b474-300ce0a529b1 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:52:36.390949 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-cbdf5f7c-c629-495d-b474-300ce0a529b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:52:36.397662 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 467/933] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:52:36 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:52:36.419325 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b63725-276f-4254-ab61-bb069be64859 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:36.430689 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b63725-276f-4254-ab61-bb069be64859 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:36.435071 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2845e-b712-4284-b0f7-940e7809e9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:36.435798 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2845e-b712-4284-b0f7-940e7809e9bb admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:36.436085 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2845e-b712-4284-b0f7-940e7809e9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:36.436364 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2845e-b712-4284-b0f7-940e7809e9bb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:36.447134 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2845e-b712-4284-b0f7-940e7809e9bb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:52:36.453868 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-c8a2845e-b712-4284-b0f7-940e7809e9bb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 14:52:36.454911 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 467/934] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:52:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:36.460420 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf5f7c-c629-495d-b474-300ce0a529b1 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:36.468787 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf5f7c-c629-495d-b474-300ce0a529b1 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:36.472791 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a6b85-75c5-4a4f-b83d-229bc0cc7f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:36.473373 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a6b85-75c5-4a4f-b83d-229bc0cc7f7d admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:36.473663 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a6b85-75c5-4a4f-b83d-229bc0cc7f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:36.473940 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a6b85-75c5-4a4f-b83d-229bc0cc7f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:36.474642 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a6b85-75c5-4a4f-b83d-229bc0cc7f7d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:36.474945 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a6b85-75c5-4a4f-b83d-229bc0cc7f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:36.500234 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a6b85-75c5-4a4f-b83d-229bc0cc7f7d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:36.508546 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 468/935] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:52:36 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:36.514202 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2845e-b712-4284-b0f7-940e7809e9bb admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:36.523516 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2845e-b712-4284-b0f7-940e7809e9bb admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:36.527494 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10232eb6-3773-472d-8d3d-11024e286875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:36.528171 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10232eb6-3773-472d-8d3d-11024e286875 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:36.528456 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10232eb6-3773-472d-8d3d-11024e286875 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:36.528731 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10232eb6-3773-472d-8d3d-11024e286875 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:36.539796 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10232eb6-3773-472d-8d3d-11024e286875 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:36.565092 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10232eb6-3773-472d-8d3d-11024e286875 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:36.582499 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-10232eb6-3773-472d-8d3d-11024e286875 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:52:36.583545 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 468/936] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:52:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:36.588808 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a6b85-75c5-4a4f-b83d-229bc0cc7f7d admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:36.597841 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a6b85-75c5-4a4f-b83d-229bc0cc7f7d admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:36.601838 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d67a5e-7ff5-4b6b-8fa9-4481963a87d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:36.602409 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d67a5e-7ff5-4b6b-8fa9-4481963a87d1 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:36.602696 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d67a5e-7ff5-4b6b-8fa9-4481963a87d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:36.602977 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d67a5e-7ff5-4b6b-8fa9-4481963a87d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:36.604185 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d67a5e-7ff5-4b6b-8fa9-4481963a87d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:36.604489 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d67a5e-7ff5-4b6b-8fa9-4481963a87d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:36.629964 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d67a5e-7ff5-4b6b-8fa9-4481963a87d1 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:36.642256 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 469/937] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:52:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:52:36.647401 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10232eb6-3773-472d-8d3d-11024e286875 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:36.656288 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10232eb6-3773-472d-8d3d-11024e286875 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:36.660284 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a786ab-a216-4ea8-90fb-b5cf54831a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:36.660970 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a786ab-a216-4ea8-90fb-b5cf54831a17 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:36.661256 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a786ab-a216-4ea8-90fb-b5cf54831a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:36.661786 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a786ab-a216-4ea8-90fb-b5cf54831a17 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:36.676031 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a786ab-a216-4ea8-90fb-b5cf54831a17 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:36.701627 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a786ab-a216-4ea8-90fb-b5cf54831a17 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:36.718564 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-00a786ab-a216-4ea8-90fb-b5cf54831a17 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 14:52:36.719616 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 469/938] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:52:36 2021] GET /identity/v3/users/swift => generated 83 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:36.724944 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d67a5e-7ff5-4b6b-8fa9-4481963a87d1 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:36.734545 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d67a5e-7ff5-4b6b-8fa9-4481963a87d1 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:36.738556 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e3c3c-becb-4fd6-8d59-c5acfbd084ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:36.739132 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e3c3c-becb-4fd6-8d59-c5acfbd084ac admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:36.739420 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e3c3c-becb-4fd6-8d59-c5acfbd084ac admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:36.739737 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6e3c3c-becb-4fd6-8d59-c5acfbd084ac admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:36.740520 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e3c3c-becb-4fd6-8d59-c5acfbd084ac admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:36.740820 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e3c3c-becb-4fd6-8d59-c5acfbd084ac admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:36.766472 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6e3c3c-becb-4fd6-8d59-c5acfbd084ac admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:36.794871 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 470/939] 10.222.0.89 () {56 vars in 1156 bytes} [Wed Oct 27 14:52:36 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:36.805818 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a786ab-a216-4ea8-90fb-b5cf54831a17 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:36.815658 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a786ab-a216-4ea8-90fb-b5cf54831a17 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:36.819761 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e671a08-822a-4307-bf05-de4f5860ca8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:36.820469 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e671a08-822a-4307-bf05-de4f5860ca8b admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:36.820754 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e671a08-822a-4307-bf05-de4f5860ca8b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:36.821030 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e671a08-822a-4307-bf05-de4f5860ca8b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:36.833261 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e671a08-822a-4307-bf05-de4f5860ca8b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:36.858546 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e671a08-822a-4307-bf05-de4f5860ca8b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:36.875098 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-2e671a08-822a-4307-bf05-de4f5860ca8b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:52:36.876168 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 470/940] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:52:36 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:36.881674 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e3c3c-becb-4fd6-8d59-c5acfbd084ac admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:36.890997 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6e3c3c-becb-4fd6-8d59-c5acfbd084ac admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:36.895099 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83921cf-794a-4752-aa7f-8d52d8a6b4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:36.895719 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83921cf-794a-4752-aa7f-8d52d8a6b4dd admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:36.896009 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83921cf-794a-4752-aa7f-8d52d8a6b4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:36.896290 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83921cf-794a-4752-aa7f-8d52d8a6b4dd admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:36.896972 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83921cf-794a-4752-aa7f-8d52d8a6b4dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:36.897270 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83921cf-794a-4752-aa7f-8d52d8a6b4dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:36.922718 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83921cf-794a-4752-aa7f-8d52d8a6b4dd admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:36.935637 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 471/941] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:52:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:36.940851 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e671a08-822a-4307-bf05-de4f5860ca8b admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:36.949701 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e671a08-822a-4307-bf05-de4f5860ca8b admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:36.953634 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b7157-8a61-48d0-a8c4-ff2e5259a0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:36.954320 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b7157-8a61-48d0-a8c4-ff2e5259a0fa admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:36.954598 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b7157-8a61-48d0-a8c4-ff2e5259a0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:36.954868 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b7157-8a61-48d0-a8c4-ff2e5259a0fa admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:36.963959 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b7157-8a61-48d0-a8c4-ff2e5259a0fa admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:36.989394 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9b7157-8a61-48d0-a8c4-ff2e5259a0fa admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:37.002245 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-4f9b7157-8a61-48d0-a8c4-ff2e5259a0fa admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:52:37.003249 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 471/942] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:52:36 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 14:52:37.008716 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83921cf-794a-4752-aa7f-8d52d8a6b4dd admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:37.017684 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83921cf-794a-4752-aa7f-8d52d8a6b4dd admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:37.021679 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96e0aae-5c92-44b5-ab47-ae20300c8899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:37.022249 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e0aae-5c92-44b5-ab47-ae20300c8899 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:37.022534 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e0aae-5c92-44b5-ab47-ae20300c8899 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:37.022811 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96e0aae-5c92-44b5-ab47-ae20300c8899 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:37.023581 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e0aae-5c92-44b5-ab47-ae20300c8899 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:37.023882 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e0aae-5c92-44b5-ab47-ae20300c8899 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:37.050133 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96e0aae-5c92-44b5-ab47-ae20300c8899 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:37.063803 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 472/943] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:52:37 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:37.069168 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b7157-8a61-48d0-a8c4-ff2e5259a0fa admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:37.078055 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9b7157-8a61-48d0-a8c4-ff2e5259a0fa admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:37.082054 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706eede1-c130-4d1f-8a43-c16b4197abfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:37.082838 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706eede1-c130-4d1f-8a43-c16b4197abfd admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:37.083126 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706eede1-c130-4d1f-8a43-c16b4197abfd admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:37.083407 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706eede1-c130-4d1f-8a43-c16b4197abfd admin admin] PATH_INFO: `/v3/projects/f79f19c59cfd43c48871b51d6aaf501f/users/ffba82bc9ddf42069a813b932bd310ba/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:37.085172 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706eede1-c130-4d1f-8a43-c16b4197abfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79f19c59cfd43c48871b51d6aaf501f, user_id=ffba82bc9ddf42069a813b932bd310ba, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:37.112259 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706eede1-c130-4d1f-8a43-c16b4197abfd admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:37.124217 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 472/944] 10.222.0.89 () {58 vars in 1460 bytes} [Wed Oct 27 14:52:37 2021] PUT /identity/v3/projects/f79f19c59cfd43c48871b51d6aaf501f/users/ffba82bc9ddf42069a813b932bd310ba/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:52:39.064474 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528a12a-e619-400b-bea3-54d9264f69f4 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:39.065016 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528a12a-e619-400b-bea3-54d9264f69f4 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:39.065016 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528a12a-e619-400b-bea3-54d9264f69f4 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:39.066663 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 473/945] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:52:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:52:39.071695 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264af9cf-a784-4d68-94a5-d5dd2bb11a07 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:39.072639 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264af9cf-a784-4d68-94a5-d5dd2bb11a07 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:39.072743 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264af9cf-a784-4d68-94a5-d5dd2bb11a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:39.095259 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-264af9cf-a784-4d68-94a5-d5dd2bb11a07 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:52:39.096430 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-264af9cf-a784-4d68-94a5-d5dd2bb11a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:52:39.157431 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 473/946] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:52:39 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:52:39.180234 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528a12a-e619-400b-bea3-54d9264f69f4 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:39.192066 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528a12a-e619-400b-bea3-54d9264f69f4 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:39.195861 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb99fb-3356-42ec-85ad-65ae8f32670f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:39.196580 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb99fb-3356-42ec-85ad-65ae8f32670f admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:39.196861 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb99fb-3356-42ec-85ad-65ae8f32670f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:39.197132 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb99fb-3356-42ec-85ad-65ae8f32670f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:39.207789 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb99fb-3356-42ec-85ad-65ae8f32670f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:52:39.214374 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-52fb99fb-3356-42ec-85ad-65ae8f32670f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 14:52:39.215487 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 474/947] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:52:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:39.221118 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264af9cf-a784-4d68-94a5-d5dd2bb11a07 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:39.230271 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264af9cf-a784-4d68-94a5-d5dd2bb11a07 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:39.234387 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2a609-0df5-4112-b1a5-69e0d69a814f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:39.234975 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2a609-0df5-4112-b1a5-69e0d69a814f admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:39.235262 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2a609-0df5-4112-b1a5-69e0d69a814f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:39.235573 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2a609-0df5-4112-b1a5-69e0d69a814f admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:39.236279 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2a609-0df5-4112-b1a5-69e0d69a814f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:39.236577 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2a609-0df5-4112-b1a5-69e0d69a814f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:39.261457 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2a609-0df5-4112-b1a5-69e0d69a814f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:39.270018 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 474/948] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:52:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:39.276300 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb99fb-3356-42ec-85ad-65ae8f32670f admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:39.285993 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb99fb-3356-42ec-85ad-65ae8f32670f admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:39.290294 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2647cf0-ebfa-420c-8618-2f6af46466bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:39.291645 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2647cf0-ebfa-420c-8618-2f6af46466bc admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:39.291936 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2647cf0-ebfa-420c-8618-2f6af46466bc admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:39.292211 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2647cf0-ebfa-420c-8618-2f6af46466bc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:39.303086 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2647cf0-ebfa-420c-8618-2f6af46466bc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:39.328028 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2647cf0-ebfa-420c-8618-2f6af46466bc admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:39.345277 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-d2647cf0-ebfa-420c-8618-2f6af46466bc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:52:39.346308 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 475/949] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:52:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:39.351639 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2a609-0df5-4112-b1a5-69e0d69a814f admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:39.361549 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2a609-0df5-4112-b1a5-69e0d69a814f admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:39.365599 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3cc645-29ee-4629-bf93-2b3ee5a06562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:39.366177 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cc645-29ee-4629-bf93-2b3ee5a06562 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:39.366465 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cc645-29ee-4629-bf93-2b3ee5a06562 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:39.366742 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cc645-29ee-4629-bf93-2b3ee5a06562 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:39.367419 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3cc645-29ee-4629-bf93-2b3ee5a06562 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:39.367743 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3cc645-29ee-4629-bf93-2b3ee5a06562 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:39.392448 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3cc645-29ee-4629-bf93-2b3ee5a06562 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:39.405209 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 475/950] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:52:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:39.410494 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2647cf0-ebfa-420c-8618-2f6af46466bc admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:39.420533 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2647cf0-ebfa-420c-8618-2f6af46466bc admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:39.424557 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5f678-c99e-4dad-b68b-c9abd7338d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:39.425260 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5f678-c99e-4dad-b68b-c9abd7338d52 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:39.425547 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5f678-c99e-4dad-b68b-c9abd7338d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:39.425826 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5f678-c99e-4dad-b68b-c9abd7338d52 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:39.438187 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5f678-c99e-4dad-b68b-c9abd7338d52 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:39.463667 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5f678-c99e-4dad-b68b-c9abd7338d52 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:39.481207 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-96b5f678-c99e-4dad-b68b-c9abd7338d52 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 14:52:39.482235 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 476/951] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:52:39 2021] GET /identity/v3/users/swift => generated 83 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:39.487493 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3cc645-29ee-4629-bf93-2b3ee5a06562 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:39.496499 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3cc645-29ee-4629-bf93-2b3ee5a06562 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:39.500485 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a38e2a-40ae-4aed-b952-7be88e094462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:39.501059 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a38e2a-40ae-4aed-b952-7be88e094462 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:39.501346 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a38e2a-40ae-4aed-b952-7be88e094462 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:39.501627 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a38e2a-40ae-4aed-b952-7be88e094462 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:39.502398 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a38e2a-40ae-4aed-b952-7be88e094462 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:39.502699 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a38e2a-40ae-4aed-b952-7be88e094462 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:39.528471 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a38e2a-40ae-4aed-b952-7be88e094462 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:39.562803 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 476/952] 10.222.0.89 () {56 vars in 1156 bytes} [Wed Oct 27 14:52:39 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:52:39.568410 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5f678-c99e-4dad-b68b-c9abd7338d52 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:39.578103 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5f678-c99e-4dad-b68b-c9abd7338d52 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:39.582043 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdfe3f-acbe-409d-83ca-d19af5b76dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:39.582607 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdfe3f-acbe-409d-83ca-d19af5b76dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:39.582891 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdfe3f-acbe-409d-83ca-d19af5b76dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:39.583166 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fdfe3f-acbe-409d-83ca-d19af5b76dd7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:39.591169 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdfe3f-acbe-409d-83ca-d19af5b76dd7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:39.616087 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fdfe3f-acbe-409d-83ca-d19af5b76dd7 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:39.625138 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 477/953] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:52:39 2021] GET /identity/v3/auth/tokens => generated 2973 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:52:39.630482 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a38e2a-40ae-4aed-b952-7be88e094462 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:39.639888 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a38e2a-40ae-4aed-b952-7be88e094462 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:39.643815 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f26ce9-1e79-4704-b038-730c1ff13214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:39.644509 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f26ce9-1e79-4704-b038-730c1ff13214 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:39.644793 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f26ce9-1e79-4704-b038-730c1ff13214 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:39.645065 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f26ce9-1e79-4704-b038-730c1ff13214 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:39.656712 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f26ce9-1e79-4704-b038-730c1ff13214 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:39.681866 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f26ce9-1e79-4704-b038-730c1ff13214 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:39.698363 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-e6f26ce9-1e79-4704-b038-730c1ff13214 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:52:39.699387 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 477/954] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:52:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:39.704657 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdfe3f-acbe-409d-83ca-d19af5b76dd7 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:39.713524 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fdfe3f-acbe-409d-83ca-d19af5b76dd7 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:39.717591 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0242b5a-20f5-48d3-971a-117a0b2dbdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:39.718157 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0242b5a-20f5-48d3-971a-117a0b2dbdac admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:39.718441 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0242b5a-20f5-48d3-971a-117a0b2dbdac admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:39.718716 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0242b5a-20f5-48d3-971a-117a0b2dbdac admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:39.719384 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0242b5a-20f5-48d3-971a-117a0b2dbdac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:39.719704 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0242b5a-20f5-48d3-971a-117a0b2dbdac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:39.744173 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0242b5a-20f5-48d3-971a-117a0b2dbdac admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:39.756274 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 478/955] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:52:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:39.761763 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f26ce9-1e79-4704-b038-730c1ff13214 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:39.770471 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f26ce9-1e79-4704-b038-730c1ff13214 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:39.774363 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b844399-e56f-43a1-824d-b2a90e56e455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:39.775037 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b844399-e56f-43a1-824d-b2a90e56e455 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:39.775935 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b844399-e56f-43a1-824d-b2a90e56e455 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:39.776214 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b844399-e56f-43a1-824d-b2a90e56e455 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:39.784719 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b844399-e56f-43a1-824d-b2a90e56e455 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:39.809815 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b844399-e56f-43a1-824d-b2a90e56e455 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:39.823266 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-7b844399-e56f-43a1-824d-b2a90e56e455 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:52:39.824299 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 478/956] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:52:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:39.829643 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0242b5a-20f5-48d3-971a-117a0b2dbdac admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:39.839074 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0242b5a-20f5-48d3-971a-117a0b2dbdac admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:39.843075 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d9bb5-235b-42c3-95f7-b7989e8bbecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:39.843665 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d9bb5-235b-42c3-95f7-b7989e8bbecd admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:39.843949 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d9bb5-235b-42c3-95f7-b7989e8bbecd admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:39.844227 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d9bb5-235b-42c3-95f7-b7989e8bbecd admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:39.844953 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d9bb5-235b-42c3-95f7-b7989e8bbecd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:39.845249 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d9bb5-235b-42c3-95f7-b7989e8bbecd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:39.870089 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3d9bb5-235b-42c3-95f7-b7989e8bbecd admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:39.882536 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 479/957] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:52:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:39.888457 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b844399-e56f-43a1-824d-b2a90e56e455 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:39.897152 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b844399-e56f-43a1-824d-b2a90e56e455 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:39.901698 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2d7a4-5b38-4788-afbf-cb168219e5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:39.902242 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2d7a4-5b38-4788-afbf-cb168219e5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:39.902522 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2d7a4-5b38-4788-afbf-cb168219e5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:39.902800 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2d7a4-5b38-4788-afbf-cb168219e5c1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:39.903589 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2d7a4-5b38-4788-afbf-cb168219e5c1 admin admin] RBAC: Adding query filter params (role.id=c243fbeb99ae4f51910f72ddc1773778, scope.project.id=f79f19c59cfd43c48871b51d6aaf501f, user.id=ffba82bc9ddf42069a813b932bd310ba) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:39.903886 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2d7a4-5b38-4788-afbf-cb168219e5c1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:39.928883 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2d7a4-5b38-4788-afbf-cb168219e5c1 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:39.934340 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 479/958] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:52:39 2021] GET /identity/v3/role_assignments?user.id=ffba82bc9ddf42069a813b932bd310ba&scope.project.id=f79f19c59cfd43c48871b51d6aaf501f&role.id=c243fbeb99ae4f51910f72ddc1773778 => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:41.879920 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be3c63-d292-4e9a-9530-68081c6a7f25 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:41.880508 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be3c63-d292-4e9a-9530-68081c6a7f25 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:41.880508 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be3c63-d292-4e9a-9530-68081c6a7f25 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:41.882118 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 480/959] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:52:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:52:41.887781 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae310d8-e8fa-4d0e-ba37-eabd4df39502 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:41.888208 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae310d8-e8fa-4d0e-ba37-eabd4df39502 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:41.888356 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae310d8-e8fa-4d0e-ba37-eabd4df39502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:41.915141 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-8ae310d8-e8fa-4d0e-ba37-eabd4df39502 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:52:41.916329 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-8ae310d8-e8fa-4d0e-ba37-eabd4df39502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:52:41.923045 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 480/960] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:52:41 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:52:41.944748 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be3c63-d292-4e9a-9530-68081c6a7f25 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:41.956768 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be3c63-d292-4e9a-9530-68081c6a7f25 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:41.960690 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ebb4c-cb32-4f84-9a51-a3aa493202e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:41.961410 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ebb4c-cb32-4f84-9a51-a3aa493202e8 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:41.961697 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ebb4c-cb32-4f84-9a51-a3aa493202e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:41.961976 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584ebb4c-cb32-4f84-9a51-a3aa493202e8 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:41.962595 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ebb4c-cb32-4f84-9a51-a3aa493202e8 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:41.988179 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584ebb4c-cb32-4f84-9a51-a3aa493202e8 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:41.998488 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-584ebb4c-cb32-4f84-9a51-a3aa493202e8 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 14:52:41.999533 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 481/961] 10.222.0.89 () {56 vars in 1147 bytes} [Wed Oct 27 14:52:41 2021] GET /identity/v3/services/object-store => generated 93 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:42.005037 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae310d8-e8fa-4d0e-ba37-eabd4df39502 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:42.013858 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae310d8-e8fa-4d0e-ba37-eabd4df39502 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:42.017847 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f711d-b1f1-4a8b-a5c4-c7a0b12aaef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:42.018422 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f711d-b1f1-4a8b-a5c4-c7a0b12aaef9 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:42.018705 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f711d-b1f1-4a8b-a5c4-c7a0b12aaef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:42.018981 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f711d-b1f1-4a8b-a5c4-c7a0b12aaef9 admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:42.019673 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f711d-b1f1-4a8b-a5c4-c7a0b12aaef9 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:42.019970 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f711d-b1f1-4a8b-a5c4-c7a0b12aaef9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:42.045968 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f711d-b1f1-4a8b-a5c4-c7a0b12aaef9 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:42.050534 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 481/962] 10.222.0.89 () {56 vars in 1143 bytes} [Wed Oct 27 14:52:42 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:42.055816 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ebb4c-cb32-4f84-9a51-a3aa493202e8 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:42.064802 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584ebb4c-cb32-4f84-9a51-a3aa493202e8 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:42.068836 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15679107-81cd-48c6-b232-952b3648069c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:42.069401 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15679107-81cd-48c6-b232-952b3648069c admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:42.069688 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15679107-81cd-48c6-b232-952b3648069c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:42.069967 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15679107-81cd-48c6-b232-952b3648069c admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:42.070623 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15679107-81cd-48c6-b232-952b3648069c admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:42.070920 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15679107-81cd-48c6-b232-952b3648069c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:42.096921 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15679107-81cd-48c6-b232-952b3648069c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:42.101076 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 482/963] 10.222.0.89 () {56 vars in 1143 bytes} [Wed Oct 27 14:52:42 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:44.023975 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8fdb9-634d-467d-87c6-809a3539f2fd None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:44.024525 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8fdb9-634d-467d-87c6-809a3539f2fd None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:44.024525 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8fdb9-634d-467d-87c6-809a3539f2fd None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:44.026707 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 482/964] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:52:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:52:44.031891 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54121e7-2972-40d5-93b6-e662c1c6f82f None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:44.032315 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54121e7-2972-40d5-93b6-e662c1c6f82f None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:44.032450 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54121e7-2972-40d5-93b6-e662c1c6f82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:44.054989 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-b54121e7-2972-40d5-93b6-e662c1c6f82f None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:52:44.056127 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-b54121e7-2972-40d5-93b6-e662c1c6f82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:52:44.062766 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 483/965] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:52:44 2021] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:52:44.084495 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8fdb9-634d-467d-87c6-809a3539f2fd None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:44.096417 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8fdb9-634d-467d-87c6-809a3539f2fd None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:44.100336 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6399003-3a1a-49d5-8355-471e0c68a352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:44.100908 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6399003-3a1a-49d5-8355-471e0c68a352 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:44.101192 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6399003-3a1a-49d5-8355-471e0c68a352 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:44.101470 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6399003-3a1a-49d5-8355-471e0c68a352 admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:44.102143 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6399003-3a1a-49d5-8355-471e0c68a352 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:44.126942 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6399003-3a1a-49d5-8355-471e0c68a352 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:44.139588 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 483/966] 10.222.0.89 () {60 vars in 1162 bytes} [Wed Oct 27 14:52:44 2021] POST /identity/v3/services => generated 241 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:52:46.092228 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bbf10-1028-45db-afe8-a1a90a171769 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:46.092770 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bbf10-1028-45db-afe8-a1a90a171769 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:46.092770 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bbf10-1028-45db-afe8-a1a90a171769 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:46.094435 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 484/967] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:52:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:52:46.099586 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d7d85-490f-49c5-9199-a52b5b3ca645 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:46.100003 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d7d85-490f-49c5-9199-a52b5b3ca645 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:46.100146 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d7d85-490f-49c5-9199-a52b5b3ca645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:46.123904 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-274d7d85-490f-49c5-9199-a52b5b3ca645 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:52:46.125023 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-274d7d85-490f-49c5-9199-a52b5b3ca645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:52:46.142071 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 484/968] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:52:46 2021] POST /identity/v3/auth/tokens => generated 3075 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:52:46.163367 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bbf10-1028-45db-afe8-a1a90a171769 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:46.174798 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bbf10-1028-45db-afe8-a1a90a171769 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:46.178651 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925fb2e-b75e-401f-8107-01ef031ce09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:46.179358 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925fb2e-b75e-401f-8107-01ef031ce09c admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:46.179667 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925fb2e-b75e-401f-8107-01ef031ce09c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:46.179941 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925fb2e-b75e-401f-8107-01ef031ce09c admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:46.180555 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925fb2e-b75e-401f-8107-01ef031ce09c admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:46.206320 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925fb2e-b75e-401f-8107-01ef031ce09c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:46.216570 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-e925fb2e-b75e-401f-8107-01ef031ce09c admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 14:52:46.217602 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 485/969] 10.222.0.89 () {56 vars in 1147 bytes} [Wed Oct 27 14:52:46 2021] GET /identity/v3/services/object-store => generated 93 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:46.223154 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d7d85-490f-49c5-9199-a52b5b3ca645 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:46.231635 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d7d85-490f-49c5-9199-a52b5b3ca645 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:46.235610 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672e3ae-15cf-48e7-b0d0-91e10afdf930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:46.236186 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672e3ae-15cf-48e7-b0d0-91e10afdf930 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:46.236467 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672e3ae-15cf-48e7-b0d0-91e10afdf930 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:46.236739 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672e3ae-15cf-48e7-b0d0-91e10afdf930 admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:46.237395 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5672e3ae-15cf-48e7-b0d0-91e10afdf930 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:46.237685 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5672e3ae-15cf-48e7-b0d0-91e10afdf930 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:46.263545 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5672e3ae-15cf-48e7-b0d0-91e10afdf930 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:46.268321 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 485/970] 10.222.0.89 () {56 vars in 1143 bytes} [Wed Oct 27 14:52:46 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:46.273892 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925fb2e-b75e-401f-8107-01ef031ce09c admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:46.283031 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925fb2e-b75e-401f-8107-01ef031ce09c admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:46.287339 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de010a2e-aed3-4d29-a263-5d4d1701c214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:46.287947 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de010a2e-aed3-4d29-a263-5d4d1701c214 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:46.288261 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de010a2e-aed3-4d29-a263-5d4d1701c214 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:46.288541 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de010a2e-aed3-4d29-a263-5d4d1701c214 admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:46.289211 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de010a2e-aed3-4d29-a263-5d4d1701c214 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:46.289507 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de010a2e-aed3-4d29-a263-5d4d1701c214 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:46.314645 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de010a2e-aed3-4d29-a263-5d4d1701c214 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:46.319159 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 486/971] 10.222.0.89 () {56 vars in 1143 bytes} [Wed Oct 27 14:52:46 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:46.325231 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672e3ae-15cf-48e7-b0d0-91e10afdf930 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:46.334105 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672e3ae-15cf-48e7-b0d0-91e10afdf930 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:46.338135 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3939b-936a-4c90-bafa-7029e9cfb677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:46.338705 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3939b-936a-4c90-bafa-7029e9cfb677 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:46.338993 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3939b-936a-4c90-bafa-7029e9cfb677 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:46.339275 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3939b-936a-4c90-bafa-7029e9cfb677 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:46.340152 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3939b-936a-4c90-bafa-7029e9cfb677 admin admin] RBAC: Adding query filter params (interface=public, service_id=3c182d26bc314ba0afbcc1cfaf928135, region_id=RegionOne) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:46.340454 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3939b-936a-4c90-bafa-7029e9cfb677 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:46.366560 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3939b-936a-4c90-bafa-7029e9cfb677 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:46.372225 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 486/972] 10.222.0.89 () {56 vars in 1272 bytes} [Wed Oct 27 14:52:46 2021] GET /identity/v3/endpoints?service_id=3c182d26bc314ba0afbcc1cfaf928135&interface=public®ion_id=RegionOne => generated 194 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:46.377292 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de010a2e-aed3-4d29-a263-5d4d1701c214 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:46.386155 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de010a2e-aed3-4d29-a263-5d4d1701c214 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:46.390167 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338af2e1-6b93-4b76-bfd9-ea42cbfe32b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:46.390729 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338af2e1-6b93-4b76-bfd9-ea42cbfe32b8 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:46.391017 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338af2e1-6b93-4b76-bfd9-ea42cbfe32b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:46.391298 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338af2e1-6b93-4b76-bfd9-ea42cbfe32b8 admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:46.391976 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338af2e1-6b93-4b76-bfd9-ea42cbfe32b8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:46.417431 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338af2e1-6b93-4b76-bfd9-ea42cbfe32b8 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:46.423985 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 487/973] 10.222.0.89 () {56 vars in 1108 bytes} [Wed Oct 27 14:52:46 2021] GET /identity/v3/services => generated 2196 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:52:48.370268 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83ffd1-93b2-4270-8851-ea793c85ec10 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:48.370790 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83ffd1-93b2-4270-8851-ea793c85ec10 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:48.370890 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83ffd1-93b2-4270-8851-ea793c85ec10 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:48.372519 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 487/974] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:52:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:52:48.377622 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af3e72-2480-44f2-ac97-15c820c3edd8 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:48.378052 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af3e72-2480-44f2-ac97-15c820c3edd8 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:48.378191 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3af3e72-2480-44f2-ac97-15c820c3edd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:48.400533 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-d3af3e72-2480-44f2-ac97-15c820c3edd8 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:52:48.401656 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-d3af3e72-2480-44f2-ac97-15c820c3edd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:52:48.408378 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 488/975] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:52:48 2021] POST /identity/v3/auth/tokens => generated 3075 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:52:48.430435 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83ffd1-93b2-4270-8851-ea793c85ec10 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:48.441731 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83ffd1-93b2-4270-8851-ea793c85ec10 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:48.445613 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea52c8-88db-4a93-8623-e681045ccf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:48.446327 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea52c8-88db-4a93-8623-e681045ccf30 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:48.446611 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea52c8-88db-4a93-8623-e681045ccf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:48.446885 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea52c8-88db-4a93-8623-e681045ccf30 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:48.447552 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea52c8-88db-4a93-8623-e681045ccf30 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:48.472834 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea52c8-88db-4a93-8623-e681045ccf30 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:48.483837 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-acea52c8-88db-4a93-8623-e681045ccf30 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 14:52:48.484876 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 488/976] 10.222.0.89 () {56 vars in 1147 bytes} [Wed Oct 27 14:52:48 2021] GET /identity/v3/services/object-store => generated 93 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:48.490952 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af3e72-2480-44f2-ac97-15c820c3edd8 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:48.499460 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3af3e72-2480-44f2-ac97-15c820c3edd8 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:48.503675 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e4b94-7658-429a-821d-8608cc0dd1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:48.504262 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e4b94-7658-429a-821d-8608cc0dd1bc admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:48.504552 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e4b94-7658-429a-821d-8608cc0dd1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:48.504833 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e4b94-7658-429a-821d-8608cc0dd1bc admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:48.505509 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e4b94-7658-429a-821d-8608cc0dd1bc admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:48.505996 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e4b94-7658-429a-821d-8608cc0dd1bc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:48.531730 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e4b94-7658-429a-821d-8608cc0dd1bc admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:48.536833 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 489/977] 10.222.0.89 () {56 vars in 1143 bytes} [Wed Oct 27 14:52:48 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:48.543083 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea52c8-88db-4a93-8623-e681045ccf30 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:48.552160 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea52c8-88db-4a93-8623-e681045ccf30 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:48.556520 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a844c-47fd-432a-9cb5-b63a666ae1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:48.557090 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a844c-47fd-432a-9cb5-b63a666ae1bd admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:48.557373 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a844c-47fd-432a-9cb5-b63a666ae1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:48.557645 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a844c-47fd-432a-9cb5-b63a666ae1bd admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:48.558304 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a844c-47fd-432a-9cb5-b63a666ae1bd admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:48.558596 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a844c-47fd-432a-9cb5-b63a666ae1bd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:48.583698 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a844c-47fd-432a-9cb5-b63a666ae1bd admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:48.588764 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 489/978] 10.222.0.89 () {56 vars in 1143 bytes} [Wed Oct 27 14:52:48 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:48.594000 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e4b94-7658-429a-821d-8608cc0dd1bc admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:48.603609 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e4b94-7658-429a-821d-8608cc0dd1bc admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:48.607736 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4432eda-754f-4452-a8fb-0cff77385693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:48.608306 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4432eda-754f-4452-a8fb-0cff77385693 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:48.608595 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4432eda-754f-4452-a8fb-0cff77385693 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:48.608875 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4432eda-754f-4452-a8fb-0cff77385693 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:48.609600 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4432eda-754f-4452-a8fb-0cff77385693 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:48.634895 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4432eda-754f-4452-a8fb-0cff77385693 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:48.651576 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 490/979] 10.222.0.89 () {60 vars in 1165 bytes} [Wed Oct 27 14:52:48 2021] POST /identity/v3/endpoints => generated 349 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:52:50.591629 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ec9b4-7353-43fd-a1ec-3135e6448ddb None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:50.592115 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ec9b4-7353-43fd-a1ec-3135e6448ddb None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:50.592115 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ec9b4-7353-43fd-a1ec-3135e6448ddb None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:50.593776 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 490/980] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:52:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:52:50.598749 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29859999-f6e9-44ad-a1ff-afa27231b4fd None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:50.599181 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29859999-f6e9-44ad-a1ff-afa27231b4fd None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:50.599312 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29859999-f6e9-44ad-a1ff-afa27231b4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:50.621584 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-29859999-f6e9-44ad-a1ff-afa27231b4fd None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:52:50.622697 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-29859999-f6e9-44ad-a1ff-afa27231b4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:52:50.639093 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 491/981] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:52:50 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:52:50.661374 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ec9b4-7353-43fd-a1ec-3135e6448ddb None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:50.673442 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ec9b4-7353-43fd-a1ec-3135e6448ddb None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:50.677649 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceba50b-416f-4fa6-aa59-13ed1e9a9bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:50.678366 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceba50b-416f-4fa6-aa59-13ed1e9a9bee admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:50.678656 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceba50b-416f-4fa6-aa59-13ed1e9a9bee admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:50.678934 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceba50b-416f-4fa6-aa59-13ed1e9a9bee admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:50.679617 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceba50b-416f-4fa6-aa59-13ed1e9a9bee admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:50.704661 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceba50b-416f-4fa6-aa59-13ed1e9a9bee admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:50.715494 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-aceba50b-416f-4fa6-aa59-13ed1e9a9bee admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 14:52:50.716531 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 491/982] 10.222.0.89 () {56 vars in 1147 bytes} [Wed Oct 27 14:52:50 2021] GET /identity/v3/services/object-store => generated 93 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:50.722303 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29859999-f6e9-44ad-a1ff-afa27231b4fd None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:50.731346 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29859999-f6e9-44ad-a1ff-afa27231b4fd None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:50.735346 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb41fc4-b8cd-4c67-bfb6-78f384c560d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:50.735952 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb41fc4-b8cd-4c67-bfb6-78f384c560d3 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:50.736236 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb41fc4-b8cd-4c67-bfb6-78f384c560d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:50.736512 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb41fc4-b8cd-4c67-bfb6-78f384c560d3 admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:50.737175 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb41fc4-b8cd-4c67-bfb6-78f384c560d3 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:50.737467 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb41fc4-b8cd-4c67-bfb6-78f384c560d3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:50.762561 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb41fc4-b8cd-4c67-bfb6-78f384c560d3 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:50.767306 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 492/983] 10.222.0.89 () {56 vars in 1143 bytes} [Wed Oct 27 14:52:50 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:50.772778 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceba50b-416f-4fa6-aa59-13ed1e9a9bee admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:50.783218 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceba50b-416f-4fa6-aa59-13ed1e9a9bee admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:50.787458 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4042be0-5d46-4f29-83d8-1b9f5b02f5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:50.788040 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4042be0-5d46-4f29-83d8-1b9f5b02f5af admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:50.788322 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4042be0-5d46-4f29-83d8-1b9f5b02f5af admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:50.788595 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4042be0-5d46-4f29-83d8-1b9f5b02f5af admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:50.789248 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4042be0-5d46-4f29-83d8-1b9f5b02f5af admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:50.789539 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4042be0-5d46-4f29-83d8-1b9f5b02f5af admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:50.814667 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4042be0-5d46-4f29-83d8-1b9f5b02f5af admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:50.819112 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 492/984] 10.222.0.89 () {56 vars in 1143 bytes} [Wed Oct 27 14:52:50 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:50.824899 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb41fc4-b8cd-4c67-bfb6-78f384c560d3 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:50.833837 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb41fc4-b8cd-4c67-bfb6-78f384c560d3 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:50.837894 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fa31a5-2cda-40a6-8361-dcaeffa4b983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:50.839016 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa31a5-2cda-40a6-8361-dcaeffa4b983 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:50.839302 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa31a5-2cda-40a6-8361-dcaeffa4b983 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:50.839608 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa31a5-2cda-40a6-8361-dcaeffa4b983 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:50.840344 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa31a5-2cda-40a6-8361-dcaeffa4b983 admin admin] RBAC: Adding query filter params (interface=admin, service_id=3c182d26bc314ba0afbcc1cfaf928135, region_id=RegionOne) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:50.840643 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa31a5-2cda-40a6-8361-dcaeffa4b983 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:50.865368 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fa31a5-2cda-40a6-8361-dcaeffa4b983 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:50.870486 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 493/985] 10.222.0.89 () {56 vars in 1270 bytes} [Wed Oct 27 14:52:50 2021] GET /identity/v3/endpoints?service_id=3c182d26bc314ba0afbcc1cfaf928135&interface=admin®ion_id=RegionOne => generated 193 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:52:50.875375 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4042be0-5d46-4f29-83d8-1b9f5b02f5af admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:50.884700 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4042be0-5d46-4f29-83d8-1b9f5b02f5af admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:50.889498 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653fb7e-4b4e-4169-9ae9-0ece14a89dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:50.890070 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653fb7e-4b4e-4169-9ae9-0ece14a89dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:50.890353 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653fb7e-4b4e-4169-9ae9-0ece14a89dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:50.890624 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653fb7e-4b4e-4169-9ae9-0ece14a89dc1 admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:50.891262 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a653fb7e-4b4e-4169-9ae9-0ece14a89dc1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:50.917015 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a653fb7e-4b4e-4169-9ae9-0ece14a89dc1 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:50.923642 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 493/986] 10.222.0.89 () {56 vars in 1108 bytes} [Wed Oct 27 14:52:50 2021] GET /identity/v3/services => generated 2196 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:52:52.836540 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11219c62-5e8b-4d27-86f8-3b83aa709323 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:52.837094 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11219c62-5e8b-4d27-86f8-3b83aa709323 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:52.837094 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11219c62-5e8b-4d27-86f8-3b83aa709323 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:52.839304 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 494/987] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:52:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:52:52.844505 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb0e02-dd81-4275-a8a6-f23e65bca373 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:52.844947 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb0e02-dd81-4275-a8a6-f23e65bca373 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:52.845069 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb0e02-dd81-4275-a8a6-f23e65bca373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:52.867457 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-9aeb0e02-dd81-4275-a8a6-f23e65bca373 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:52:52.868598 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-9aeb0e02-dd81-4275-a8a6-f23e65bca373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:52:52.875236 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 494/988] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:52:52 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:52:52.897695 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11219c62-5e8b-4d27-86f8-3b83aa709323 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:52.909620 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11219c62-5e8b-4d27-86f8-3b83aa709323 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:52.913828 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d58b7-f559-4179-9e12-3d10ae4f1c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:52.914541 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d58b7-f559-4179-9e12-3d10ae4f1c4d admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:52.914830 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d58b7-f559-4179-9e12-3d10ae4f1c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:52.915111 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d58b7-f559-4179-9e12-3d10ae4f1c4d admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:52.916343 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d58b7-f559-4179-9e12-3d10ae4f1c4d admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:52.941140 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d58b7-f559-4179-9e12-3d10ae4f1c4d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:52.951433 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-2e3d58b7-f559-4179-9e12-3d10ae4f1c4d admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 14:52:52.952480 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 495/989] 10.222.0.89 () {56 vars in 1147 bytes} [Wed Oct 27 14:52:52 2021] GET /identity/v3/services/object-store => generated 93 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:52.958034 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb0e02-dd81-4275-a8a6-f23e65bca373 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:52.966811 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb0e02-dd81-4275-a8a6-f23e65bca373 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:52.970807 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7e433-110b-4f26-9a50-95a766cbe0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:52.971381 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7e433-110b-4f26-9a50-95a766cbe0ee admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:52.971696 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7e433-110b-4f26-9a50-95a766cbe0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:52.971972 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7e433-110b-4f26-9a50-95a766cbe0ee admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:52.972629 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7e433-110b-4f26-9a50-95a766cbe0ee admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:52.972922 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7e433-110b-4f26-9a50-95a766cbe0ee admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:52.998225 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7e433-110b-4f26-9a50-95a766cbe0ee admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:53.002867 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 495/990] 10.222.0.89 () {56 vars in 1143 bytes} [Wed Oct 27 14:52:52 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:53.008068 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d58b7-f559-4179-9e12-3d10ae4f1c4d admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:53.016948 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d58b7-f559-4179-9e12-3d10ae4f1c4d admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:53.020985 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a1da0-e1fe-4872-ab47-11cae613bf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:53.021546 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a1da0-e1fe-4872-ab47-11cae613bf9a admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:53.021834 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a1da0-e1fe-4872-ab47-11cae613bf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:53.022115 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a1da0-e1fe-4872-ab47-11cae613bf9a admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:53.022773 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a1da0-e1fe-4872-ab47-11cae613bf9a admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:53.023069 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a1da0-e1fe-4872-ab47-11cae613bf9a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:53.049186 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a1da0-e1fe-4872-ab47-11cae613bf9a admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:53.053710 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 496/991] 10.222.0.89 () {56 vars in 1143 bytes} [Wed Oct 27 14:52:53 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:53.058879 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7e433-110b-4f26-9a50-95a766cbe0ee admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:53.067550 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7e433-110b-4f26-9a50-95a766cbe0ee admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:53.071484 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d882c-b2e3-4f63-a317-84c356c39862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:53.072535 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d882c-b2e3-4f63-a317-84c356c39862 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:53.072815 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d882c-b2e3-4f63-a317-84c356c39862 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:53.073088 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d882c-b2e3-4f63-a317-84c356c39862 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:53.073758 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d882c-b2e3-4f63-a317-84c356c39862 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:53.098335 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d882c-b2e3-4f63-a317-84c356c39862 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:53.113238 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 496/992] 10.222.0.89 () {60 vars in 1165 bytes} [Wed Oct 27 14:52:53 2021] POST /identity/v3/endpoints => generated 325 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:52:55.069530 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d068d4-b6be-41e5-97c7-57433f358b2f None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:55.070056 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d068d4-b6be-41e5-97c7-57433f358b2f None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:55.070056 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d068d4-b6be-41e5-97c7-57433f358b2f None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:55.071820 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 497/993] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:52:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:52:55.076939 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad15b5-7059-41db-80b4-c1693fb34324 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:55.077373 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad15b5-7059-41db-80b4-c1693fb34324 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:55.077513 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad15b5-7059-41db-80b4-c1693fb34324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:55.099862 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-c6ad15b5-7059-41db-80b4-c1693fb34324 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:52:55.100991 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-c6ad15b5-7059-41db-80b4-c1693fb34324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:52:55.118449 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 497/994] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:52:55 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:52:55.140410 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d068d4-b6be-41e5-97c7-57433f358b2f None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:55.152287 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d068d4-b6be-41e5-97c7-57433f358b2f None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:55.156182 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873bc38-7aac-4282-841b-4a697231fea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:55.156879 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873bc38-7aac-4282-841b-4a697231fea8 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:55.157164 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873bc38-7aac-4282-841b-4a697231fea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:55.157439 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873bc38-7aac-4282-841b-4a697231fea8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:55.158487 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873bc38-7aac-4282-841b-4a697231fea8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:55.184081 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d873bc38-7aac-4282-841b-4a697231fea8 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:55.185494 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 498/995] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:52:55 2021] GET /identity/v3/domains/default => generated 199 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:55.190925 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad15b5-7059-41db-80b4-c1693fb34324 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:55.199274 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad15b5-7059-41db-80b4-c1693fb34324 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:55.203373 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b91c0-b36b-4fe6-b815-e8639689d6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:55.203988 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b91c0-b36b-4fe6-b815-e8639689d6fd admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:55.204276 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b91c0-b36b-4fe6-b815-e8639689d6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:55.204555 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b91c0-b36b-4fe6-b815-e8639689d6fd admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:55.205197 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b91c0-b36b-4fe6-b815-e8639689d6fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:55.231604 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262b91c0-b36b-4fe6-b815-e8639689d6fd admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:55.258043 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 498/996] 10.222.0.89 () {60 vars in 1162 bytes} [Wed Oct 27 14:52:55 2021] POST /identity/v3/projects => generated 311 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:52:57.238926 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04030972-0f7e-4542-8b2c-79a4321c2e86 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:57.239475 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04030972-0f7e-4542-8b2c-79a4321c2e86 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:57.239568 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04030972-0f7e-4542-8b2c-79a4321c2e86 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:57.241174 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 499/997] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:52:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:52:57.246883 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418928e-8e38-49d5-92a6-47ff759d4526 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:57.247302 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418928e-8e38-49d5-92a6-47ff759d4526 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:57.247644 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418928e-8e38-49d5-92a6-47ff759d4526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:57.269549 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-c418928e-8e38-49d5-92a6-47ff759d4526 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:52:57.270666 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-c418928e-8e38-49d5-92a6-47ff759d4526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:52:57.331514 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 499/998] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:52:57 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:52:57.354830 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04030972-0f7e-4542-8b2c-79a4321c2e86 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:57.366115 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04030972-0f7e-4542-8b2c-79a4321c2e86 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:57.370438 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639901ed-ce69-4b90-83af-376c220f6bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:57.371133 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639901ed-ce69-4b90-83af-376c220f6bfa admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:57.371416 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639901ed-ce69-4b90-83af-376c220f6bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:57.371722 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639901ed-ce69-4b90-83af-376c220f6bfa admin admin] PATH_INFO: `/v3/domains/default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:57.372766 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639901ed-ce69-4b90-83af-376c220f6bfa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:57.398448 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639901ed-ce69-4b90-83af-376c220f6bfa admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:57.399938 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 500/999] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:52:57 2021] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:57.405701 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418928e-8e38-49d5-92a6-47ff759d4526 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:57.414480 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418928e-8e38-49d5-92a6-47ff759d4526 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:57.418609 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03988c71-3b5d-4583-95ab-d8875ae68246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:57.419198 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03988c71-3b5d-4583-95ab-d8875ae68246 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:57.419522 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03988c71-3b5d-4583-95ab-d8875ae68246 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:57.419804 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03988c71-3b5d-4583-95ab-d8875ae68246 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:57.420494 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03988c71-3b5d-4583-95ab-d8875ae68246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:57.446057 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03988c71-3b5d-4583-95ab-d8875ae68246 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:57.465302 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 500/1000] 10.222.0.89 () {60 vars in 1153 bytes} [Wed Oct 27 14:52:57 2021] POST /identity/v3/users => generated 285 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:52:59.448780 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4255409-dae1-4e17-98aa-4e98fd557c36 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:59.449318 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4255409-dae1-4e17-98aa-4e98fd557c36 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:59.449318 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4255409-dae1-4e17-98aa-4e98fd557c36 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:59.450990 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 501/1001] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:52:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:52:59.456157 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec76b9a-c8a1-4078-9cee-3f493588938c None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:59.456694 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec76b9a-c8a1-4078-9cee-3f493588938c None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:59.456694 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec76b9a-c8a1-4078-9cee-3f493588938c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:59.479565 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-1ec76b9a-c8a1-4078-9cee-3f493588938c None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:52:59.480694 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-1ec76b9a-c8a1-4078-9cee-3f493588938c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:52:59.487384 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 501/1002] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:52:59 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:52:59.509815 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4255409-dae1-4e17-98aa-4e98fd557c36 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:59.520990 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4255409-dae1-4e17-98aa-4e98fd557c36 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:59.525355 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226317de-203a-40a6-95a5-e6ec2bde6aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:59.526091 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226317de-203a-40a6-95a5-e6ec2bde6aee admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:59.526369 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226317de-203a-40a6-95a5-e6ec2bde6aee admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:59.526641 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226317de-203a-40a6-95a5-e6ec2bde6aee admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:59.538484 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226317de-203a-40a6-95a5-e6ec2bde6aee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:52:59.545225 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-226317de-203a-40a6-95a5-e6ec2bde6aee admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 14:52:59.546276 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 502/1003] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:52:59 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:52:59.551881 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec76b9a-c8a1-4078-9cee-3f493588938c None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:59.560257 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec76b9a-c8a1-4078-9cee-3f493588938c None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:59.564268 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577866b1-ca91-407e-9f1d-165a90e176a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:59.564848 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577866b1-ca91-407e-9f1d-165a90e176a7 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:59.565135 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577866b1-ca91-407e-9f1d-165a90e176a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:59.565415 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577866b1-ca91-407e-9f1d-165a90e176a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:59.566117 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577866b1-ca91-407e-9f1d-165a90e176a7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:59.566420 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577866b1-ca91-407e-9f1d-165a90e176a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:59.591591 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577866b1-ca91-407e-9f1d-165a90e176a7 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:59.599852 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 502/1004] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:52:59 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:59.605822 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226317de-203a-40a6-95a5-e6ec2bde6aee admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:59.614933 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226317de-203a-40a6-95a5-e6ec2bde6aee admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:59.618946 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962470a9-46a3-4785-8b80-5c94f0914c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:59.619808 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962470a9-46a3-4785-8b80-5c94f0914c3c admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:59.620095 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962470a9-46a3-4785-8b80-5c94f0914c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:59.620375 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962470a9-46a3-4785-8b80-5c94f0914c3c admin admin] PATH_INFO: `/v3/users/3a6bfc723b354784af63c6adfbe4642d` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:59.638200 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962470a9-46a3-4785-8b80-5c94f0914c3c admin admin] RBAC: Authorizing `identity:get_user(user_id=3a6bfc723b354784af63c6adfbe4642d)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:59.664245 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962470a9-46a3-4785-8b80-5c94f0914c3c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:59.666313 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 503/1005] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:52:59 2021] GET /identity/v3/users/3a6bfc723b354784af63c6adfbe4642d => generated 285 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:52:59.671647 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577866b1-ca91-407e-9f1d-165a90e176a7 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:59.680517 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577866b1-ca91-407e-9f1d-165a90e176a7 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:59.684540 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23819f9b-7d10-472f-bd5c-88024c711f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:59.685100 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23819f9b-7d10-472f-bd5c-88024c711f9a admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:59.685387 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23819f9b-7d10-472f-bd5c-88024c711f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:59.685664 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23819f9b-7d10-472f-bd5c-88024c711f9a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:59.693060 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23819f9b-7d10-472f-bd5c-88024c711f9a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:59.718352 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23819f9b-7d10-472f-bd5c-88024c711f9a admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:59.726537 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 503/1006] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:52:59 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:52:59.732517 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962470a9-46a3-4785-8b80-5c94f0914c3c admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:59.741390 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962470a9-46a3-4785-8b80-5c94f0914c3c admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:59.745433 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd9eb14-4439-4406-95f7-f5942febe88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:59.746194 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9eb14-4439-4406-95f7-f5942febe88c admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:59.746480 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9eb14-4439-4406-95f7-f5942febe88c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:59.746759 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd9eb14-4439-4406-95f7-f5942febe88c admin admin] PATH_INFO: `/v3/projects/d9060ccbdeba4080b6b83d9884d2eb3e` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:59.747888 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9eb14-4439-4406-95f7-f5942febe88c admin admin] RBAC: Authorizing `identity:get_project(project_id=d9060ccbdeba4080b6b83d9884d2eb3e)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:59.773026 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd9eb14-4439-4406-95f7-f5942febe88c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:59.774599 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 504/1007] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:52:59 2021] GET /identity/v3/projects/d9060ccbdeba4080b6b83d9884d2eb3e => generated 311 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:52:59.780264 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23819f9b-7d10-472f-bd5c-88024c711f9a admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:52:59.788545 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23819f9b-7d10-472f-bd5c-88024c711f9a admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:52:59.793146 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3b691c-b9ab-4bba-a8ec-c92c21d54637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:52:59.793698 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b691c-b9ab-4bba-a8ec-c92c21d54637 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:52:59.793984 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b691c-b9ab-4bba-a8ec-c92c21d54637 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:52:59.794265 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3b691c-b9ab-4bba-a8ec-c92c21d54637 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:52:59.795023 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b691c-b9ab-4bba-a8ec-c92c21d54637 admin admin] RBAC: Adding query filter params (role.id=c243fbeb99ae4f51910f72ddc1773778, scope.project.id=d9060ccbdeba4080b6b83d9884d2eb3e, user.id=3a6bfc723b354784af63c6adfbe4642d) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:52:59.795324 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b691c-b9ab-4bba-a8ec-c92c21d54637 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:52:59.820114 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3b691c-b9ab-4bba-a8ec-c92c21d54637 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:52:59.825705 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 504/1008] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:52:59 2021] GET /identity/v3/role_assignments?user.id=3a6bfc723b354784af63c6adfbe4642d&scope.project.id=d9060ccbdeba4080b6b83d9884d2eb3e&role.id=c243fbeb99ae4f51910f72ddc1773778 => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:01.749024 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa119d5-c6d8-4925-acbb-3ad2ab2ff39c None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:01.749577 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa119d5-c6d8-4925-acbb-3ad2ab2ff39c None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:01.749577 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa119d5-c6d8-4925-acbb-3ad2ab2ff39c None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:01.751241 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 505/1009] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:53:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:53:01.756450 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e713fb-6c90-40b1-9d4a-8c28a4d618b3 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:01.756828 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e713fb-6c90-40b1-9d4a-8c28a4d618b3 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:01.757016 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e713fb-6c90-40b1-9d4a-8c28a4d618b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:01.779241 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-81e713fb-6c90-40b1-9d4a-8c28a4d618b3 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:53:01.780392 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-81e713fb-6c90-40b1-9d4a-8c28a4d618b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:53:01.787223 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 505/1010] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:53:01 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:53:01.809216 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa119d5-c6d8-4925-acbb-3ad2ab2ff39c None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:01.820471 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa119d5-c6d8-4925-acbb-3ad2ab2ff39c None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:01.824366 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb4e08-1c8e-43d4-8a8b-e0a84de6f1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:01.825056 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb4e08-1c8e-43d4-8a8b-e0a84de6f1d9 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:01.825339 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb4e08-1c8e-43d4-8a8b-e0a84de6f1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:01.825615 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeb4e08-1c8e-43d4-8a8b-e0a84de6f1d9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:01.836335 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeb4e08-1c8e-43d4-8a8b-e0a84de6f1d9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:53:01.842903 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-4aeb4e08-1c8e-43d4-8a8b-e0a84de6f1d9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 14:53:01.843967 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 506/1011] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:53:01 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:53:01.849395 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e713fb-6c90-40b1-9d4a-8c28a4d618b3 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:01.858183 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e713fb-6c90-40b1-9d4a-8c28a4d618b3 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:01.862169 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0749b07-6c06-4fa0-88d2-16faf1288d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:01.862746 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0749b07-6c06-4fa0-88d2-16faf1288d37 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:01.863032 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0749b07-6c06-4fa0-88d2-16faf1288d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:01.863308 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0749b07-6c06-4fa0-88d2-16faf1288d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:01.864039 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0749b07-6c06-4fa0-88d2-16faf1288d37 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:53:01.864335 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0749b07-6c06-4fa0-88d2-16faf1288d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:01.888996 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0749b07-6c06-4fa0-88d2-16faf1288d37 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:01.897189 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 506/1012] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:53:01 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:01.903015 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb4e08-1c8e-43d4-8a8b-e0a84de6f1d9 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:01.914137 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeb4e08-1c8e-43d4-8a8b-e0a84de6f1d9 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:01.918716 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d307a-c9f9-44bc-b8e1-f75671480199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:01.919485 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d307a-c9f9-44bc-b8e1-f75671480199 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:01.919771 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d307a-c9f9-44bc-b8e1-f75671480199 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:01.920046 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d307a-c9f9-44bc-b8e1-f75671480199 admin admin] PATH_INFO: `/v3/users/3a6bfc723b354784af63c6adfbe4642d` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:01.921111 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d307a-c9f9-44bc-b8e1-f75671480199 admin admin] RBAC: Authorizing `identity:get_user(user_id=3a6bfc723b354784af63c6adfbe4642d)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:01.945937 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d307a-c9f9-44bc-b8e1-f75671480199 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:01.947335 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 507/1013] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:53:01 2021] GET /identity/v3/users/3a6bfc723b354784af63c6adfbe4642d => generated 285 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:01.952464 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0749b07-6c06-4fa0-88d2-16faf1288d37 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:01.961195 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0749b07-6c06-4fa0-88d2-16faf1288d37 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:01.965732 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2aefd-1f1c-49c4-9666-54bd973f2351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:01.966482 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2aefd-1f1c-49c4-9666-54bd973f2351 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:01.966770 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2aefd-1f1c-49c4-9666-54bd973f2351 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:01.967047 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2aefd-1f1c-49c4-9666-54bd973f2351 admin admin] PATH_INFO: `/v3/projects/d9060ccbdeba4080b6b83d9884d2eb3e` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:01.968127 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c2aefd-1f1c-49c4-9666-54bd973f2351 admin admin] RBAC: Authorizing `identity:get_project(project_id=d9060ccbdeba4080b6b83d9884d2eb3e)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:01.993854 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c2aefd-1f1c-49c4-9666-54bd973f2351 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:01.995313 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 507/1014] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:53:01 2021] GET /identity/v3/projects/d9060ccbdeba4080b6b83d9884d2eb3e => generated 311 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:02.000551 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d307a-c9f9-44bc-b8e1-f75671480199 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:02.009244 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d307a-c9f9-44bc-b8e1-f75671480199 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:02.013178 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4522d8d1-f959-40ee-ac87-6ce3d7f188ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:02.013943 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522d8d1-f959-40ee-ac87-6ce3d7f188ef admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:02.014225 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522d8d1-f959-40ee-ac87-6ce3d7f188ef admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:02.014499 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4522d8d1-f959-40ee-ac87-6ce3d7f188ef admin admin] PATH_INFO: `/v3/projects/d9060ccbdeba4080b6b83d9884d2eb3e/users/3a6bfc723b354784af63c6adfbe4642d/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:02.016207 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522d8d1-f959-40ee-ac87-6ce3d7f188ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9060ccbdeba4080b6b83d9884d2eb3e, user_id=3a6bfc723b354784af63c6adfbe4642d, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:02.043115 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4522d8d1-f959-40ee-ac87-6ce3d7f188ef admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:02.055756 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 508/1015] 10.222.0.89 () {58 vars in 1460 bytes} [Wed Oct 27 14:53:01 2021] PUT /identity/v3/projects/d9060ccbdeba4080b6b83d9884d2eb3e/users/3a6bfc723b354784af63c6adfbe4642d/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:53:03.958305 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d83201-7eb4-4624-9948-1b6497ac4aa5 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:03.959843 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d83201-7eb4-4624-9948-1b6497ac4aa5 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:03.959843 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d83201-7eb4-4624-9948-1b6497ac4aa5 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:03.960574 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 508/1016] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:53:03 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:53:03.966392 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8bed83-6c3e-450e-8a09-0ef09b461495 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:03.966773 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8bed83-6c3e-450e-8a09-0ef09b461495 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:03.966952 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8bed83-6c3e-450e-8a09-0ef09b461495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:03.989351 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-ef8bed83-6c3e-450e-8a09-0ef09b461495 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:53:03.990467 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-ef8bed83-6c3e-450e-8a09-0ef09b461495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:53:04.052311 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 509/1017] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:53:03 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:53:04.073932 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d83201-7eb4-4624-9948-1b6497ac4aa5 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:04.085308 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d83201-7eb4-4624-9948-1b6497ac4aa5 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:04.089715 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b555fb-3319-4a43-ab47-d5f24520e8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:04.090420 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b555fb-3319-4a43-ab47-d5f24520e8c4 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:04.090706 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b555fb-3319-4a43-ab47-d5f24520e8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:04.090984 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b555fb-3319-4a43-ab47-d5f24520e8c4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:04.102565 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b555fb-3319-4a43-ab47-d5f24520e8c4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:53:04.109566 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-d1b555fb-3319-4a43-ab47-d5f24520e8c4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 14:53:04.110628 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 509/1018] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:53:04 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:53:04.116335 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8bed83-6c3e-450e-8a09-0ef09b461495 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:04.124677 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8bed83-6c3e-450e-8a09-0ef09b461495 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:04.128670 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38435e6d-145a-4006-8324-d0af7c3dfaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:04.129247 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38435e6d-145a-4006-8324-d0af7c3dfaae admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:04.129529 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38435e6d-145a-4006-8324-d0af7c3dfaae admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:04.129800 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38435e6d-145a-4006-8324-d0af7c3dfaae admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:04.130497 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38435e6d-145a-4006-8324-d0af7c3dfaae admin admin] RBAC: Adding query filter params (name=admin) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:53:04.130788 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38435e6d-145a-4006-8324-d0af7c3dfaae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:04.155900 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38435e6d-145a-4006-8324-d0af7c3dfaae admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:04.164318 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 510/1019] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:53:04 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:04.170260 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b555fb-3319-4a43-ab47-d5f24520e8c4 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:04.179152 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b555fb-3319-4a43-ab47-d5f24520e8c4 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:04.183148 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b12ec9-fbda-42c3-ab40-9493e804f33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:04.183943 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b12ec9-fbda-42c3-ab40-9493e804f33a admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:04.184227 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b12ec9-fbda-42c3-ab40-9493e804f33a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:04.184504 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b12ec9-fbda-42c3-ab40-9493e804f33a admin admin] PATH_INFO: `/v3/users/3a6bfc723b354784af63c6adfbe4642d` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:04.185580 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b12ec9-fbda-42c3-ab40-9493e804f33a admin admin] RBAC: Authorizing `identity:get_user(user_id=3a6bfc723b354784af63c6adfbe4642d)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:04.210797 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b12ec9-fbda-42c3-ab40-9493e804f33a admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:04.212840 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 510/1020] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:53:04 2021] GET /identity/v3/users/3a6bfc723b354784af63c6adfbe4642d => generated 285 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:04.217832 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38435e6d-145a-4006-8324-d0af7c3dfaae admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:04.226766 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38435e6d-145a-4006-8324-d0af7c3dfaae admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:04.231338 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1aa93-d820-4bb5-ab4e-4be2221760a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:04.231924 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1aa93-d820-4bb5-ab4e-4be2221760a8 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:04.232207 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1aa93-d820-4bb5-ab4e-4be2221760a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:04.232483 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1aa93-d820-4bb5-ab4e-4be2221760a8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:04.239844 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1aa93-d820-4bb5-ab4e-4be2221760a8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:04.264559 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e1aa93-d820-4bb5-ab4e-4be2221760a8 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:04.273391 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 511/1021] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:53:04 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:53:04.281577 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b12ec9-fbda-42c3-ab40-9493e804f33a admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:04.291735 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b12ec9-fbda-42c3-ab40-9493e804f33a admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:04.295806 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e83b10-3dff-401c-94f3-1c5036a7af08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:04.296578 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e83b10-3dff-401c-94f3-1c5036a7af08 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:04.296868 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e83b10-3dff-401c-94f3-1c5036a7af08 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:04.297147 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e83b10-3dff-401c-94f3-1c5036a7af08 admin admin] PATH_INFO: `/v3/projects/d9060ccbdeba4080b6b83d9884d2eb3e` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:04.298218 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e83b10-3dff-401c-94f3-1c5036a7af08 admin admin] RBAC: Authorizing `identity:get_project(project_id=d9060ccbdeba4080b6b83d9884d2eb3e)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:04.324472 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e83b10-3dff-401c-94f3-1c5036a7af08 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:04.325995 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 511/1022] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:53:04 2021] GET /identity/v3/projects/d9060ccbdeba4080b6b83d9884d2eb3e => generated 311 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:04.331776 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1aa93-d820-4bb5-ab4e-4be2221760a8 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:04.340832 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1aa93-d820-4bb5-ab4e-4be2221760a8 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:04.344924 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc71c3-3087-45d7-bdcc-f8238477344d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:04.345485 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc71c3-3087-45d7-bdcc-f8238477344d admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:04.345770 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc71c3-3087-45d7-bdcc-f8238477344d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:04.346047 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc71c3-3087-45d7-bdcc-f8238477344d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:04.346817 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc71c3-3087-45d7-bdcc-f8238477344d admin admin] RBAC: Adding query filter params (role.id=c243fbeb99ae4f51910f72ddc1773778, scope.project.id=d9060ccbdeba4080b6b83d9884d2eb3e, user.id=3a6bfc723b354784af63c6adfbe4642d) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:53:04.347112 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc71c3-3087-45d7-bdcc-f8238477344d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:04.371917 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc71c3-3087-45d7-bdcc-f8238477344d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:04.377461 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 512/1023] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:53:04 2021] GET /identity/v3/role_assignments?user.id=3a6bfc723b354784af63c6adfbe4642d&scope.project.id=d9060ccbdeba4080b6b83d9884d2eb3e&role.id=c243fbeb99ae4f51910f72ddc1773778 => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:53:06.345033 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd205b-e7d5-4a75-8e05-b087b5639003 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:06.345574 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd205b-e7d5-4a75-8e05-b087b5639003 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:06.345574 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd205b-e7d5-4a75-8e05-b087b5639003 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:06.347264 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 512/1024] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:53:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:53:06.352309 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d817b57-b1c8-4bdd-89b2-5dd918dad8ef None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:06.352721 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d817b57-b1c8-4bdd-89b2-5dd918dad8ef None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:06.352864 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d817b57-b1c8-4bdd-89b2-5dd918dad8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:06.374984 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-3d817b57-b1c8-4bdd-89b2-5dd918dad8ef None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:53:06.376119 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-3d817b57-b1c8-4bdd-89b2-5dd918dad8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:53:06.382695 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 513/1025] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:53:06 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:53:06.406147 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd205b-e7d5-4a75-8e05-b087b5639003 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:06.417810 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd205b-e7d5-4a75-8e05-b087b5639003 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:06.421709 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb8b68-e377-41cd-abfa-1433bbfdab0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:06.422407 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb8b68-e377-41cd-abfa-1433bbfdab0b admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:06.422696 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb8b68-e377-41cd-abfa-1433bbfdab0b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:06.422980 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb8b68-e377-41cd-abfa-1433bbfdab0b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:06.424062 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb8b68-e377-41cd-abfa-1433bbfdab0b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:06.450149 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb8b68-e377-41cd-abfa-1433bbfdab0b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:06.451586 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 513/1026] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:53:06 2021] GET /identity/v3/domains/default => generated 199 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:06.456839 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d817b57-b1c8-4bdd-89b2-5dd918dad8ef None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:06.465145 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d817b57-b1c8-4bdd-89b2-5dd918dad8ef None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:06.469155 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e949d15-4528-4e04-acb3-7a1e5d4b0dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:06.469740 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e949d15-4528-4e04-acb3-7a1e5d4b0dfa admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:06.470024 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e949d15-4528-4e04-acb3-7a1e5d4b0dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:06.470300 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e949d15-4528-4e04-acb3-7a1e5d4b0dfa admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:06.470932 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e949d15-4528-4e04-acb3-7a1e5d4b0dfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:06.496371 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e949d15-4528-4e04-acb3-7a1e5d4b0dfa admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:06.514329 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 514/1027] 10.222.0.89 () {60 vars in 1153 bytes} [Wed Oct 27 14:53:06 2021] POST /identity/v3/users => generated 286 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:53:08.468613 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62167fbb-c009-410a-8c5e-29b5927654b5 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:08.469155 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62167fbb-c009-410a-8c5e-29b5927654b5 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:08.469241 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62167fbb-c009-410a-8c5e-29b5927654b5 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:08.470853 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 514/1028] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:53:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:53:08.476109 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb178a4-2686-416f-b210-5083d64b1aab None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:08.476499 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb178a4-2686-416f-b210-5083d64b1aab None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:08.476674 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb178a4-2686-416f-b210-5083d64b1aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:08.498953 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-fcb178a4-2686-416f-b210-5083d64b1aab None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:53:08.500109 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-fcb178a4-2686-416f-b210-5083d64b1aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:53:08.506787 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 515/1029] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:53:08 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:53:08.529492 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62167fbb-c009-410a-8c5e-29b5927654b5 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:08.541711 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62167fbb-c009-410a-8c5e-29b5927654b5 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:08.545623 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df3c2c-1df3-4619-80e4-455af57ab938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:08.546388 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df3c2c-1df3-4619-80e4-455af57ab938 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:08.546675 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df3c2c-1df3-4619-80e4-455af57ab938 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:08.546954 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df3c2c-1df3-4619-80e4-455af57ab938 admin admin] PATH_INFO: `/v3/roles/f98faade9eb9460b9aa1049aef51b342` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:08.548304 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df3c2c-1df3-4619-80e4-455af57ab938 admin admin] RBAC: Authorizing `identity:get_role(role_id=f98faade9eb9460b9aa1049aef51b342)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:08.572386 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING py.warnings [None req-b3df3c2c-1df3-4619-80e4-455af57ab938 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:53:08.572386 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: warnings.warn(msg) Oct 27 14:53:08.572386 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: Oct 27 14:53:08.573256 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df3c2c-1df3-4619-80e4-455af57ab938 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:08.574497 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 515/1030] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:53:08 2021] GET /identity/v3/roles/f98faade9eb9460b9aa1049aef51b342 => generated 223 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:08.580047 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb178a4-2686-416f-b210-5083d64b1aab None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:08.589023 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb178a4-2686-416f-b210-5083d64b1aab None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:08.593151 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7d097-c16a-4e6e-ba2c-7c279ea6b750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:08.593933 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7d097-c16a-4e6e-ba2c-7c279ea6b750 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:08.594224 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7d097-c16a-4e6e-ba2c-7c279ea6b750 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:08.594503 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7d097-c16a-4e6e-ba2c-7c279ea6b750 admin admin] PATH_INFO: `/v3/users/88161958c7b047a288a16c270621dd16` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:08.612741 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7d097-c16a-4e6e-ba2c-7c279ea6b750 admin admin] RBAC: Authorizing `identity:get_user(user_id=88161958c7b047a288a16c270621dd16)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:08.637952 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7d097-c16a-4e6e-ba2c-7c279ea6b750 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:08.639402 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 516/1031] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:53:08 2021] GET /identity/v3/users/88161958c7b047a288a16c270621dd16 => generated 286 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:08.644755 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df3c2c-1df3-4619-80e4-455af57ab938 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:08.654272 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df3c2c-1df3-4619-80e4-455af57ab938 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:08.658325 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f7ac9-0abb-4f4a-bdfe-5b484d8e02fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:08.658885 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f7ac9-0abb-4f4a-bdfe-5b484d8e02fd admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:08.659173 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f7ac9-0abb-4f4a-bdfe-5b484d8e02fd admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:08.659477 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f7ac9-0abb-4f4a-bdfe-5b484d8e02fd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:08.668178 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f7ac9-0abb-4f4a-bdfe-5b484d8e02fd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:08.693079 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f7ac9-0abb-4f4a-bdfe-5b484d8e02fd admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:08.701300 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 516/1032] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:53:08 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:53:08.706787 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7d097-c16a-4e6e-ba2c-7c279ea6b750 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:08.716338 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7d097-c16a-4e6e-ba2c-7c279ea6b750 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:08.720421 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed394b6-a738-41c8-b27f-5437836c9fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:08.721182 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed394b6-a738-41c8-b27f-5437836c9fef admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:08.721471 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed394b6-a738-41c8-b27f-5437836c9fef admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:08.721751 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed394b6-a738-41c8-b27f-5437836c9fef admin admin] PATH_INFO: `/v3/projects/d9060ccbdeba4080b6b83d9884d2eb3e` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:08.722817 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed394b6-a738-41c8-b27f-5437836c9fef admin admin] RBAC: Authorizing `identity:get_project(project_id=d9060ccbdeba4080b6b83d9884d2eb3e)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:08.748551 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed394b6-a738-41c8-b27f-5437836c9fef admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:08.750021 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 517/1033] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:53:08 2021] GET /identity/v3/projects/d9060ccbdeba4080b6b83d9884d2eb3e => generated 311 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:08.755388 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f7ac9-0abb-4f4a-bdfe-5b484d8e02fd admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:08.763539 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f7ac9-0abb-4f4a-bdfe-5b484d8e02fd admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:08.767673 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0844d-a27c-49c0-a473-4b443506bce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:08.768230 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0844d-a27c-49c0-a473-4b443506bce5 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:08.768519 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0844d-a27c-49c0-a473-4b443506bce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:08.768805 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0844d-a27c-49c0-a473-4b443506bce5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:08.769620 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0844d-a27c-49c0-a473-4b443506bce5 admin admin] RBAC: Adding query filter params (role.id=f98faade9eb9460b9aa1049aef51b342, scope.project.id=d9060ccbdeba4080b6b83d9884d2eb3e, user.id=88161958c7b047a288a16c270621dd16) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:53:08.769926 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0844d-a27c-49c0-a473-4b443506bce5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:08.796321 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0844d-a27c-49c0-a473-4b443506bce5 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:08.801379 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 517/1034] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:53:08 2021] GET /identity/v3/role_assignments?user.id=88161958c7b047a288a16c270621dd16&scope.project.id=d9060ccbdeba4080b6b83d9884d2eb3e&role.id=f98faade9eb9460b9aa1049aef51b342 => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:53:10.710514 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417dbf8-21bb-49e9-a887-38a2170fc4b2 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:10.711038 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417dbf8-21bb-49e9-a887-38a2170fc4b2 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:10.711125 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417dbf8-21bb-49e9-a887-38a2170fc4b2 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:10.712851 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 518/1035] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:53:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:53:10.717925 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a7aed-2b7e-47f1-98a5-f48c54053334 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:10.718340 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a7aed-2b7e-47f1-98a5-f48c54053334 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:10.718500 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a7aed-2b7e-47f1-98a5-f48c54053334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:10.742187 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-991a7aed-2b7e-47f1-98a5-f48c54053334 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:53:10.743878 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-991a7aed-2b7e-47f1-98a5-f48c54053334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:53:10.750596 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 518/1036] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:53:10 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:53:10.772759 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417dbf8-21bb-49e9-a887-38a2170fc4b2 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:10.784384 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417dbf8-21bb-49e9-a887-38a2170fc4b2 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:10.788554 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f71a02-11f6-44bb-9536-d4a9bd4fce56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:10.789318 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f71a02-11f6-44bb-9536-d4a9bd4fce56 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:10.789607 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f71a02-11f6-44bb-9536-d4a9bd4fce56 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:10.789888 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f71a02-11f6-44bb-9536-d4a9bd4fce56 admin admin] PATH_INFO: `/v3/roles/f98faade9eb9460b9aa1049aef51b342` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:10.791196 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f71a02-11f6-44bb-9536-d4a9bd4fce56 admin admin] RBAC: Authorizing `identity:get_role(role_id=f98faade9eb9460b9aa1049aef51b342)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:10.815971 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING py.warnings [None req-a9f71a02-11f6-44bb-9536-d4a9bd4fce56 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:53:10.815971 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: warnings.warn(msg) Oct 27 14:53:10.815971 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: Oct 27 14:53:10.816842 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f71a02-11f6-44bb-9536-d4a9bd4fce56 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:10.818061 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 519/1037] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:53:10 2021] GET /identity/v3/roles/f98faade9eb9460b9aa1049aef51b342 => generated 223 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:10.824241 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a7aed-2b7e-47f1-98a5-f48c54053334 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:10.832648 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a7aed-2b7e-47f1-98a5-f48c54053334 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:10.836729 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c94eb-4715-4fd8-9b81-2510cdd87b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:10.837507 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c94eb-4715-4fd8-9b81-2510cdd87b4d admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:10.837793 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c94eb-4715-4fd8-9b81-2510cdd87b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:10.838073 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c94eb-4715-4fd8-9b81-2510cdd87b4d admin admin] PATH_INFO: `/v3/users/88161958c7b047a288a16c270621dd16` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:10.839151 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c94eb-4715-4fd8-9b81-2510cdd87b4d admin admin] RBAC: Authorizing `identity:get_user(user_id=88161958c7b047a288a16c270621dd16)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:10.864412 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c94eb-4715-4fd8-9b81-2510cdd87b4d admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:10.865825 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 519/1038] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:53:10 2021] GET /identity/v3/users/88161958c7b047a288a16c270621dd16 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:10.871621 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f71a02-11f6-44bb-9536-d4a9bd4fce56 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:10.880666 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f71a02-11f6-44bb-9536-d4a9bd4fce56 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:10.885447 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6637bd-9778-4a4e-9fe9-e2510429e249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:10.886195 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6637bd-9778-4a4e-9fe9-e2510429e249 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:10.886483 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6637bd-9778-4a4e-9fe9-e2510429e249 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:10.886765 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6637bd-9778-4a4e-9fe9-e2510429e249 admin admin] PATH_INFO: `/v3/projects/d9060ccbdeba4080b6b83d9884d2eb3e` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:10.887856 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6637bd-9778-4a4e-9fe9-e2510429e249 admin admin] RBAC: Authorizing `identity:get_project(project_id=d9060ccbdeba4080b6b83d9884d2eb3e)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:10.913479 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6637bd-9778-4a4e-9fe9-e2510429e249 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:10.914962 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 520/1039] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:53:10 2021] GET /identity/v3/projects/d9060ccbdeba4080b6b83d9884d2eb3e => generated 311 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:10.920227 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c94eb-4715-4fd8-9b81-2510cdd87b4d admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:10.929039 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c94eb-4715-4fd8-9b81-2510cdd87b4d admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:10.933594 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b30b0a-5b61-44a5-a65c-3e86cfa38b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:10.934372 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b30b0a-5b61-44a5-a65c-3e86cfa38b0f admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:10.934656 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b30b0a-5b61-44a5-a65c-3e86cfa38b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:10.934936 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b30b0a-5b61-44a5-a65c-3e86cfa38b0f admin admin] PATH_INFO: `/v3/projects/d9060ccbdeba4080b6b83d9884d2eb3e/users/88161958c7b047a288a16c270621dd16/roles/f98faade9eb9460b9aa1049aef51b342` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:10.936931 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b30b0a-5b61-44a5-a65c-3e86cfa38b0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9060ccbdeba4080b6b83d9884d2eb3e, user_id=88161958c7b047a288a16c270621dd16, role_id=f98faade9eb9460b9aa1049aef51b342)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:10.963467 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b30b0a-5b61-44a5-a65c-3e86cfa38b0f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:10.975599 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 520/1040] 10.222.0.89 () {58 vars in 1460 bytes} [Wed Oct 27 14:53:10 2021] PUT /identity/v3/projects/d9060ccbdeba4080b6b83d9884d2eb3e/users/88161958c7b047a288a16c270621dd16/roles/f98faade9eb9460b9aa1049aef51b342 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:53:12.904003 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55163857-b0ab-46bb-b059-ab77104d43d8 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:12.904561 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55163857-b0ab-46bb-b059-ab77104d43d8 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:12.904561 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55163857-b0ab-46bb-b059-ab77104d43d8 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:12.906207 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 521/1041] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:53:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:53:12.911612 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46971f40-c03a-470f-941f-67e5df37feb5 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:12.912001 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46971f40-c03a-470f-941f-67e5df37feb5 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:12.912173 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46971f40-c03a-470f-941f-67e5df37feb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:12.936307 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-46971f40-c03a-470f-941f-67e5df37feb5 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:53:12.937425 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-46971f40-c03a-470f-941f-67e5df37feb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:53:12.998319 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 521/1042] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:53:12 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:53:13.020314 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55163857-b0ab-46bb-b059-ab77104d43d8 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:13.032325 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55163857-b0ab-46bb-b059-ab77104d43d8 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:13.036530 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd24b4-3f2c-4bb1-850f-4a8f400311a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:13.037294 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd24b4-3f2c-4bb1-850f-4a8f400311a2 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:13.037584 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd24b4-3f2c-4bb1-850f-4a8f400311a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:13.037862 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd24b4-3f2c-4bb1-850f-4a8f400311a2 admin admin] PATH_INFO: `/v3/roles/f98faade9eb9460b9aa1049aef51b342` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:13.039168 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd24b4-3f2c-4bb1-850f-4a8f400311a2 admin admin] RBAC: Authorizing `identity:get_role(role_id=f98faade9eb9460b9aa1049aef51b342)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:13.065746 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cd24b4-3f2c-4bb1-850f-4a8f400311a2 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:13.066992 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 522/1043] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:53:13 2021] GET /identity/v3/roles/f98faade9eb9460b9aa1049aef51b342 => generated 223 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:13.072407 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46971f40-c03a-470f-941f-67e5df37feb5 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:13.080803 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46971f40-c03a-470f-941f-67e5df37feb5 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:13.084856 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c5a39-fe45-40b3-95aa-50b962d2ebb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:13.085636 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c5a39-fe45-40b3-95aa-50b962d2ebb0 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:13.085922 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c5a39-fe45-40b3-95aa-50b962d2ebb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:13.086201 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c5a39-fe45-40b3-95aa-50b962d2ebb0 admin admin] PATH_INFO: `/v3/users/88161958c7b047a288a16c270621dd16` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:13.087830 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c5a39-fe45-40b3-95aa-50b962d2ebb0 admin admin] RBAC: Authorizing `identity:get_user(user_id=88161958c7b047a288a16c270621dd16)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:13.113580 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c5a39-fe45-40b3-95aa-50b962d2ebb0 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:13.114996 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 522/1044] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:53:13 2021] GET /identity/v3/users/88161958c7b047a288a16c270621dd16 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:13.120527 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd24b4-3f2c-4bb1-850f-4a8f400311a2 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:13.129500 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd24b4-3f2c-4bb1-850f-4a8f400311a2 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:13.133525 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e23008-f119-48b6-95e1-ef390a839afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:13.134075 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e23008-f119-48b6-95e1-ef390a839afa admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:13.134361 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e23008-f119-48b6-95e1-ef390a839afa admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:13.134642 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e23008-f119-48b6-95e1-ef390a839afa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:13.142045 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e23008-f119-48b6-95e1-ef390a839afa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:13.168311 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e23008-f119-48b6-95e1-ef390a839afa admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:13.176456 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 523/1045] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:53:13 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:53:13.181748 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c5a39-fe45-40b3-95aa-50b962d2ebb0 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:13.190669 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c5a39-fe45-40b3-95aa-50b962d2ebb0 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:13.194757 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96571209-5de9-4bd8-8261-957e28a6e2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:13.195529 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96571209-5de9-4bd8-8261-957e28a6e2e0 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:13.195819 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96571209-5de9-4bd8-8261-957e28a6e2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:13.196097 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96571209-5de9-4bd8-8261-957e28a6e2e0 admin admin] PATH_INFO: `/v3/projects/d9060ccbdeba4080b6b83d9884d2eb3e` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:13.197170 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96571209-5de9-4bd8-8261-957e28a6e2e0 admin admin] RBAC: Authorizing `identity:get_project(project_id=d9060ccbdeba4080b6b83d9884d2eb3e)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:13.222885 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96571209-5de9-4bd8-8261-957e28a6e2e0 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:13.224539 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 523/1046] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:53:13 2021] GET /identity/v3/projects/d9060ccbdeba4080b6b83d9884d2eb3e => generated 311 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:13.230529 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e23008-f119-48b6-95e1-ef390a839afa admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:13.238874 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e23008-f119-48b6-95e1-ef390a839afa admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:13.242973 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359f026-6603-48b2-8ff5-1536bc43f7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:13.243687 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359f026-6603-48b2-8ff5-1536bc43f7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:13.243979 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359f026-6603-48b2-8ff5-1536bc43f7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:13.244259 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359f026-6603-48b2-8ff5-1536bc43f7b4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:13.245031 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5359f026-6603-48b2-8ff5-1536bc43f7b4 admin admin] RBAC: Adding query filter params (role.id=f98faade9eb9460b9aa1049aef51b342, scope.project.id=d9060ccbdeba4080b6b83d9884d2eb3e, user.id=88161958c7b047a288a16c270621dd16) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:53:13.245333 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5359f026-6603-48b2-8ff5-1536bc43f7b4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:13.270214 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5359f026-6603-48b2-8ff5-1536bc43f7b4 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:13.276376 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 524/1047] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:53:13 2021] GET /identity/v3/role_assignments?user.id=88161958c7b047a288a16c270621dd16&scope.project.id=d9060ccbdeba4080b6b83d9884d2eb3e&role.id=f98faade9eb9460b9aa1049aef51b342 => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:15.237523 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4aea94-6db5-4d43-a0f7-4b32b81e18dc None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:15.238074 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4aea94-6db5-4d43-a0f7-4b32b81e18dc None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:15.238074 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4aea94-6db5-4d43-a0f7-4b32b81e18dc None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:15.239777 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 524/1048] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:53:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:53:15.245584 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac70fe-896a-49d7-a15b-57e19aa65236 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:15.246015 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac70fe-896a-49d7-a15b-57e19aa65236 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:15.246141 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac70fe-896a-49d7-a15b-57e19aa65236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:15.268517 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-b0ac70fe-896a-49d7-a15b-57e19aa65236 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:53:15.269631 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-b0ac70fe-896a-49d7-a15b-57e19aa65236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:53:15.276294 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 525/1049] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:53:15 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:53:15.298183 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4aea94-6db5-4d43-a0f7-4b32b81e18dc None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:15.310025 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4aea94-6db5-4d43-a0f7-4b32b81e18dc None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:15.313912 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff498d-5a74-4d2a-91e6-740e9fc81ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:15.314660 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff498d-5a74-4d2a-91e6-740e9fc81ee9 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:15.314947 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff498d-5a74-4d2a-91e6-740e9fc81ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:15.315223 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff498d-5a74-4d2a-91e6-740e9fc81ee9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:15.316310 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff498d-5a74-4d2a-91e6-740e9fc81ee9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:15.341611 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff498d-5a74-4d2a-91e6-740e9fc81ee9 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:15.343033 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 525/1050] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:53:15 2021] GET /identity/v3/domains/default => generated 199 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:15.348468 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac70fe-896a-49d7-a15b-57e19aa65236 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:15.356852 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac70fe-896a-49d7-a15b-57e19aa65236 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:15.360996 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130e053-4374-4a45-bd2c-e10451b08ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:15.361571 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130e053-4374-4a45-bd2c-e10451b08ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:15.361856 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130e053-4374-4a45-bd2c-e10451b08ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:15.362132 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130e053-4374-4a45-bd2c-e10451b08ca5 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:15.362781 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130e053-4374-4a45-bd2c-e10451b08ca5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:15.388916 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130e053-4374-4a45-bd2c-e10451b08ca5 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:15.414859 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 526/1051] 10.222.0.89 () {60 vars in 1162 bytes} [Wed Oct 27 14:53:15 2021] POST /identity/v3/projects => generated 311 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:53:17.375127 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84ae0a-7c62-4c8c-bd42-2a21ce9e948e None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:17.375663 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84ae0a-7c62-4c8c-bd42-2a21ce9e948e None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:17.375769 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84ae0a-7c62-4c8c-bd42-2a21ce9e948e None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:17.377463 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 526/1052] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:53:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:53:17.382466 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfb509-7071-4d43-a675-066d9947fcd5 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:17.382884 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfb509-7071-4d43-a675-066d9947fcd5 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:17.383031 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfb509-7071-4d43-a675-066d9947fcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:17.404441 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-38cfb509-7071-4d43-a675-066d9947fcd5 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:53:17.405571 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-38cfb509-7071-4d43-a675-066d9947fcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:53:17.468170 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 527/1053] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:53:17 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:53:17.491913 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84ae0a-7c62-4c8c-bd42-2a21ce9e948e None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:17.503270 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84ae0a-7c62-4c8c-bd42-2a21ce9e948e None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:17.507240 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9a4e3-9f2f-4f21-8e73-16cdd1393bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:17.507960 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9a4e3-9f2f-4f21-8e73-16cdd1393bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:17.508249 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9a4e3-9f2f-4f21-8e73-16cdd1393bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:17.508530 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9a4e3-9f2f-4f21-8e73-16cdd1393bd8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:17.509615 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb9a4e3-9f2f-4f21-8e73-16cdd1393bd8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:17.534844 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb9a4e3-9f2f-4f21-8e73-16cdd1393bd8 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:17.536546 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 527/1054] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:53:17 2021] GET /identity/v3/domains/default => generated 199 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:17.542525 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cfb509-7071-4d43-a675-066d9947fcd5 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:17.551043 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cfb509-7071-4d43-a675-066d9947fcd5 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:17.555099 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb4b82-98a6-4897-9d4d-54c79b7314c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:17.555720 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb4b82-98a6-4897-9d4d-54c79b7314c5 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:17.556009 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb4b82-98a6-4897-9d4d-54c79b7314c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:17.556290 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb4b82-98a6-4897-9d4d-54c79b7314c5 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:17.556934 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb4b82-98a6-4897-9d4d-54c79b7314c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:17.581951 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccb4b82-98a6-4897-9d4d-54c79b7314c5 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:17.603099 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 528/1055] 10.222.0.89 () {60 vars in 1153 bytes} [Wed Oct 27 14:53:17 2021] POST /identity/v3/users => generated 286 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:53:19.566465 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991038f-a7af-4d06-9855-8c1b936e5189 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:19.566961 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991038f-a7af-4d06-9855-8c1b936e5189 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:19.566961 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4991038f-a7af-4d06-9855-8c1b936e5189 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:19.568651 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 528/1056] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:53:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:53:19.574292 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031e3cb-6690-46ac-a6a8-789f523451b2 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:19.574735 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031e3cb-6690-46ac-a6a8-789f523451b2 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:19.574865 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031e3cb-6690-46ac-a6a8-789f523451b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:19.598965 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-c031e3cb-6690-46ac-a6a8-789f523451b2 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:53:19.600125 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-c031e3cb-6690-46ac-a6a8-789f523451b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:53:19.606827 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 529/1057] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:53:19 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:53:19.628544 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991038f-a7af-4d06-9855-8c1b936e5189 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:19.640228 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4991038f-a7af-4d06-9855-8c1b936e5189 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:19.644058 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46212ae5-dd76-4c78-9c20-902e61b49711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:19.644751 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46212ae5-dd76-4c78-9c20-902e61b49711 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:19.645033 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46212ae5-dd76-4c78-9c20-902e61b49711 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:19.645306 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46212ae5-dd76-4c78-9c20-902e61b49711 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:19.657387 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46212ae5-dd76-4c78-9c20-902e61b49711 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:53:19.663740 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-46212ae5-dd76-4c78-9c20-902e61b49711 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 14:53:19.664823 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 529/1058] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:53:19 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:53:19.670257 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031e3cb-6690-46ac-a6a8-789f523451b2 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:19.678616 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031e3cb-6690-46ac-a6a8-789f523451b2 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:19.683192 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7627127-0a74-46f2-aac8-d27053ddaebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:19.683810 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7627127-0a74-46f2-aac8-d27053ddaebb admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:19.684128 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7627127-0a74-46f2-aac8-d27053ddaebb admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:19.684406 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7627127-0a74-46f2-aac8-d27053ddaebb admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:19.685109 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7627127-0a74-46f2-aac8-d27053ddaebb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:53:19.685404 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7627127-0a74-46f2-aac8-d27053ddaebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:19.710570 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7627127-0a74-46f2-aac8-d27053ddaebb admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:19.718781 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 530/1059] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:53:19 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:19.724078 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46212ae5-dd76-4c78-9c20-902e61b49711 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:19.732926 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46212ae5-dd76-4c78-9c20-902e61b49711 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:19.736905 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d776f3-6ec3-4d1f-bbf4-952e1a04dd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:19.737665 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d776f3-6ec3-4d1f-bbf4-952e1a04dd29 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:19.737947 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d776f3-6ec3-4d1f-bbf4-952e1a04dd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:19.738219 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d776f3-6ec3-4d1f-bbf4-952e1a04dd29 admin admin] PATH_INFO: `/v3/users/e894d961b69e44e1bb4a315988f44915` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:19.756539 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d776f3-6ec3-4d1f-bbf4-952e1a04dd29 admin admin] RBAC: Authorizing `identity:get_user(user_id=e894d961b69e44e1bb4a315988f44915)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:19.782392 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d776f3-6ec3-4d1f-bbf4-952e1a04dd29 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:19.783972 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 530/1060] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:53:19 2021] GET /identity/v3/users/e894d961b69e44e1bb4a315988f44915 => generated 286 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:19.789531 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7627127-0a74-46f2-aac8-d27053ddaebb admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:19.798551 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7627127-0a74-46f2-aac8-d27053ddaebb admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:19.802592 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441bc68-e4b2-44f0-964e-5226a25adb61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:19.803162 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441bc68-e4b2-44f0-964e-5226a25adb61 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:19.803471 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441bc68-e4b2-44f0-964e-5226a25adb61 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:19.803762 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441bc68-e4b2-44f0-964e-5226a25adb61 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:19.812508 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441bc68-e4b2-44f0-964e-5226a25adb61 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:19.838040 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441bc68-e4b2-44f0-964e-5226a25adb61 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:19.846721 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 531/1061] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:53:19 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:53:19.852584 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d776f3-6ec3-4d1f-bbf4-952e1a04dd29 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:19.861656 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d776f3-6ec3-4d1f-bbf4-952e1a04dd29 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:19.865728 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff5959-e9dd-4354-b4c0-2b43b09ad896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:19.866501 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff5959-e9dd-4354-b4c0-2b43b09ad896 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:19.866786 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff5959-e9dd-4354-b4c0-2b43b09ad896 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:19.867063 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff5959-e9dd-4354-b4c0-2b43b09ad896 admin admin] PATH_INFO: `/v3/projects/64ff4a8a24b34d5fb9629c9202180b1d` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:19.868606 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff5959-e9dd-4354-b4c0-2b43b09ad896 admin admin] RBAC: Authorizing `identity:get_project(project_id=64ff4a8a24b34d5fb9629c9202180b1d)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:19.894319 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff5959-e9dd-4354-b4c0-2b43b09ad896 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:19.896034 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 531/1062] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:53:19 2021] GET /identity/v3/projects/64ff4a8a24b34d5fb9629c9202180b1d => generated 311 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:19.901433 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441bc68-e4b2-44f0-964e-5226a25adb61 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:19.909816 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441bc68-e4b2-44f0-964e-5226a25adb61 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:19.914214 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb669c5-9003-4b32-952c-4a7afa9ef53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:19.914793 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb669c5-9003-4b32-952c-4a7afa9ef53e admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:19.915089 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb669c5-9003-4b32-952c-4a7afa9ef53e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:19.915368 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb669c5-9003-4b32-952c-4a7afa9ef53e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:19.916178 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb669c5-9003-4b32-952c-4a7afa9ef53e admin admin] RBAC: Adding query filter params (role.id=c243fbeb99ae4f51910f72ddc1773778, scope.project.id=64ff4a8a24b34d5fb9629c9202180b1d, user.id=e894d961b69e44e1bb4a315988f44915) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:53:19.916480 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb669c5-9003-4b32-952c-4a7afa9ef53e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:19.941841 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb669c5-9003-4b32-952c-4a7afa9ef53e admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:19.947656 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 532/1063] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:53:19 2021] GET /identity/v3/role_assignments?user.id=e894d961b69e44e1bb4a315988f44915&scope.project.id=64ff4a8a24b34d5fb9629c9202180b1d&role.id=c243fbeb99ae4f51910f72ddc1773778 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:53:21.859416 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94375b71-0ff0-44ea-b7c5-2c3c1a956e6b None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:21.859975 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94375b71-0ff0-44ea-b7c5-2c3c1a956e6b None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:21.859975 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94375b71-0ff0-44ea-b7c5-2c3c1a956e6b None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:21.861638 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 532/1064] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:53:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:53:21.866688 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645ff1b-931e-4c34-94bf-24dbb2d6eeda None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:21.867124 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645ff1b-931e-4c34-94bf-24dbb2d6eeda None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:21.867255 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645ff1b-931e-4c34-94bf-24dbb2d6eeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:21.889775 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-0645ff1b-931e-4c34-94bf-24dbb2d6eeda None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:53:21.890896 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-0645ff1b-931e-4c34-94bf-24dbb2d6eeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:53:21.897655 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 533/1065] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:53:21 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:53:21.919619 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94375b71-0ff0-44ea-b7c5-2c3c1a956e6b None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:21.931376 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94375b71-0ff0-44ea-b7c5-2c3c1a956e6b None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:21.935226 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8b082-e24b-442d-82ca-3b63fd10c133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:21.935945 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8b082-e24b-442d-82ca-3b63fd10c133 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:21.936228 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8b082-e24b-442d-82ca-3b63fd10c133 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:21.936502 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8b082-e24b-442d-82ca-3b63fd10c133 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:21.947187 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8b082-e24b-442d-82ca-3b63fd10c133 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:53:21.953379 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-a6e8b082-e24b-442d-82ca-3b63fd10c133 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 14:53:21.954414 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 533/1066] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:53:21 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:53:21.959997 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645ff1b-931e-4c34-94bf-24dbb2d6eeda None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:21.968875 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645ff1b-931e-4c34-94bf-24dbb2d6eeda None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:21.972984 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567c2a4-b194-44bf-92e5-c638809f1906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:21.973565 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567c2a4-b194-44bf-92e5-c638809f1906 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:21.973852 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567c2a4-b194-44bf-92e5-c638809f1906 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:21.974132 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567c2a4-b194-44bf-92e5-c638809f1906 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:21.974842 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567c2a4-b194-44bf-92e5-c638809f1906 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:53:21.975141 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567c2a4-b194-44bf-92e5-c638809f1906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:22.000659 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567c2a4-b194-44bf-92e5-c638809f1906 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:22.008969 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 534/1067] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:53:21 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:22.014287 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8b082-e24b-442d-82ca-3b63fd10c133 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:22.024071 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8b082-e24b-442d-82ca-3b63fd10c133 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:22.028524 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ffda8-f50d-49ed-b0b8-80654b371746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:22.029278 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ffda8-f50d-49ed-b0b8-80654b371746 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:22.029561 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ffda8-f50d-49ed-b0b8-80654b371746 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:22.029836 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ffda8-f50d-49ed-b0b8-80654b371746 admin admin] PATH_INFO: `/v3/users/e894d961b69e44e1bb4a315988f44915` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:22.030889 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ffda8-f50d-49ed-b0b8-80654b371746 admin admin] RBAC: Authorizing `identity:get_user(user_id=e894d961b69e44e1bb4a315988f44915)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:22.056893 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ffda8-f50d-49ed-b0b8-80654b371746 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:22.058309 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 534/1068] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:53:22 2021] GET /identity/v3/users/e894d961b69e44e1bb4a315988f44915 => generated 286 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:22.063797 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567c2a4-b194-44bf-92e5-c638809f1906 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:22.072840 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567c2a4-b194-44bf-92e5-c638809f1906 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:22.076920 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbefc087-9522-43aa-bd03-35a99acfc760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:22.077687 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefc087-9522-43aa-bd03-35a99acfc760 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:22.078003 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefc087-9522-43aa-bd03-35a99acfc760 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:22.078285 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbefc087-9522-43aa-bd03-35a99acfc760 admin admin] PATH_INFO: `/v3/projects/64ff4a8a24b34d5fb9629c9202180b1d` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:22.079354 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbefc087-9522-43aa-bd03-35a99acfc760 admin admin] RBAC: Authorizing `identity:get_project(project_id=64ff4a8a24b34d5fb9629c9202180b1d)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:22.105639 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbefc087-9522-43aa-bd03-35a99acfc760 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:22.107108 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 535/1069] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:53:22 2021] GET /identity/v3/projects/64ff4a8a24b34d5fb9629c9202180b1d => generated 311 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:22.112424 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ffda8-f50d-49ed-b0b8-80654b371746 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:22.121318 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ffda8-f50d-49ed-b0b8-80654b371746 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:22.125328 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba06750-048b-4eab-b709-74371d349c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:22.126116 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba06750-048b-4eab-b709-74371d349c15 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:22.126401 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba06750-048b-4eab-b709-74371d349c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:22.126678 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba06750-048b-4eab-b709-74371d349c15 admin admin] PATH_INFO: `/v3/projects/64ff4a8a24b34d5fb9629c9202180b1d/users/e894d961b69e44e1bb4a315988f44915/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:22.128434 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba06750-048b-4eab-b709-74371d349c15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64ff4a8a24b34d5fb9629c9202180b1d, user_id=e894d961b69e44e1bb4a315988f44915, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:22.154913 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba06750-048b-4eab-b709-74371d349c15 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:22.167982 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 535/1070] 10.222.0.89 () {58 vars in 1460 bytes} [Wed Oct 27 14:53:22 2021] PUT /identity/v3/projects/64ff4a8a24b34d5fb9629c9202180b1d/users/e894d961b69e44e1bb4a315988f44915/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 14:53:24.088505 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e513b2-f258-47e3-933f-4a47704b9f94 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:24.089034 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e513b2-f258-47e3-933f-4a47704b9f94 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:24.089148 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e513b2-f258-47e3-933f-4a47704b9f94 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:24.090820 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 536/1071] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:53:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:53:24.095869 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbd127-dac7-44a3-874d-5b0f278077de None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:24.096289 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbd127-dac7-44a3-874d-5b0f278077de None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:24.096445 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edbd127-dac7-44a3-874d-5b0f278077de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:24.119433 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-3edbd127-dac7-44a3-874d-5b0f278077de None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:53:24.120591 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-3edbd127-dac7-44a3-874d-5b0f278077de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:53:24.182685 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 536/1072] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:53:24 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:53:24.205472 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e513b2-f258-47e3-933f-4a47704b9f94 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:24.217498 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e513b2-f258-47e3-933f-4a47704b9f94 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:24.221452 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de572b5c-4d9e-49fa-b746-deae8f20324b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:24.222158 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de572b5c-4d9e-49fa-b746-deae8f20324b admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:24.222445 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de572b5c-4d9e-49fa-b746-deae8f20324b admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:24.222725 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de572b5c-4d9e-49fa-b746-deae8f20324b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:24.235140 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de572b5c-4d9e-49fa-b746-deae8f20324b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:53:24.241337 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-de572b5c-4d9e-49fa-b746-deae8f20324b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 14:53:24.242407 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 537/1073] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:53:24 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:53:24.248196 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edbd127-dac7-44a3-874d-5b0f278077de None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:24.256936 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edbd127-dac7-44a3-874d-5b0f278077de None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:24.260762 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9efddba-415e-48bd-9a22-cda9f49b703f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:24.261351 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efddba-415e-48bd-9a22-cda9f49b703f admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:24.261640 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efddba-415e-48bd-9a22-cda9f49b703f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:24.261922 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9efddba-415e-48bd-9a22-cda9f49b703f admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:24.262634 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9efddba-415e-48bd-9a22-cda9f49b703f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:53:24.262934 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9efddba-415e-48bd-9a22-cda9f49b703f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:24.288515 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9efddba-415e-48bd-9a22-cda9f49b703f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:24.297614 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 537/1074] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:53:24 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:24.303216 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de572b5c-4d9e-49fa-b746-deae8f20324b admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:24.312433 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de572b5c-4d9e-49fa-b746-deae8f20324b admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:24.316477 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccbc7f-c0d5-4539-8c7b-a21214fae434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:24.317273 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccbc7f-c0d5-4539-8c7b-a21214fae434 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:24.317561 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccbc7f-c0d5-4539-8c7b-a21214fae434 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:24.317838 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccbc7f-c0d5-4539-8c7b-a21214fae434 admin admin] PATH_INFO: `/v3/users/e894d961b69e44e1bb4a315988f44915` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:24.318914 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaccbc7f-c0d5-4539-8c7b-a21214fae434 admin admin] RBAC: Authorizing `identity:get_user(user_id=e894d961b69e44e1bb4a315988f44915)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:24.344643 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaccbc7f-c0d5-4539-8c7b-a21214fae434 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:24.346001 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 538/1075] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:53:24 2021] GET /identity/v3/users/e894d961b69e44e1bb4a315988f44915 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:24.351277 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9efddba-415e-48bd-9a22-cda9f49b703f admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:24.360963 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9efddba-415e-48bd-9a22-cda9f49b703f admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:24.365002 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05dd8ad-6964-4173-a195-fdb3dbdf65dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:24.365564 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05dd8ad-6964-4173-a195-fdb3dbdf65dd admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:24.365852 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05dd8ad-6964-4173-a195-fdb3dbdf65dd admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:24.366131 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05dd8ad-6964-4173-a195-fdb3dbdf65dd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:24.373584 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05dd8ad-6964-4173-a195-fdb3dbdf65dd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:24.398344 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05dd8ad-6964-4173-a195-fdb3dbdf65dd admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:24.407116 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 538/1076] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:53:24 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:53:24.412796 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccbc7f-c0d5-4539-8c7b-a21214fae434 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:24.422214 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccbc7f-c0d5-4539-8c7b-a21214fae434 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:24.426217 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf64ba-c266-4670-99cb-94096bc500ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:24.426949 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf64ba-c266-4670-99cb-94096bc500ee admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:24.427232 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf64ba-c266-4670-99cb-94096bc500ee admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:24.427546 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf64ba-c266-4670-99cb-94096bc500ee admin admin] PATH_INFO: `/v3/projects/64ff4a8a24b34d5fb9629c9202180b1d` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:24.428602 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf64ba-c266-4670-99cb-94096bc500ee admin admin] RBAC: Authorizing `identity:get_project(project_id=64ff4a8a24b34d5fb9629c9202180b1d)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:24.453608 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf64ba-c266-4670-99cb-94096bc500ee admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:24.455179 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 539/1077] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:53:24 2021] GET /identity/v3/projects/64ff4a8a24b34d5fb9629c9202180b1d => generated 311 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:24.460292 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05dd8ad-6964-4173-a195-fdb3dbdf65dd admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:24.468776 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05dd8ad-6964-4173-a195-fdb3dbdf65dd admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:24.472819 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0acbf-1177-490e-90e7-0f607b9a30e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:24.473368 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0acbf-1177-490e-90e7-0f607b9a30e7 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:24.473661 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0acbf-1177-490e-90e7-0f607b9a30e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:24.473944 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0acbf-1177-490e-90e7-0f607b9a30e7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:24.474706 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0acbf-1177-490e-90e7-0f607b9a30e7 admin admin] RBAC: Adding query filter params (role.id=c243fbeb99ae4f51910f72ddc1773778, scope.project.id=64ff4a8a24b34d5fb9629c9202180b1d, user.id=e894d961b69e44e1bb4a315988f44915) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:53:24.475005 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0acbf-1177-490e-90e7-0f607b9a30e7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:24.500475 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb0acbf-1177-490e-90e7-0f607b9a30e7 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:24.505956 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 539/1078] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:53:24 2021] GET /identity/v3/role_assignments?user.id=e894d961b69e44e1bb4a315988f44915&scope.project.id=64ff4a8a24b34d5fb9629c9202180b1d&role.id=c243fbeb99ae4f51910f72ddc1773778 => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:53:26.462156 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad080e9-c1a2-4748-b470-b46d70c2065d None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:26.462692 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad080e9-c1a2-4748-b470-b46d70c2065d None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:26.462692 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad080e9-c1a2-4748-b470-b46d70c2065d None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:26.464486 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 540/1079] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:53:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:53:26.469575 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134adb29-5493-4848-a297-7116fc86e531 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:26.469946 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134adb29-5493-4848-a297-7116fc86e531 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:26.470135 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134adb29-5493-4848-a297-7116fc86e531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:26.492349 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-134adb29-5493-4848-a297-7116fc86e531 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:53:26.493494 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-134adb29-5493-4848-a297-7116fc86e531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:53:26.500180 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 540/1080] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:53:26 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:53:26.521516 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad080e9-c1a2-4748-b470-b46d70c2065d None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:26.533394 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad080e9-c1a2-4748-b470-b46d70c2065d None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:26.537581 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c63c49-a6bf-49d1-8347-e4a4210d0bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:26.538140 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c63c49-a6bf-49d1-8347-e4a4210d0bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:26.538425 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c63c49-a6bf-49d1-8347-e4a4210d0bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:26.538700 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c63c49-a6bf-49d1-8347-e4a4210d0bc7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:26.546726 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c63c49-a6bf-49d1-8347-e4a4210d0bc7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:26.571536 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c63c49-a6bf-49d1-8347-e4a4210d0bc7 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:26.579793 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 541/1081] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:53:26 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:53:26.585312 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134adb29-5493-4848-a297-7116fc86e531 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:26.594140 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134adb29-5493-4848-a297-7116fc86e531 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:26.598207 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e98e43f-c907-4570-8b58-05a15012f304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:26.598915 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98e43f-c907-4570-8b58-05a15012f304 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:26.599200 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98e43f-c907-4570-8b58-05a15012f304 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:26.599507 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e98e43f-c907-4570-8b58-05a15012f304 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:26.607791 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98e43f-c907-4570-8b58-05a15012f304 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:26.632677 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e98e43f-c907-4570-8b58-05a15012f304 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:26.646755 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-5e98e43f-c907-4570-8b58-05a15012f304 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 27 14:53:26.647814 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 541/1082] 10.222.0.89 () {56 vars in 1138 bytes} [Wed Oct 27 14:53:26 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:53:26.653858 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c63c49-a6bf-49d1-8347-e4a4210d0bc7 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:26.662357 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c63c49-a6bf-49d1-8347-e4a4210d0bc7 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:26.667059 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf5b41-628e-4e7b-9905-6fd79040e712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:26.667658 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf5b41-628e-4e7b-9905-6fd79040e712 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:26.667944 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf5b41-628e-4e7b-9905-6fd79040e712 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:26.668221 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf5b41-628e-4e7b-9905-6fd79040e712 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:26.668885 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf5b41-628e-4e7b-9905-6fd79040e712 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:53:26.669179 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf5b41-628e-4e7b-9905-6fd79040e712 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:26.693700 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf5b41-628e-4e7b-9905-6fd79040e712 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:26.701290 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 542/1083] 10.222.0.89 () {56 vars in 1136 bytes} [Wed Oct 27 14:53:26 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:28.634632 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443b6b0-8714-4d00-85e9-ef0c5c70d0f9 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:28.635127 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443b6b0-8714-4d00-85e9-ef0c5c70d0f9 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:28.635127 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443b6b0-8714-4d00-85e9-ef0c5c70d0f9 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:28.636800 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 542/1084] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:53:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:53:28.641942 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9515007-628e-4c00-910e-c363d7e0202f None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:28.642361 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9515007-628e-4c00-910e-c363d7e0202f None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:28.642509 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9515007-628e-4c00-910e-c363d7e0202f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:28.665014 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-e9515007-628e-4c00-910e-c363d7e0202f None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:53:28.666128 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-e9515007-628e-4c00-910e-c363d7e0202f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:53:28.672806 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 543/1085] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:53:28 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:53:28.694810 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443b6b0-8714-4d00-85e9-ef0c5c70d0f9 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:28.706203 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443b6b0-8714-4d00-85e9-ef0c5c70d0f9 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:28.710092 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c0b3c-af88-4a8b-b767-a87406d36665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:28.710654 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c0b3c-af88-4a8b-b767-a87406d36665 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:28.710936 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c0b3c-af88-4a8b-b767-a87406d36665 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:28.711210 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c0b3c-af88-4a8b-b767-a87406d36665 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:28.712428 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c0b3c-af88-4a8b-b767-a87406d36665 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:28.736938 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING py.warnings [None req-6f1c0b3c-af88-4a8b-b767-a87406d36665 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 14:53:28.736938 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: warnings.warn(msg) Oct 27 14:53:28.736938 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: Oct 27 14:53:28.737803 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c0b3c-af88-4a8b-b767-a87406d36665 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:28.752073 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 543/1086] 10.222.0.89 () {60 vars in 1159 bytes} [Wed Oct 27 14:53:28 2021] POST /identity/v3/domains => generated 267 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:53:30.710214 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357af36-ab9e-400f-b1e5-d919037e1665 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:30.710726 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357af36-ab9e-400f-b1e5-d919037e1665 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:30.710841 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357af36-ab9e-400f-b1e5-d919037e1665 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:30.713065 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 544/1087] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:53:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:53:30.718100 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171a07d-cede-49eb-9fdb-fd1f51ae9b6c None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:30.718519 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171a07d-cede-49eb-9fdb-fd1f51ae9b6c None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:30.718665 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171a07d-cede-49eb-9fdb-fd1f51ae9b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:30.740840 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-6171a07d-cede-49eb-9fdb-fd1f51ae9b6c None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:53:30.741975 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-6171a07d-cede-49eb-9fdb-fd1f51ae9b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:53:30.805216 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 544/1088] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:53:30 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:53:30.828076 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357af36-ab9e-400f-b1e5-d919037e1665 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:30.840258 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357af36-ab9e-400f-b1e5-d919037e1665 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:30.844393 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2525a08a-4d32-431f-8c1b-25089ab3794d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:30.845160 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525a08a-4d32-431f-8c1b-25089ab3794d admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:30.845445 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525a08a-4d32-431f-8c1b-25089ab3794d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:30.845722 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525a08a-4d32-431f-8c1b-25089ab3794d admin admin] PATH_INFO: `/v3/domains/2ae0dd16af1242cdb8cf71f555475bc3` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:30.857337 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2525a08a-4d32-431f-8c1b-25089ab3794d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=2ae0dd16af1242cdb8cf71f555475bc3)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:30.882446 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2525a08a-4d32-431f-8c1b-25089ab3794d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:30.884596 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 545/1089] 10.222.0.89 () {56 vars in 1204 bytes} [Wed Oct 27 14:53:30 2021] GET /identity/v3/domains/2ae0dd16af1242cdb8cf71f555475bc3 => generated 267 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:30.889985 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171a07d-cede-49eb-9fdb-fd1f51ae9b6c None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:30.898386 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171a07d-cede-49eb-9fdb-fd1f51ae9b6c None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:30.903024 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7f03d-2e45-4bc8-ac51-6b6e039ad666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:30.903664 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7f03d-2e45-4bc8-ac51-6b6e039ad666 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:30.903956 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7f03d-2e45-4bc8-ac51-6b6e039ad666 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:30.904238 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7f03d-2e45-4bc8-ac51-6b6e039ad666 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:30.904886 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7f03d-2e45-4bc8-ac51-6b6e039ad666 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:30.929966 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7f03d-2e45-4bc8-ac51-6b6e039ad666 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:30.956562 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 545/1090] 10.222.0.89 () {60 vars in 1162 bytes} [Wed Oct 27 14:53:30 2021] POST /identity/v3/projects => generated 361 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:53:32.936926 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a132e3-3292-495d-8e2a-3f917d000676 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:32.937454 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a132e3-3292-495d-8e2a-3f917d000676 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:32.937454 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a132e3-3292-495d-8e2a-3f917d000676 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:32.939125 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 546/1091] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:53:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:53:32.944315 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196c08e-c1cd-4287-ae5c-f44a8200d1d8 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:32.944713 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196c08e-c1cd-4287-ae5c-f44a8200d1d8 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:32.944887 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196c08e-c1cd-4287-ae5c-f44a8200d1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:32.966207 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-e196c08e-c1cd-4287-ae5c-f44a8200d1d8 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:53:32.967335 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-e196c08e-c1cd-4287-ae5c-f44a8200d1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:53:33.029664 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 546/1092] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:53:32 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:53:33.053514 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a132e3-3292-495d-8e2a-3f917d000676 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:33.065401 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a132e3-3292-495d-8e2a-3f917d000676 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:33.069263 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38513cb-d863-4f94-8127-b2776d175732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:33.070032 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38513cb-d863-4f94-8127-b2776d175732 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:33.070314 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38513cb-d863-4f94-8127-b2776d175732 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:33.070636 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38513cb-d863-4f94-8127-b2776d175732 admin admin] PATH_INFO: `/v3/domains/2ae0dd16af1242cdb8cf71f555475bc3` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:33.071705 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38513cb-d863-4f94-8127-b2776d175732 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=2ae0dd16af1242cdb8cf71f555475bc3)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:33.096638 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38513cb-d863-4f94-8127-b2776d175732 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:33.098036 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 547/1093] 10.222.0.89 () {56 vars in 1204 bytes} [Wed Oct 27 14:53:33 2021] GET /identity/v3/domains/2ae0dd16af1242cdb8cf71f555475bc3 => generated 267 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:33.103996 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196c08e-c1cd-4287-ae5c-f44a8200d1d8 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:33.112310 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196c08e-c1cd-4287-ae5c-f44a8200d1d8 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:33.116416 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6a836-92ad-4e88-81ec-46de13771f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:33.117002 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6a836-92ad-4e88-81ec-46de13771f39 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:33.117309 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6a836-92ad-4e88-81ec-46de13771f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:33.118136 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6a836-92ad-4e88-81ec-46de13771f39 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:33.118791 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf6a836-92ad-4e88-81ec-46de13771f39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:33.143766 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf6a836-92ad-4e88-81ec-46de13771f39 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:33.162119 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 547/1094] 10.222.0.89 () {60 vars in 1153 bytes} [Wed Oct 27 14:53:33 2021] POST /identity/v3/users => generated 311 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 14:53:35.175205 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f166a87-de64-4bc4-927b-9b0371962feb None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:35.175761 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f166a87-de64-4bc4-927b-9b0371962feb None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:35.175761 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f166a87-de64-4bc4-927b-9b0371962feb None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:35.177434 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 548/1095] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:53:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:53:35.183179 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d9e57-a612-4ca8-a92a-6fb46bcbe10f None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:35.183622 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d9e57-a612-4ca8-a92a-6fb46bcbe10f None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:35.183777 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d9e57-a612-4ca8-a92a-6fb46bcbe10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:35.205699 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-b86d9e57-a612-4ca8-a92a-6fb46bcbe10f None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:53:35.206828 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-b86d9e57-a612-4ca8-a92a-6fb46bcbe10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:53:35.213631 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 548/1096] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:53:35 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:53:35.236471 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f166a87-de64-4bc4-927b-9b0371962feb None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:35.248775 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f166a87-de64-4bc4-927b-9b0371962feb None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:35.252716 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120b065-930e-4d67-8616-0bafd7c0c632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:35.253426 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120b065-930e-4d67-8616-0bafd7c0c632 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:35.253715 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120b065-930e-4d67-8616-0bafd7c0c632 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:35.253994 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120b065-930e-4d67-8616-0bafd7c0c632 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:35.265586 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120b065-930e-4d67-8616-0bafd7c0c632 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:53:35.271881 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-f120b065-930e-4d67-8616-0bafd7c0c632 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 14:53:35.272994 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 549/1097] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:53:35 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 14:53:35.279283 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d9e57-a612-4ca8-a92a-6fb46bcbe10f None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:35.288400 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d9e57-a612-4ca8-a92a-6fb46bcbe10f None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:35.293180 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda5946-75ab-44b5-bf44-b1af7501829c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:35.293772 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda5946-75ab-44b5-bf44-b1af7501829c admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:35.294063 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda5946-75ab-44b5-bf44-b1af7501829c admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:35.294344 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda5946-75ab-44b5-bf44-b1af7501829c admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:35.295054 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda5946-75ab-44b5-bf44-b1af7501829c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:53:35.295354 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda5946-75ab-44b5-bf44-b1af7501829c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:35.335519 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda5946-75ab-44b5-bf44-b1af7501829c admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:35.344090 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 549/1098] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:53:35 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:35.349568 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120b065-930e-4d67-8616-0bafd7c0c632 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:35.360189 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120b065-930e-4d67-8616-0bafd7c0c632 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:35.364268 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502983c-7975-4f6a-8506-ad7fa5e920ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:35.365044 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502983c-7975-4f6a-8506-ad7fa5e920ba admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:35.365332 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502983c-7975-4f6a-8506-ad7fa5e920ba admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:35.365612 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502983c-7975-4f6a-8506-ad7fa5e920ba admin admin] PATH_INFO: `/v3/users/3729fae8d3fb4ec08dbfb9be93562977` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:35.383857 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502983c-7975-4f6a-8506-ad7fa5e920ba admin admin] RBAC: Authorizing `identity:get_user(user_id=3729fae8d3fb4ec08dbfb9be93562977)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:35.409109 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502983c-7975-4f6a-8506-ad7fa5e920ba admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:35.410835 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 550/1099] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:53:35 2021] GET /identity/v3/users/3729fae8d3fb4ec08dbfb9be93562977 => generated 311 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:35.416686 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda5946-75ab-44b5-bf44-b1af7501829c admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:35.425678 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda5946-75ab-44b5-bf44-b1af7501829c admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:35.429630 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af307c0-b717-4a09-a03a-3294fc49697c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:35.430805 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af307c0-b717-4a09-a03a-3294fc49697c admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:35.431085 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af307c0-b717-4a09-a03a-3294fc49697c admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:35.431360 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af307c0-b717-4a09-a03a-3294fc49697c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:35.438725 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af307c0-b717-4a09-a03a-3294fc49697c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:35.463992 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af307c0-b717-4a09-a03a-3294fc49697c admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:35.472119 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 550/1100] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:53:35 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:53:35.478080 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502983c-7975-4f6a-8506-ad7fa5e920ba admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:35.486991 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502983c-7975-4f6a-8506-ad7fa5e920ba admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:35.491078 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583b7e9-ccf4-4ab1-9ad8-126da98fd3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:35.491874 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583b7e9-ccf4-4ab1-9ad8-126da98fd3ec admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:35.492163 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583b7e9-ccf4-4ab1-9ad8-126da98fd3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:35.492440 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583b7e9-ccf4-4ab1-9ad8-126da98fd3ec admin admin] PATH_INFO: `/v3/projects/bb46db492f3b46c2a485e8105b6d02fa` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:35.493518 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583b7e9-ccf4-4ab1-9ad8-126da98fd3ec admin admin] RBAC: Authorizing `identity:get_project(project_id=bb46db492f3b46c2a485e8105b6d02fa)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:35.518691 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583b7e9-ccf4-4ab1-9ad8-126da98fd3ec admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:35.520194 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 551/1101] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:53:35 2021] GET /identity/v3/projects/bb46db492f3b46c2a485e8105b6d02fa => generated 361 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:35.525964 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af307c0-b717-4a09-a03a-3294fc49697c admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:35.533948 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af307c0-b717-4a09-a03a-3294fc49697c admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:35.538320 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072fd7d0-1451-4e06-84a2-d6b2a4288f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:35.538868 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fd7d0-1451-4e06-84a2-d6b2a4288f82 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:35.539151 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fd7d0-1451-4e06-84a2-d6b2a4288f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:35.539498 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fd7d0-1451-4e06-84a2-d6b2a4288f82 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:35.540754 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072fd7d0-1451-4e06-84a2-d6b2a4288f82 admin admin] RBAC: Adding query filter params (role.id=c243fbeb99ae4f51910f72ddc1773778, scope.project.id=bb46db492f3b46c2a485e8105b6d02fa, user.id=3729fae8d3fb4ec08dbfb9be93562977) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:53:35.541048 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072fd7d0-1451-4e06-84a2-d6b2a4288f82 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:35.565766 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072fd7d0-1451-4e06-84a2-d6b2a4288f82 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:35.570928 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 551/1102] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:53:35 2021] GET /identity/v3/role_assignments?user.id=3729fae8d3fb4ec08dbfb9be93562977&scope.project.id=bb46db492f3b46c2a485e8105b6d02fa&role.id=c243fbeb99ae4f51910f72ddc1773778 => generated 259 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:37.490714 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662f2e8-32ca-46d1-95e6-e2a2ea8da62e None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:37.491231 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662f2e8-32ca-46d1-95e6-e2a2ea8da62e None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:37.491315 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662f2e8-32ca-46d1-95e6-e2a2ea8da62e None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:37.493536 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 552/1103] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:53:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:53:37.498588 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5fd0b-52d4-400f-b5c5-02ce366aca54 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:37.499009 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5fd0b-52d4-400f-b5c5-02ce366aca54 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:37.499145 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5fd0b-52d4-400f-b5c5-02ce366aca54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:37.520924 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-95e5fd0b-52d4-400f-b5c5-02ce366aca54 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:53:37.521971 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-95e5fd0b-52d4-400f-b5c5-02ce366aca54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:53:37.528586 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 552/1104] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:53:37 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:53:37.550582 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662f2e8-32ca-46d1-95e6-e2a2ea8da62e None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:37.562536 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662f2e8-32ca-46d1-95e6-e2a2ea8da62e None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:37.566434 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd827b5-cf6f-46fc-b45d-198504f15858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:37.567132 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd827b5-cf6f-46fc-b45d-198504f15858 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:37.567419 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd827b5-cf6f-46fc-b45d-198504f15858 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:37.567723 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd827b5-cf6f-46fc-b45d-198504f15858 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:37.578512 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd827b5-cf6f-46fc-b45d-198504f15858 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:53:37.584677 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-dbd827b5-cf6f-46fc-b45d-198504f15858 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 14:53:37.585725 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 553/1105] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:53:37 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:53:37.591310 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5fd0b-52d4-400f-b5c5-02ce366aca54 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:37.599571 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5fd0b-52d4-400f-b5c5-02ce366aca54 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:37.604158 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85b06e-054b-4361-a001-46fa9978eb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:37.604732 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85b06e-054b-4361-a001-46fa9978eb52 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:37.605014 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85b06e-054b-4361-a001-46fa9978eb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:37.605287 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85b06e-054b-4361-a001-46fa9978eb52 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:37.605977 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f85b06e-054b-4361-a001-46fa9978eb52 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:53:37.606270 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f85b06e-054b-4361-a001-46fa9978eb52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:37.631433 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f85b06e-054b-4361-a001-46fa9978eb52 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:37.640090 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 553/1106] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:53:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:53:37.645873 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd827b5-cf6f-46fc-b45d-198504f15858 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:37.656060 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd827b5-cf6f-46fc-b45d-198504f15858 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:37.660425 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec7b6d-37c1-4d1f-b6bf-85065cb8c5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:37.661196 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec7b6d-37c1-4d1f-b6bf-85065cb8c5fc admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:37.661481 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec7b6d-37c1-4d1f-b6bf-85065cb8c5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:37.661757 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec7b6d-37c1-4d1f-b6bf-85065cb8c5fc admin admin] PATH_INFO: `/v3/users/3729fae8d3fb4ec08dbfb9be93562977` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:37.662838 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec7b6d-37c1-4d1f-b6bf-85065cb8c5fc admin admin] RBAC: Authorizing `identity:get_user(user_id=3729fae8d3fb4ec08dbfb9be93562977)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:37.689351 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec7b6d-37c1-4d1f-b6bf-85065cb8c5fc admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:37.690771 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 554/1107] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:53:37 2021] GET /identity/v3/users/3729fae8d3fb4ec08dbfb9be93562977 => generated 311 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:37.696136 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85b06e-054b-4361-a001-46fa9978eb52 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:37.705040 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85b06e-054b-4361-a001-46fa9978eb52 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:37.709118 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ed213-940e-461c-bf57-db1aa030305e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:37.709880 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ed213-940e-461c-bf57-db1aa030305e admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:37.710161 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ed213-940e-461c-bf57-db1aa030305e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:37.710435 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ed213-940e-461c-bf57-db1aa030305e admin admin] PATH_INFO: `/v3/projects/bb46db492f3b46c2a485e8105b6d02fa` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:37.712018 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ed213-940e-461c-bf57-db1aa030305e admin admin] RBAC: Authorizing `identity:get_project(project_id=bb46db492f3b46c2a485e8105b6d02fa)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:37.737753 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ed213-940e-461c-bf57-db1aa030305e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:37.739211 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 554/1108] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:53:37 2021] GET /identity/v3/projects/bb46db492f3b46c2a485e8105b6d02fa => generated 361 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:37.744470 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec7b6d-37c1-4d1f-b6bf-85065cb8c5fc admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:37.753617 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec7b6d-37c1-4d1f-b6bf-85065cb8c5fc admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:37.757703 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b475cbd-ffd2-48e3-a12c-19f1e20472b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:37.758488 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b475cbd-ffd2-48e3-a12c-19f1e20472b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:37.758778 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b475cbd-ffd2-48e3-a12c-19f1e20472b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:37.759060 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b475cbd-ffd2-48e3-a12c-19f1e20472b7 admin admin] PATH_INFO: `/v3/projects/bb46db492f3b46c2a485e8105b6d02fa/users/3729fae8d3fb4ec08dbfb9be93562977/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:37.760832 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b475cbd-ffd2-48e3-a12c-19f1e20472b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb46db492f3b46c2a485e8105b6d02fa, user_id=3729fae8d3fb4ec08dbfb9be93562977, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:37.787627 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b475cbd-ffd2-48e3-a12c-19f1e20472b7 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:37.800431 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 555/1109] 10.222.0.89 () {58 vars in 1460 bytes} [Wed Oct 27 14:53:37 2021] PUT /identity/v3/projects/bb46db492f3b46c2a485e8105b6d02fa/users/3729fae8d3fb4ec08dbfb9be93562977/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:53:39.690606 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788dbe9-c2e4-4de6-ba9f-f0927eedd3f8 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:39.691139 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788dbe9-c2e4-4de6-ba9f-f0927eedd3f8 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:39.691139 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788dbe9-c2e4-4de6-ba9f-f0927eedd3f8 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:39.692866 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 555/1110] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:53:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:53:39.698348 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e52ba5-f450-466c-b155-4aa76002d31a None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:39.698778 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e52ba5-f450-466c-b155-4aa76002d31a None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:39.698905 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e52ba5-f450-466c-b155-4aa76002d31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:39.721433 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-f7e52ba5-f450-466c-b155-4aa76002d31a None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:53:39.722556 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-f7e52ba5-f450-466c-b155-4aa76002d31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:53:39.783726 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 556/1111] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:53:39 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:53:39.805911 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788dbe9-c2e4-4de6-ba9f-f0927eedd3f8 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:39.817409 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788dbe9-c2e4-4de6-ba9f-f0927eedd3f8 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:39.821841 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899f196-f653-4222-85bb-ac87f438a514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:39.822541 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899f196-f653-4222-85bb-ac87f438a514 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:39.822827 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899f196-f653-4222-85bb-ac87f438a514 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:39.823103 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899f196-f653-4222-85bb-ac87f438a514 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:39.834630 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899f196-f653-4222-85bb-ac87f438a514 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:53:39.841421 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-6899f196-f653-4222-85bb-ac87f438a514 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 14:53:39.842477 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 556/1112] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:53:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:53:39.848078 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e52ba5-f450-466c-b155-4aa76002d31a None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:39.856380 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e52ba5-f450-466c-b155-4aa76002d31a None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:39.860378 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae0d81-ff0d-4f13-8c7d-3966d966b532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:39.860957 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae0d81-ff0d-4f13-8c7d-3966d966b532 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:39.861241 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae0d81-ff0d-4f13-8c7d-3966d966b532 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:39.861516 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae0d81-ff0d-4f13-8c7d-3966d966b532 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:39.862218 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae0d81-ff0d-4f13-8c7d-3966d966b532 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:53:39.862510 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae0d81-ff0d-4f13-8c7d-3966d966b532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:39.887618 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ae0d81-ff0d-4f13-8c7d-3966d966b532 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:39.895765 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 557/1113] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:53:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:39.901832 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899f196-f653-4222-85bb-ac87f438a514 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:39.910980 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899f196-f653-4222-85bb-ac87f438a514 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:39.915005 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f965d60-9ebd-42f7-8258-6a62b0afc470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:39.915809 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f965d60-9ebd-42f7-8258-6a62b0afc470 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:39.916095 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f965d60-9ebd-42f7-8258-6a62b0afc470 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:39.916374 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f965d60-9ebd-42f7-8258-6a62b0afc470 admin admin] PATH_INFO: `/v3/users/3729fae8d3fb4ec08dbfb9be93562977` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:39.917448 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f965d60-9ebd-42f7-8258-6a62b0afc470 admin admin] RBAC: Authorizing `identity:get_user(user_id=3729fae8d3fb4ec08dbfb9be93562977)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:39.943201 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f965d60-9ebd-42f7-8258-6a62b0afc470 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:39.944586 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 557/1114] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:53:39 2021] GET /identity/v3/users/3729fae8d3fb4ec08dbfb9be93562977 => generated 311 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:39.950182 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae0d81-ff0d-4f13-8c7d-3966d966b532 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:39.958904 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ae0d81-ff0d-4f13-8c7d-3966d966b532 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:39.962878 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c72d18-34ce-4e1e-892a-0f03d83f727b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:39.963418 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c72d18-34ce-4e1e-892a-0f03d83f727b admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:39.963729 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c72d18-34ce-4e1e-892a-0f03d83f727b admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:39.964007 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c72d18-34ce-4e1e-892a-0f03d83f727b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:39.971331 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c72d18-34ce-4e1e-892a-0f03d83f727b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:39.996611 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c72d18-34ce-4e1e-892a-0f03d83f727b admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:40.005115 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 558/1115] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:53:39 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:53:40.011663 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f965d60-9ebd-42f7-8258-6a62b0afc470 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:40.021083 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f965d60-9ebd-42f7-8258-6a62b0afc470 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:40.025101 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90923d63-b4be-425a-8cb1-9862f41eb126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:40.025861 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90923d63-b4be-425a-8cb1-9862f41eb126 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:40.026143 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90923d63-b4be-425a-8cb1-9862f41eb126 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:40.026418 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90923d63-b4be-425a-8cb1-9862f41eb126 admin admin] PATH_INFO: `/v3/projects/bb46db492f3b46c2a485e8105b6d02fa` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:40.027509 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90923d63-b4be-425a-8cb1-9862f41eb126 admin admin] RBAC: Authorizing `identity:get_project(project_id=bb46db492f3b46c2a485e8105b6d02fa)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:40.052713 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90923d63-b4be-425a-8cb1-9862f41eb126 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:40.054195 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 558/1116] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:53:40 2021] GET /identity/v3/projects/bb46db492f3b46c2a485e8105b6d02fa => generated 361 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:53:40.060267 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c72d18-34ce-4e1e-892a-0f03d83f727b admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:53:40.068603 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c72d18-34ce-4e1e-892a-0f03d83f727b admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:53:40.073473 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458287a-f938-4dc5-8555-19fefecff8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:53:40.074040 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458287a-f938-4dc5-8555-19fefecff8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:53:40.074329 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458287a-f938-4dc5-8555-19fefecff8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:53:40.074610 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458287a-f938-4dc5-8555-19fefecff8a2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:53:40.075381 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458287a-f938-4dc5-8555-19fefecff8a2 admin admin] RBAC: Adding query filter params (role.id=c243fbeb99ae4f51910f72ddc1773778, scope.project.id=bb46db492f3b46c2a485e8105b6d02fa, user.id=3729fae8d3fb4ec08dbfb9be93562977) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:53:40.075718 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458287a-f938-4dc5-8555-19fefecff8a2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:53:40.100675 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458287a-f938-4dc5-8555-19fefecff8a2 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:53:40.106312 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 559/1117] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:53:40 2021] GET /identity/v3/role_assignments?user.id=3729fae8d3fb4ec08dbfb9be93562977&scope.project.id=bb46db492f3b46c2a485e8105b6d02fa&role.id=c243fbeb99ae4f51910f72ddc1773778 => generated 608 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:06.498657 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f04d2-9dc0-476f-8209-53d4b0e14a29 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:06.499236 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f04d2-9dc0-476f-8209-53d4b0e14a29 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:06.499236 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f04d2-9dc0-476f-8209-53d4b0e14a29 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:06.500925 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 559/1118] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:55:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:55:06.506033 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33719cd-e3b5-4e48-9997-0de30887c9c4 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:06.506500 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33719cd-e3b5-4e48-9997-0de30887c9c4 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:06.506603 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33719cd-e3b5-4e48-9997-0de30887c9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:06.529089 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-a33719cd-e3b5-4e48-9997-0de30887c9c4 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:55:06.530154 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-a33719cd-e3b5-4e48-9997-0de30887c9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:55:06.537921 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 560/1119] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:55:06 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:55:06.560512 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f04d2-9dc0-476f-8209-53d4b0e14a29 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:06.572482 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683f04d2-9dc0-476f-8209-53d4b0e14a29 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:06.576463 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99582e7-b412-4b7a-8cd1-97f2ff571cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:06.577164 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99582e7-b412-4b7a-8cd1-97f2ff571cfb admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:06.577455 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99582e7-b412-4b7a-8cd1-97f2ff571cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:06.577738 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99582e7-b412-4b7a-8cd1-97f2ff571cfb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:06.590187 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99582e7-b412-4b7a-8cd1-97f2ff571cfb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:06.615100 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99582e7-b412-4b7a-8cd1-97f2ff571cfb admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:06.631799 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-d99582e7-b412-4b7a-8cd1-97f2ff571cfb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:55:06.632844 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 560/1120] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:55:06 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 14:55:06.638541 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33719cd-e3b5-4e48-9997-0de30887c9c4 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:06.647680 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33719cd-e3b5-4e48-9997-0de30887c9c4 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:06.651756 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c389248-58b8-41e2-840b-b856d33e551e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:06.652336 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c389248-58b8-41e2-840b-b856d33e551e admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:06.652626 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c389248-58b8-41e2-840b-b856d33e551e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:06.652907 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c389248-58b8-41e2-840b-b856d33e551e admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:06.653589 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c389248-58b8-41e2-840b-b856d33e551e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:06.653886 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c389248-58b8-41e2-840b-b856d33e551e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:06.679026 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c389248-58b8-41e2-840b-b856d33e551e admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:06.693324 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 561/1121] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:55:06 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:06.698547 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99582e7-b412-4b7a-8cd1-97f2ff571cfb admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:06.707528 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99582e7-b412-4b7a-8cd1-97f2ff571cfb admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:06.712077 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d88e54-3e60-4ad0-bddf-072ad444fbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:06.712655 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d88e54-3e60-4ad0-bddf-072ad444fbb5 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:06.712939 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d88e54-3e60-4ad0-bddf-072ad444fbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:06.713218 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d88e54-3e60-4ad0-bddf-072ad444fbb5 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:06.713852 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d88e54-3e60-4ad0-bddf-072ad444fbb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:06.738861 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d88e54-3e60-4ad0-bddf-072ad444fbb5 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:06.758528 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 561/1122] 10.222.0.89 () {60 vars in 1153 bytes} [Wed Oct 27 14:55:06 2021] POST /identity/v3/users => generated 251 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:55:08.709174 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026154a1-0c67-4335-b7b3-ce4dc4fc2496 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:08.709791 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026154a1-0c67-4335-b7b3-ce4dc4fc2496 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:08.709791 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026154a1-0c67-4335-b7b3-ce4dc4fc2496 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:08.711373 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 562/1123] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:55:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:55:08.716776 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db027a41-1881-4482-a388-10859d21af06 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:08.717216 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db027a41-1881-4482-a388-10859d21af06 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:08.717366 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db027a41-1881-4482-a388-10859d21af06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:08.738554 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-db027a41-1881-4482-a388-10859d21af06 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:55:08.740255 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-db027a41-1881-4482-a388-10859d21af06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:55:08.746863 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 562/1124] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:55:08 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:55:08.769105 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026154a1-0c67-4335-b7b3-ce4dc4fc2496 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:08.780313 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026154a1-0c67-4335-b7b3-ce4dc4fc2496 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:08.784416 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a04fe-7b96-4266-a9ad-29341eec2c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:08.785112 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a04fe-7b96-4266-a9ad-29341eec2c5a admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:08.785408 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a04fe-7b96-4266-a9ad-29341eec2c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:08.785660 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a04fe-7b96-4266-a9ad-29341eec2c5a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:08.796840 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a04fe-7b96-4266-a9ad-29341eec2c5a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:55:08.803569 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-377a04fe-7b96-4266-a9ad-29341eec2c5a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 14:55:08.804766 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 563/1125] 10.222.0.89 () {56 vars in 1123 bytes} [Wed Oct 27 14:55:08 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:55:08.810012 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db027a41-1881-4482-a388-10859d21af06 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:08.818358 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db027a41-1881-4482-a388-10859d21af06 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:08.822423 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4c238-cddd-4664-82a7-a2735288e6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:08.822999 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4c238-cddd-4664-82a7-a2735288e6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:08.823286 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4c238-cddd-4664-82a7-a2735288e6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:08.823604 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4c238-cddd-4664-82a7-a2735288e6b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:08.824314 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4c238-cddd-4664-82a7-a2735288e6b4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:08.824612 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4c238-cddd-4664-82a7-a2735288e6b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:08.849985 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4c238-cddd-4664-82a7-a2735288e6b4 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:08.858034 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 563/1126] 10.222.0.89 () {56 vars in 1124 bytes} [Wed Oct 27 14:55:08 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:55:08.863173 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a04fe-7b96-4266-a9ad-29341eec2c5a admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:08.873235 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a04fe-7b96-4266-a9ad-29341eec2c5a admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:08.877308 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17582224-d14a-4966-ad65-1f4275d42d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:08.877986 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17582224-d14a-4966-ad65-1f4275d42d6d admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:08.878272 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17582224-d14a-4966-ad65-1f4275d42d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:08.878550 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17582224-d14a-4966-ad65-1f4275d42d6d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:08.889413 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17582224-d14a-4966-ad65-1f4275d42d6d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:08.915150 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17582224-d14a-4966-ad65-1f4275d42d6d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:08.932801 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-17582224-d14a-4966-ad65-1f4275d42d6d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:55:08.933847 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 564/1127] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:55:08 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:55:08.939074 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4c238-cddd-4664-82a7-a2735288e6b4 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:08.947961 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4c238-cddd-4664-82a7-a2735288e6b4 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:08.951971 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4d036-8ed9-458d-aa7f-3fea73ae7628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:08.952534 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4d036-8ed9-458d-aa7f-3fea73ae7628 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:08.952821 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4d036-8ed9-458d-aa7f-3fea73ae7628 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:08.953098 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4d036-8ed9-458d-aa7f-3fea73ae7628 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:08.953768 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4d036-8ed9-458d-aa7f-3fea73ae7628 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:08.954063 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4d036-8ed9-458d-aa7f-3fea73ae7628 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:08.979293 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4d036-8ed9-458d-aa7f-3fea73ae7628 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:08.993540 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 564/1128] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:55:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:55:08.998837 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17582224-d14a-4966-ad65-1f4275d42d6d admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:09.007852 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17582224-d14a-4966-ad65-1f4275d42d6d admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:09.011855 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61adeaf-420d-40ae-9e99-907d2225a0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:09.012548 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61adeaf-420d-40ae-9e99-907d2225a0cb admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:09.012831 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61adeaf-420d-40ae-9e99-907d2225a0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:09.013106 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61adeaf-420d-40ae-9e99-907d2225a0cb admin admin] PATH_INFO: `/v3/users/placement` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:09.025505 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61adeaf-420d-40ae-9e99-907d2225a0cb admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:09.051302 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61adeaf-420d-40ae-9e99-907d2225a0cb admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:09.069004 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-d61adeaf-420d-40ae-9e99-907d2225a0cb admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 14:55:09.070027 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 565/1129] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:55:08 2021] GET /identity/v3/users/placement => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:55:09.075376 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4d036-8ed9-458d-aa7f-3fea73ae7628 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:09.084301 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4d036-8ed9-458d-aa7f-3fea73ae7628 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:09.088326 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498b74e-a19f-4b10-bcf7-cd4ff1e33b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:09.088902 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498b74e-a19f-4b10-bcf7-cd4ff1e33b2d admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:09.089187 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498b74e-a19f-4b10-bcf7-cd4ff1e33b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:09.089464 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498b74e-a19f-4b10-bcf7-cd4ff1e33b2d admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:09.090243 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498b74e-a19f-4b10-bcf7-cd4ff1e33b2d admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:09.090539 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498b74e-a19f-4b10-bcf7-cd4ff1e33b2d admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:09.116664 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498b74e-a19f-4b10-bcf7-cd4ff1e33b2d admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:09.144239 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 565/1130] 10.222.0.89 () {56 vars in 1164 bytes} [Wed Oct 27 14:55:09 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:09.149614 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61adeaf-420d-40ae-9e99-907d2225a0cb admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:09.158784 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61adeaf-420d-40ae-9e99-907d2225a0cb admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:09.163258 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8e92c-4056-48b4-8156-6de73b01462d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:09.163842 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8e92c-4056-48b4-8156-6de73b01462d admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:09.164126 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8e92c-4056-48b4-8156-6de73b01462d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:09.164402 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8e92c-4056-48b4-8156-6de73b01462d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:09.171754 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8e92c-4056-48b4-8156-6de73b01462d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:09.196946 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8e92c-4056-48b4-8156-6de73b01462d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:09.205928 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 566/1131] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:55:09 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:55:09.211828 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498b74e-a19f-4b10-bcf7-cd4ff1e33b2d admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:09.222228 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498b74e-a19f-4b10-bcf7-cd4ff1e33b2d admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:09.228782 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1409a8-a157-42f9-9c7c-9f01a5fc2e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:09.229586 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1409a8-a157-42f9-9c7c-9f01a5fc2e25 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:09.229954 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1409a8-a157-42f9-9c7c-9f01a5fc2e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:09.230371 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1409a8-a157-42f9-9c7c-9f01a5fc2e25 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:09.245538 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1409a8-a157-42f9-9c7c-9f01a5fc2e25 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:09.276965 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1409a8-a157-42f9-9c7c-9f01a5fc2e25 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:09.298850 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-9b1409a8-a157-42f9-9c7c-9f01a5fc2e25 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:55:09.300244 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 566/1132] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:55:09 2021] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 14:55:09.306548 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8e92c-4056-48b4-8156-6de73b01462d admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:09.317192 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8e92c-4056-48b4-8156-6de73b01462d admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:09.322718 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794e191-b5b6-4a88-8aee-601850d418bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:09.323559 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794e191-b5b6-4a88-8aee-601850d418bb admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:09.323899 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794e191-b5b6-4a88-8aee-601850d418bb admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:09.324257 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794e191-b5b6-4a88-8aee-601850d418bb admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:09.325147 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2794e191-b5b6-4a88-8aee-601850d418bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:09.325633 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2794e191-b5b6-4a88-8aee-601850d418bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:09.356620 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2794e191-b5b6-4a88-8aee-601850d418bb admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:09.369328 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 567/1133] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:55:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:09.374937 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1409a8-a157-42f9-9c7c-9f01a5fc2e25 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:09.384126 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1409a8-a157-42f9-9c7c-9f01a5fc2e25 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:09.388352 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15b509-fa3f-4ec3-90a7-8c7b851e0b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:09.389060 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15b509-fa3f-4ec3-90a7-8c7b851e0b2d admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:09.389342 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15b509-fa3f-4ec3-90a7-8c7b851e0b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:09.389617 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15b509-fa3f-4ec3-90a7-8c7b851e0b2d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:09.398821 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e15b509-fa3f-4ec3-90a7-8c7b851e0b2d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:09.424666 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e15b509-fa3f-4ec3-90a7-8c7b851e0b2d admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:09.437605 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-8e15b509-fa3f-4ec3-90a7-8c7b851e0b2d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:55:09.438631 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 567/1134] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:55:09 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:55:09.443999 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794e191-b5b6-4a88-8aee-601850d418bb admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:09.453033 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794e191-b5b6-4a88-8aee-601850d418bb admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:09.457096 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb96784-555c-4a75-a4bd-016f86fa01fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:09.457671 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb96784-555c-4a75-a4bd-016f86fa01fa admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:09.457958 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb96784-555c-4a75-a4bd-016f86fa01fa admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:09.458235 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb96784-555c-4a75-a4bd-016f86fa01fa admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:09.459518 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb96784-555c-4a75-a4bd-016f86fa01fa admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:09.459822 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb96784-555c-4a75-a4bd-016f86fa01fa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:09.485923 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb96784-555c-4a75-a4bd-016f86fa01fa admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:09.499038 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 568/1135] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:55:09 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:09.504740 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15b509-fa3f-4ec3-90a7-8c7b851e0b2d admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:09.515169 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15b509-fa3f-4ec3-90a7-8c7b851e0b2d admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:09.519257 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f632b-bae7-42aa-861b-38623aa0aac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:09.519855 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f632b-bae7-42aa-861b-38623aa0aac1 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:09.520144 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f632b-bae7-42aa-861b-38623aa0aac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:09.520421 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f632b-bae7-42aa-861b-38623aa0aac1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:09.521197 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f632b-bae7-42aa-861b-38623aa0aac1 admin admin] RBAC: Adding query filter params (role.id=0af8b2c9076246e6ac61d13d88d91976, scope.project.id=f79f19c59cfd43c48871b51d6aaf501f, user.id=fcbab075fd5b4a889c2002639ca9d60a) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:09.521541 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f632b-bae7-42aa-861b-38623aa0aac1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:09.547268 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f632b-bae7-42aa-861b-38623aa0aac1 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:09.553077 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 568/1136] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:55:09 2021] GET /identity/v3/role_assignments?user.id=fcbab075fd5b4a889c2002639ca9d60a&scope.project.id=f79f19c59cfd43c48871b51d6aaf501f&role.id=0af8b2c9076246e6ac61d13d88d91976 => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:11.477419 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c2fb5-4e84-49a4-a1cc-b73ebcf19c65 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:11.477925 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c2fb5-4e84-49a4-a1cc-b73ebcf19c65 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:11.478011 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6c2fb5-4e84-49a4-a1cc-b73ebcf19c65 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:11.479672 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 569/1137] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:55:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:55:11.484758 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0307b87-6173-4c74-a27b-69ffbb989d25 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:11.485129 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0307b87-6173-4c74-a27b-69ffbb989d25 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:11.485331 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0307b87-6173-4c74-a27b-69ffbb989d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:11.508500 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-c0307b87-6173-4c74-a27b-69ffbb989d25 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:55:11.509570 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-c0307b87-6173-4c74-a27b-69ffbb989d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:55:11.516345 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 569/1138] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:55:11 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:55:11.538590 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c2fb5-4e84-49a4-a1cc-b73ebcf19c65 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:11.549973 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6c2fb5-4e84-49a4-a1cc-b73ebcf19c65 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:11.554382 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc68b7e-4508-4ffc-924f-7b1d4ecce001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:11.555080 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc68b7e-4508-4ffc-924f-7b1d4ecce001 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:11.555361 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc68b7e-4508-4ffc-924f-7b1d4ecce001 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:11.555667 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc68b7e-4508-4ffc-924f-7b1d4ecce001 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:11.566287 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc68b7e-4508-4ffc-924f-7b1d4ecce001 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:55:11.573128 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-afc68b7e-4508-4ffc-924f-7b1d4ecce001 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 14:55:11.574184 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 570/1139] 10.222.0.89 () {56 vars in 1123 bytes} [Wed Oct 27 14:55:11 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:55:11.579824 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0307b87-6173-4c74-a27b-69ffbb989d25 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:11.588180 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0307b87-6173-4c74-a27b-69ffbb989d25 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:11.592279 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82831f-df71-434c-bb02-db0c856edbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:11.592863 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82831f-df71-434c-bb02-db0c856edbda admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:11.593153 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82831f-df71-434c-bb02-db0c856edbda admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:11.593433 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed82831f-df71-434c-bb02-db0c856edbda admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:11.594139 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82831f-df71-434c-bb02-db0c856edbda admin admin] RBAC: Adding query filter params (name=service) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:11.594440 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82831f-df71-434c-bb02-db0c856edbda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:11.619992 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed82831f-df71-434c-bb02-db0c856edbda admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:11.628164 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 570/1140] 10.222.0.89 () {56 vars in 1124 bytes} [Wed Oct 27 14:55:11 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:11.634114 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc68b7e-4508-4ffc-924f-7b1d4ecce001 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:11.643664 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc68b7e-4508-4ffc-924f-7b1d4ecce001 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:11.647804 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ecbc0-597e-47f6-bc64-0fd51867e28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:11.648497 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ecbc0-597e-47f6-bc64-0fd51867e28c admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:11.648784 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ecbc0-597e-47f6-bc64-0fd51867e28c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:11.649068 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12ecbc0-597e-47f6-bc64-0fd51867e28c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:11.660229 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ecbc0-597e-47f6-bc64-0fd51867e28c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:11.685947 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12ecbc0-597e-47f6-bc64-0fd51867e28c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:11.703936 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-a12ecbc0-597e-47f6-bc64-0fd51867e28c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:55:11.705187 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 571/1141] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:55:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 14:55:11.711002 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82831f-df71-434c-bb02-db0c856edbda admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:11.720203 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed82831f-df71-434c-bb02-db0c856edbda admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:11.724273 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3ab52-cf37-4bff-9832-7765bc806887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:11.724851 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3ab52-cf37-4bff-9832-7765bc806887 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:11.725139 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3ab52-cf37-4bff-9832-7765bc806887 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:11.725422 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb3ab52-cf37-4bff-9832-7765bc806887 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:11.726102 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3ab52-cf37-4bff-9832-7765bc806887 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:11.726401 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3ab52-cf37-4bff-9832-7765bc806887 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:11.751745 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb3ab52-cf37-4bff-9832-7765bc806887 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:11.764703 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 571/1142] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:55:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:11.769880 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ecbc0-597e-47f6-bc64-0fd51867e28c admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:11.778967 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12ecbc0-597e-47f6-bc64-0fd51867e28c admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:11.783214 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85984a5-69b8-4a19-a463-1f65b580f86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:11.783948 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85984a5-69b8-4a19-a463-1f65b580f86b admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:11.784239 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85984a5-69b8-4a19-a463-1f65b580f86b admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:11.784515 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85984a5-69b8-4a19-a463-1f65b580f86b admin admin] PATH_INFO: `/v3/users/placement` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:11.797346 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85984a5-69b8-4a19-a463-1f65b580f86b admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:11.823088 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85984a5-69b8-4a19-a463-1f65b580f86b admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:11.840079 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-f85984a5-69b8-4a19-a463-1f65b580f86b admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 14:55:11.841097 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 572/1143] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:55:11 2021] GET /identity/v3/users/placement => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:55:11.846496 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3ab52-cf37-4bff-9832-7765bc806887 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:11.856054 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb3ab52-cf37-4bff-9832-7765bc806887 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:11.860128 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74da7a-d7f3-4758-88f8-278bcc2a1a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:11.860708 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74da7a-d7f3-4758-88f8-278bcc2a1a16 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:11.860996 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74da7a-d7f3-4758-88f8-278bcc2a1a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:11.861272 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74da7a-d7f3-4758-88f8-278bcc2a1a16 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:11.862053 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74da7a-d7f3-4758-88f8-278bcc2a1a16 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:11.862354 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74da7a-d7f3-4758-88f8-278bcc2a1a16 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:11.887992 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74da7a-d7f3-4758-88f8-278bcc2a1a16 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:11.916628 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 572/1144] 10.222.0.89 () {56 vars in 1164 bytes} [Wed Oct 27 14:55:11 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:11.921952 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85984a5-69b8-4a19-a463-1f65b580f86b admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:11.931594 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85984a5-69b8-4a19-a463-1f65b580f86b admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:11.935540 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6c10c-aced-4575-8070-db9435c5263b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:11.936225 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6c10c-aced-4575-8070-db9435c5263b admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:11.936505 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6c10c-aced-4575-8070-db9435c5263b admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:11.936775 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e6c10c-aced-4575-8070-db9435c5263b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:11.948441 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e6c10c-aced-4575-8070-db9435c5263b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:11.973138 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e6c10c-aced-4575-8070-db9435c5263b admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:11.990243 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-43e6c10c-aced-4575-8070-db9435c5263b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:55:11.991256 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 573/1145] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:55:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:55:11.996599 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74da7a-d7f3-4758-88f8-278bcc2a1a16 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:12.006503 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74da7a-d7f3-4758-88f8-278bcc2a1a16 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:12.010601 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd315f5-8e04-4743-b60c-23d1001f0bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:12.011184 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd315f5-8e04-4743-b60c-23d1001f0bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:12.011500 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd315f5-8e04-4743-b60c-23d1001f0bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:12.011785 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd315f5-8e04-4743-b60c-23d1001f0bb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:12.012461 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd315f5-8e04-4743-b60c-23d1001f0bb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:12.012758 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd315f5-8e04-4743-b60c-23d1001f0bb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:12.038244 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd315f5-8e04-4743-b60c-23d1001f0bb2 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:12.050401 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 573/1146] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:55:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:12.056289 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6c10c-aced-4575-8070-db9435c5263b admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:12.065206 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e6c10c-aced-4575-8070-db9435c5263b admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:12.069166 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba8e47-93d4-48d1-a401-57e4b2d357df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:12.069854 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba8e47-93d4-48d1-a401-57e4b2d357df admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:12.070134 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba8e47-93d4-48d1-a401-57e4b2d357df admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:12.070407 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba8e47-93d4-48d1-a401-57e4b2d357df admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:12.078978 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba8e47-93d4-48d1-a401-57e4b2d357df admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:12.104393 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ba8e47-93d4-48d1-a401-57e4b2d357df admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:12.117910 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-f1ba8e47-93d4-48d1-a401-57e4b2d357df admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:55:12.118918 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 574/1147] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:55:12 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:55:12.124221 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd315f5-8e04-4743-b60c-23d1001f0bb2 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:12.133101 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd315f5-8e04-4743-b60c-23d1001f0bb2 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:12.137177 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d825f78e-615d-4a7c-90d2-7b665aaaf1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:12.137747 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825f78e-615d-4a7c-90d2-7b665aaaf1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:12.138035 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825f78e-615d-4a7c-90d2-7b665aaaf1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:12.138316 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d825f78e-615d-4a7c-90d2-7b665aaaf1a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:12.139049 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825f78e-615d-4a7c-90d2-7b665aaaf1a7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:12.139351 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825f78e-615d-4a7c-90d2-7b665aaaf1a7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:12.165138 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d825f78e-615d-4a7c-90d2-7b665aaaf1a7 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:12.178227 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 574/1148] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:55:12 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:12.183547 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba8e47-93d4-48d1-a401-57e4b2d357df admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:12.192371 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba8e47-93d4-48d1-a401-57e4b2d357df admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:12.196331 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e511cd-294d-463a-a554-41559903a38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:12.197220 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e511cd-294d-463a-a554-41559903a38e admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:12.197506 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e511cd-294d-463a-a554-41559903a38e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:12.197779 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e511cd-294d-463a-a554-41559903a38e admin admin] PATH_INFO: `/v3/projects/f79f19c59cfd43c48871b51d6aaf501f/users/fcbab075fd5b4a889c2002639ca9d60a/roles/0af8b2c9076246e6ac61d13d88d91976` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:12.220945 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e511cd-294d-463a-a554-41559903a38e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79f19c59cfd43c48871b51d6aaf501f, user_id=fcbab075fd5b4a889c2002639ca9d60a, role_id=0af8b2c9076246e6ac61d13d88d91976)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:12.257821 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e511cd-294d-463a-a554-41559903a38e admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:12.274546 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 575/1149] 10.222.0.89 () {58 vars in 1460 bytes} [Wed Oct 27 14:55:12 2021] PUT /identity/v3/projects/f79f19c59cfd43c48871b51d6aaf501f/users/fcbab075fd5b4a889c2002639ca9d60a/roles/0af8b2c9076246e6ac61d13d88d91976 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:55:14.203388 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfa000-b005-4bf2-b8b1-e665b54473e7 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:14.204046 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfa000-b005-4bf2-b8b1-e665b54473e7 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:14.204046 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfa000-b005-4bf2-b8b1-e665b54473e7 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:14.205634 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 575/1150] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:55:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:55:14.211330 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2254a4-a6ee-49a2-bdd7-0e217b3377dd None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:14.211957 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2254a4-a6ee-49a2-bdd7-0e217b3377dd None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:14.211957 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2254a4-a6ee-49a2-bdd7-0e217b3377dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:14.234504 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-8a2254a4-a6ee-49a2-bdd7-0e217b3377dd None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:55:14.235653 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-8a2254a4-a6ee-49a2-bdd7-0e217b3377dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:55:14.298314 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 576/1151] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:55:14 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:55:14.321446 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfa000-b005-4bf2-b8b1-e665b54473e7 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:14.334771 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dfa000-b005-4bf2-b8b1-e665b54473e7 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:14.338757 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ce4e8-81e7-459e-a285-b72541fed886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:14.339494 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ce4e8-81e7-459e-a285-b72541fed886 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:14.339782 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ce4e8-81e7-459e-a285-b72541fed886 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:14.340059 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ce4e8-81e7-459e-a285-b72541fed886 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:14.350948 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ce4e8-81e7-459e-a285-b72541fed886 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:55:14.357240 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-f14ce4e8-81e7-459e-a285-b72541fed886 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 14:55:14.358311 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 576/1152] 10.222.0.89 () {56 vars in 1123 bytes} [Wed Oct 27 14:55:14 2021] GET /identity/v3/roles/service => generated 85 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:55:14.364092 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2254a4-a6ee-49a2-bdd7-0e217b3377dd None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:14.372497 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2254a4-a6ee-49a2-bdd7-0e217b3377dd None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:14.376489 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5773323-77ac-4c5c-a77a-455696084f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:14.377069 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5773323-77ac-4c5c-a77a-455696084f1e admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:14.377349 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5773323-77ac-4c5c-a77a-455696084f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:14.377621 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5773323-77ac-4c5c-a77a-455696084f1e admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:14.378327 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5773323-77ac-4c5c-a77a-455696084f1e admin admin] RBAC: Adding query filter params (name=service) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:14.378618 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5773323-77ac-4c5c-a77a-455696084f1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:14.404192 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5773323-77ac-4c5c-a77a-455696084f1e admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:14.412561 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 577/1153] 10.222.0.89 () {56 vars in 1124 bytes} [Wed Oct 27 14:55:14 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:14.417878 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ce4e8-81e7-459e-a285-b72541fed886 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:14.427763 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ce4e8-81e7-459e-a285-b72541fed886 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:14.431817 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5228ce3-91bb-47f6-886b-c859108c693f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:14.432492 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5228ce3-91bb-47f6-886b-c859108c693f admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:14.432778 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5228ce3-91bb-47f6-886b-c859108c693f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:14.433054 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5228ce3-91bb-47f6-886b-c859108c693f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:14.444411 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5228ce3-91bb-47f6-886b-c859108c693f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:14.469318 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5228ce3-91bb-47f6-886b-c859108c693f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:14.487282 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-f5228ce3-91bb-47f6-886b-c859108c693f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:55:14.488319 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 577/1154] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:55:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:55:14.494148 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5773323-77ac-4c5c-a77a-455696084f1e admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:14.502980 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5773323-77ac-4c5c-a77a-455696084f1e admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:14.507645 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef939a8-5bca-4806-8828-2c306a973d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:14.508209 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef939a8-5bca-4806-8828-2c306a973d98 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:14.508490 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef939a8-5bca-4806-8828-2c306a973d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:14.508764 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef939a8-5bca-4806-8828-2c306a973d98 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:14.509429 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef939a8-5bca-4806-8828-2c306a973d98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:14.509719 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef939a8-5bca-4806-8828-2c306a973d98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:14.534565 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef939a8-5bca-4806-8828-2c306a973d98 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:14.546984 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 578/1155] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:55:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:14.552684 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5228ce3-91bb-47f6-886b-c859108c693f admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:14.561555 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5228ce3-91bb-47f6-886b-c859108c693f admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:14.565576 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18596ebc-a2e9-4c19-ba8e-1f5142b840e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:14.566270 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18596ebc-a2e9-4c19-ba8e-1f5142b840e2 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:14.566555 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18596ebc-a2e9-4c19-ba8e-1f5142b840e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:14.566828 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18596ebc-a2e9-4c19-ba8e-1f5142b840e2 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:14.579506 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18596ebc-a2e9-4c19-ba8e-1f5142b840e2 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:14.604550 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18596ebc-a2e9-4c19-ba8e-1f5142b840e2 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:14.622277 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-18596ebc-a2e9-4c19-ba8e-1f5142b840e2 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 14:55:14.623295 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 578/1156] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:55:14 2021] GET /identity/v3/users/placement => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 14:55:14.628769 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef939a8-5bca-4806-8828-2c306a973d98 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:14.638474 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef939a8-5bca-4806-8828-2c306a973d98 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:14.642524 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63bd17-e4a2-498c-82ee-ff3d10f4bb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:14.643165 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63bd17-e4a2-498c-82ee-ff3d10f4bb9f admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:14.643477 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63bd17-e4a2-498c-82ee-ff3d10f4bb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:14.643761 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63bd17-e4a2-498c-82ee-ff3d10f4bb9f admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:14.644547 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63bd17-e4a2-498c-82ee-ff3d10f4bb9f admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:14.644850 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63bd17-e4a2-498c-82ee-ff3d10f4bb9f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:14.670261 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac63bd17-e4a2-498c-82ee-ff3d10f4bb9f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:14.699059 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 579/1157] 10.222.0.89 () {56 vars in 1164 bytes} [Wed Oct 27 14:55:14 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:14.704466 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18596ebc-a2e9-4c19-ba8e-1f5142b840e2 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:14.713410 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18596ebc-a2e9-4c19-ba8e-1f5142b840e2 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:14.717398 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406292c-b2e1-4b97-80e1-4c5bed89b21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:14.717951 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406292c-b2e1-4b97-80e1-4c5bed89b21f admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:14.718237 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406292c-b2e1-4b97-80e1-4c5bed89b21f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:14.718509 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406292c-b2e1-4b97-80e1-4c5bed89b21f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:14.725974 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406292c-b2e1-4b97-80e1-4c5bed89b21f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:14.751196 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406292c-b2e1-4b97-80e1-4c5bed89b21f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:14.760989 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 579/1158] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:55:14 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:55:14.766373 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63bd17-e4a2-498c-82ee-ff3d10f4bb9f admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:14.775378 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac63bd17-e4a2-498c-82ee-ff3d10f4bb9f admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:14.779461 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5ee21-f427-45cc-a8b7-32a938f4496c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:14.780168 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5ee21-f427-45cc-a8b7-32a938f4496c admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:14.780456 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5ee21-f427-45cc-a8b7-32a938f4496c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:14.780736 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5ee21-f427-45cc-a8b7-32a938f4496c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:14.792731 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5ee21-f427-45cc-a8b7-32a938f4496c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:14.818270 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5ee21-f427-45cc-a8b7-32a938f4496c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:14.834545 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-91e5ee21-f427-45cc-a8b7-32a938f4496c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:55:14.835597 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 580/1159] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:55:14 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:55:14.840865 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406292c-b2e1-4b97-80e1-4c5bed89b21f admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:14.849496 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406292c-b2e1-4b97-80e1-4c5bed89b21f admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:14.853539 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daefe3f-3fae-45a1-8816-dbad8b959e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:14.854105 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daefe3f-3fae-45a1-8816-dbad8b959e07 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:14.854390 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daefe3f-3fae-45a1-8816-dbad8b959e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:14.854667 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daefe3f-3fae-45a1-8816-dbad8b959e07 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:14.855341 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daefe3f-3fae-45a1-8816-dbad8b959e07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:14.855665 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daefe3f-3fae-45a1-8816-dbad8b959e07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:14.880965 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daefe3f-3fae-45a1-8816-dbad8b959e07 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:14.893135 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 580/1160] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:55:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:14.898267 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5ee21-f427-45cc-a8b7-32a938f4496c admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:14.907149 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5ee21-f427-45cc-a8b7-32a938f4496c admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:14.911984 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68808f03-7135-49b4-80b9-a007edbb6395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:14.912665 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68808f03-7135-49b4-80b9-a007edbb6395 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:14.912949 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68808f03-7135-49b4-80b9-a007edbb6395 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:14.913224 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68808f03-7135-49b4-80b9-a007edbb6395 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:14.921846 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68808f03-7135-49b4-80b9-a007edbb6395 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:14.947225 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68808f03-7135-49b4-80b9-a007edbb6395 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:14.960215 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-68808f03-7135-49b4-80b9-a007edbb6395 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:55:14.961223 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 581/1161] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:55:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:55:14.966516 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daefe3f-3fae-45a1-8816-dbad8b959e07 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:14.975887 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daefe3f-3fae-45a1-8816-dbad8b959e07 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:14.979940 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb3c51-2c29-4f8b-bf5e-dc2c36c648de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:14.980448 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb3c51-2c29-4f8b-bf5e-dc2c36c648de admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:14.980732 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb3c51-2c29-4f8b-bf5e-dc2c36c648de admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:14.981009 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb3c51-2c29-4f8b-bf5e-dc2c36c648de admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:14.981735 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb3c51-2c29-4f8b-bf5e-dc2c36c648de admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:14.982032 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb3c51-2c29-4f8b-bf5e-dc2c36c648de admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:15.007606 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb3c51-2c29-4f8b-bf5e-dc2c36c648de admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:15.020074 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 581/1162] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:55:14 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:15.025475 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68808f03-7135-49b4-80b9-a007edbb6395 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:15.034556 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68808f03-7135-49b4-80b9-a007edbb6395 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:15.039039 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209732a-cbbe-4690-bb50-7cb1a3fc5109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:15.039630 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209732a-cbbe-4690-bb50-7cb1a3fc5109 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:15.039917 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209732a-cbbe-4690-bb50-7cb1a3fc5109 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:15.040194 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209732a-cbbe-4690-bb50-7cb1a3fc5109 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:15.040958 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d209732a-cbbe-4690-bb50-7cb1a3fc5109 admin admin] RBAC: Adding query filter params (role.id=0af8b2c9076246e6ac61d13d88d91976, scope.project.id=f79f19c59cfd43c48871b51d6aaf501f, user.id=fcbab075fd5b4a889c2002639ca9d60a) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:15.041255 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d209732a-cbbe-4690-bb50-7cb1a3fc5109 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:15.066723 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d209732a-cbbe-4690-bb50-7cb1a3fc5109 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:15.072213 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 582/1163] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:55:15 2021] GET /identity/v3/role_assignments?user.id=fcbab075fd5b4a889c2002639ca9d60a&scope.project.id=f79f19c59cfd43c48871b51d6aaf501f&role.id=0af8b2c9076246e6ac61d13d88d91976 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:17.077780 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0f2e1-f33a-4be4-997c-298ec7c7327b None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:17.078343 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0f2e1-f33a-4be4-997c-298ec7c7327b None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:17.078343 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0f2e1-f33a-4be4-997c-298ec7c7327b None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:17.080016 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 582/1164] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:55:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:55:17.085786 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d42d59-a630-4314-993e-b0d88b7a23c7 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:17.086157 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d42d59-a630-4314-993e-b0d88b7a23c7 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:17.086352 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d42d59-a630-4314-993e-b0d88b7a23c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:17.108381 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-a3d42d59-a630-4314-993e-b0d88b7a23c7 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:55:17.109509 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-a3d42d59-a630-4314-993e-b0d88b7a23c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:55:17.116216 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 583/1165] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:55:17 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:55:17.139013 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0f2e1-f33a-4be4-997c-298ec7c7327b None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:17.150958 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0f2e1-f33a-4be4-997c-298ec7c7327b None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:17.154847 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94397c80-869c-4c5d-8fd4-69f94d6354cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:17.155570 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94397c80-869c-4c5d-8fd4-69f94d6354cd admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:17.155856 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94397c80-869c-4c5d-8fd4-69f94d6354cd admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:17.156133 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94397c80-869c-4c5d-8fd4-69f94d6354cd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:17.167212 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94397c80-869c-4c5d-8fd4-69f94d6354cd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:55:17.173380 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-94397c80-869c-4c5d-8fd4-69f94d6354cd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 14:55:17.174433 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 583/1166] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:55:17 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:55:17.179946 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d42d59-a630-4314-993e-b0d88b7a23c7 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:17.188335 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d42d59-a630-4314-993e-b0d88b7a23c7 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:17.192385 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c52f1-7018-44e6-8da3-19c3467ad8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:17.192964 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c52f1-7018-44e6-8da3-19c3467ad8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:17.193251 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c52f1-7018-44e6-8da3-19c3467ad8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:17.194057 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c52f1-7018-44e6-8da3-19c3467ad8a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:17.194765 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c52f1-7018-44e6-8da3-19c3467ad8a9 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:17.195063 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c52f1-7018-44e6-8da3-19c3467ad8a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:17.223055 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c52f1-7018-44e6-8da3-19c3467ad8a9 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:17.239473 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 584/1167] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:55:17 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:17.240638 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94397c80-869c-4c5d-8fd4-69f94d6354cd admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:17.253259 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94397c80-869c-4c5d-8fd4-69f94d6354cd admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:17.258694 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a84f8f-d870-4e6d-a44f-7238815ecd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:17.259411 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a84f8f-d870-4e6d-a44f-7238815ecd8e admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:17.259729 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a84f8f-d870-4e6d-a44f-7238815ecd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:17.260010 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a84f8f-d870-4e6d-a44f-7238815ecd8e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:17.271203 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a84f8f-d870-4e6d-a44f-7238815ecd8e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:17.297127 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a84f8f-d870-4e6d-a44f-7238815ecd8e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:17.314101 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-f6a84f8f-d870-4e6d-a44f-7238815ecd8e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:55:17.315162 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 584/1168] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:55:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 14:55:17.321541 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c52f1-7018-44e6-8da3-19c3467ad8a9 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:17.330753 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c52f1-7018-44e6-8da3-19c3467ad8a9 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:17.335488 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df38d1-ac93-467b-9142-c8c8eceaf5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:17.336074 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df38d1-ac93-467b-9142-c8c8eceaf5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:17.336362 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df38d1-ac93-467b-9142-c8c8eceaf5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:17.336639 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df38d1-ac93-467b-9142-c8c8eceaf5c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:17.337323 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df38d1-ac93-467b-9142-c8c8eceaf5c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:17.337619 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df38d1-ac93-467b-9142-c8c8eceaf5c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:17.362669 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df38d1-ac93-467b-9142-c8c8eceaf5c9 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:17.375045 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 585/1169] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:55:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:17.380501 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a84f8f-d870-4e6d-a44f-7238815ecd8e admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:17.389978 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a84f8f-d870-4e6d-a44f-7238815ecd8e admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:17.394004 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef059d-de9f-499a-9622-19a1cc9082f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:17.394702 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef059d-de9f-499a-9622-19a1cc9082f9 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:17.394989 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef059d-de9f-499a-9622-19a1cc9082f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:17.395265 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef059d-de9f-499a-9622-19a1cc9082f9 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:17.408519 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef059d-de9f-499a-9622-19a1cc9082f9 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:17.434097 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef059d-de9f-499a-9622-19a1cc9082f9 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:17.451876 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-89ef059d-de9f-499a-9622-19a1cc9082f9 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 14:55:17.452906 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 585/1170] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:55:17 2021] GET /identity/v3/users/placement => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:55:17.458474 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df38d1-ac93-467b-9142-c8c8eceaf5c9 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:17.467570 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df38d1-ac93-467b-9142-c8c8eceaf5c9 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:17.471682 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0bfbd-1256-4b18-8df9-8ade50c3f9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:17.472260 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0bfbd-1256-4b18-8df9-8ade50c3f9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:17.472547 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0bfbd-1256-4b18-8df9-8ade50c3f9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:17.472824 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0bfbd-1256-4b18-8df9-8ade50c3f9b6 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:17.473599 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0bfbd-1256-4b18-8df9-8ade50c3f9b6 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:17.473899 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0bfbd-1256-4b18-8df9-8ade50c3f9b6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:17.499421 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e0bfbd-1256-4b18-8df9-8ade50c3f9b6 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:17.529672 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 586/1171] 10.222.0.89 () {56 vars in 1164 bytes} [Wed Oct 27 14:55:17 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:17.535402 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef059d-de9f-499a-9622-19a1cc9082f9 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:17.544362 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef059d-de9f-499a-9622-19a1cc9082f9 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:17.548380 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8368fe9-055a-46d2-8d2e-ab4786273536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:17.548928 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8368fe9-055a-46d2-8d2e-ab4786273536 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:17.549209 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8368fe9-055a-46d2-8d2e-ab4786273536 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:17.549585 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8368fe9-055a-46d2-8d2e-ab4786273536 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:17.557376 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8368fe9-055a-46d2-8d2e-ab4786273536 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:17.582683 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8368fe9-055a-46d2-8d2e-ab4786273536 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:17.591605 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 586/1172] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:55:17 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:55:17.597006 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0bfbd-1256-4b18-8df9-8ade50c3f9b6 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:17.605915 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0bfbd-1256-4b18-8df9-8ade50c3f9b6 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:17.609990 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217b36e-9560-479f-b3a1-a136270b9383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:17.610685 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217b36e-9560-479f-b3a1-a136270b9383 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:17.610970 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217b36e-9560-479f-b3a1-a136270b9383 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:17.611246 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a217b36e-9560-479f-b3a1-a136270b9383 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:17.622905 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217b36e-9560-479f-b3a1-a136270b9383 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:17.648503 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a217b36e-9560-479f-b3a1-a136270b9383 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:17.664890 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-a217b36e-9560-479f-b3a1-a136270b9383 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:55:17.665925 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 587/1173] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:55:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:55:17.671241 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8368fe9-055a-46d2-8d2e-ab4786273536 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:17.679895 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8368fe9-055a-46d2-8d2e-ab4786273536 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:17.683911 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d5347-bb9c-4aea-9e6f-d5cbcd87eeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:17.684478 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d5347-bb9c-4aea-9e6f-d5cbcd87eeeb admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:17.684765 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d5347-bb9c-4aea-9e6f-d5cbcd87eeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:17.685040 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d5347-bb9c-4aea-9e6f-d5cbcd87eeeb admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:17.685707 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d5347-bb9c-4aea-9e6f-d5cbcd87eeeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:17.685998 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d5347-bb9c-4aea-9e6f-d5cbcd87eeeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:17.711751 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512d5347-bb9c-4aea-9e6f-d5cbcd87eeeb admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:17.723963 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 587/1174] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:55:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:17.729308 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217b36e-9560-479f-b3a1-a136270b9383 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:17.738343 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a217b36e-9560-479f-b3a1-a136270b9383 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:17.742884 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6def9-03ac-4676-b332-182c1fe7224d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:17.743615 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6def9-03ac-4676-b332-182c1fe7224d admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:17.743904 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6def9-03ac-4676-b332-182c1fe7224d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:17.744180 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb6def9-03ac-4676-b332-182c1fe7224d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:17.752820 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6def9-03ac-4676-b332-182c1fe7224d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:17.778342 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb6def9-03ac-4676-b332-182c1fe7224d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:17.792176 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-dfb6def9-03ac-4676-b332-182c1fe7224d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:55:17.793201 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 588/1175] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:55:17 2021] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:55:17.798735 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d5347-bb9c-4aea-9e6f-d5cbcd87eeeb admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:17.808299 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d5347-bb9c-4aea-9e6f-d5cbcd87eeeb admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:17.812366 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33720a96-4875-40ee-ac49-45fe9e49577d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:17.812936 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33720a96-4875-40ee-ac49-45fe9e49577d admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:17.813225 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33720a96-4875-40ee-ac49-45fe9e49577d admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:17.813506 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33720a96-4875-40ee-ac49-45fe9e49577d admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:17.814239 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33720a96-4875-40ee-ac49-45fe9e49577d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:17.814542 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33720a96-4875-40ee-ac49-45fe9e49577d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:17.839635 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33720a96-4875-40ee-ac49-45fe9e49577d admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:17.852633 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 588/1176] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:55:17 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:17.858105 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6def9-03ac-4676-b332-182c1fe7224d admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:17.867685 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb6def9-03ac-4676-b332-182c1fe7224d admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:17.871688 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e87a82-2557-492e-aa88-48536aafc41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:17.872246 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e87a82-2557-492e-aa88-48536aafc41a admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:17.872533 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e87a82-2557-492e-aa88-48536aafc41a admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:17.872808 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e87a82-2557-492e-aa88-48536aafc41a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:17.873575 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e87a82-2557-492e-aa88-48536aafc41a admin admin] RBAC: Adding query filter params (role.id=c243fbeb99ae4f51910f72ddc1773778, scope.project.id=f79f19c59cfd43c48871b51d6aaf501f, user.id=fcbab075fd5b4a889c2002639ca9d60a) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:17.873874 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e87a82-2557-492e-aa88-48536aafc41a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:17.898791 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e87a82-2557-492e-aa88-48536aafc41a admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:17.903905 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 589/1177] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:55:17 2021] GET /identity/v3/role_assignments?user.id=fcbab075fd5b4a889c2002639ca9d60a&scope.project.id=f79f19c59cfd43c48871b51d6aaf501f&role.id=c243fbeb99ae4f51910f72ddc1773778 => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:19.834722 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe639af-4cd6-41ef-b3a4-75d38eda3397 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:19.835253 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe639af-4cd6-41ef-b3a4-75d38eda3397 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:19.835346 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe639af-4cd6-41ef-b3a4-75d38eda3397 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:19.837090 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 589/1178] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:55:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:55:19.842256 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7d86e-c470-4cff-bced-404b04dd6627 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:19.842655 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7d86e-c470-4cff-bced-404b04dd6627 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:19.842815 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7d86e-c470-4cff-bced-404b04dd6627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:19.865435 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-5ae7d86e-c470-4cff-bced-404b04dd6627 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:55:19.866560 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-5ae7d86e-c470-4cff-bced-404b04dd6627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:55:19.873333 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 590/1179] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:55:19 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:55:19.894728 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe639af-4cd6-41ef-b3a4-75d38eda3397 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:19.906654 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe639af-4cd6-41ef-b3a4-75d38eda3397 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:19.910869 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8835785-7629-4af5-a04b-a3993f5b3a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:19.911602 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8835785-7629-4af5-a04b-a3993f5b3a77 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:19.911891 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8835785-7629-4af5-a04b-a3993f5b3a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:19.912702 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8835785-7629-4af5-a04b-a3993f5b3a77 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:19.923702 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8835785-7629-4af5-a04b-a3993f5b3a77 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:55:19.929868 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-f8835785-7629-4af5-a04b-a3993f5b3a77 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 14:55:19.930922 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 590/1180] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:55:19 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:55:19.936514 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7d86e-c470-4cff-bced-404b04dd6627 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:19.944902 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7d86e-c470-4cff-bced-404b04dd6627 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:19.948918 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7036f002-f567-46b1-b2fd-16be34546a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:19.949554 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036f002-f567-46b1-b2fd-16be34546a9c admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:19.949844 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036f002-f567-46b1-b2fd-16be34546a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:19.950125 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7036f002-f567-46b1-b2fd-16be34546a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:19.950837 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7036f002-f567-46b1-b2fd-16be34546a9c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:19.951133 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7036f002-f567-46b1-b2fd-16be34546a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:19.977086 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7036f002-f567-46b1-b2fd-16be34546a9c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:19.985357 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 591/1181] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:55:19 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:19.990741 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8835785-7629-4af5-a04b-a3993f5b3a77 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:20.000316 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8835785-7629-4af5-a04b-a3993f5b3a77 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:20.004724 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c23ea0-dee5-4934-b9bd-31b0aa9d023b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:20.005408 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c23ea0-dee5-4934-b9bd-31b0aa9d023b admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:20.005695 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c23ea0-dee5-4934-b9bd-31b0aa9d023b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:20.006460 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c23ea0-dee5-4934-b9bd-31b0aa9d023b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:20.017410 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c23ea0-dee5-4934-b9bd-31b0aa9d023b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:20.043415 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c23ea0-dee5-4934-b9bd-31b0aa9d023b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:20.061188 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-79c23ea0-dee5-4934-b9bd-31b0aa9d023b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:55:20.062220 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 591/1182] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:55:19 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:55:20.069137 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7036f002-f567-46b1-b2fd-16be34546a9c admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:20.078188 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7036f002-f567-46b1-b2fd-16be34546a9c admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:20.082227 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a1f6c-a9cd-475c-87dc-0de38a69b71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:20.082803 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a1f6c-a9cd-475c-87dc-0de38a69b71e admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:20.083091 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a1f6c-a9cd-475c-87dc-0de38a69b71e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:20.083369 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a1f6c-a9cd-475c-87dc-0de38a69b71e admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:20.084683 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a1f6c-a9cd-475c-87dc-0de38a69b71e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:20.085033 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a1f6c-a9cd-475c-87dc-0de38a69b71e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:20.109751 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a1f6c-a9cd-475c-87dc-0de38a69b71e admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:20.122030 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 592/1183] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:55:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:20.127298 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c23ea0-dee5-4934-b9bd-31b0aa9d023b admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:20.136713 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c23ea0-dee5-4934-b9bd-31b0aa9d023b admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:20.140766 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b60047-d83a-48ec-955e-87be1f7d0631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:20.141459 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b60047-d83a-48ec-955e-87be1f7d0631 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:20.141747 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b60047-d83a-48ec-955e-87be1f7d0631 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:20.142025 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b60047-d83a-48ec-955e-87be1f7d0631 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:20.154927 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b60047-d83a-48ec-955e-87be1f7d0631 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:20.180184 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b60047-d83a-48ec-955e-87be1f7d0631 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:20.197834 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-76b60047-d83a-48ec-955e-87be1f7d0631 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 14:55:20.198857 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 592/1184] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:55:20 2021] GET /identity/v3/users/placement => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:55:20.204202 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a1f6c-a9cd-475c-87dc-0de38a69b71e admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:20.213854 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a1f6c-a9cd-475c-87dc-0de38a69b71e admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:20.217945 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2baa5cd-fcde-45a1-b50d-b2d2d71d1bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:20.218527 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2baa5cd-fcde-45a1-b50d-b2d2d71d1bac admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:20.218816 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2baa5cd-fcde-45a1-b50d-b2d2d71d1bac admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:20.219096 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2baa5cd-fcde-45a1-b50d-b2d2d71d1bac admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:20.219918 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2baa5cd-fcde-45a1-b50d-b2d2d71d1bac admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:20.220247 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2baa5cd-fcde-45a1-b50d-b2d2d71d1bac admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:20.245312 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2baa5cd-fcde-45a1-b50d-b2d2d71d1bac admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:20.274516 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 593/1185] 10.222.0.89 () {56 vars in 1164 bytes} [Wed Oct 27 14:55:20 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:20.280087 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b60047-d83a-48ec-955e-87be1f7d0631 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:20.289477 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b60047-d83a-48ec-955e-87be1f7d0631 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:20.293531 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43615f77-7032-4f24-8193-0d90a06a59bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:20.294259 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43615f77-7032-4f24-8193-0d90a06a59bc admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:20.294543 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43615f77-7032-4f24-8193-0d90a06a59bc admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:20.294816 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43615f77-7032-4f24-8193-0d90a06a59bc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:20.306645 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43615f77-7032-4f24-8193-0d90a06a59bc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:20.331809 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43615f77-7032-4f24-8193-0d90a06a59bc admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:20.348607 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-43615f77-7032-4f24-8193-0d90a06a59bc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:55:20.349743 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 593/1186] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:55:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:55:20.354840 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2baa5cd-fcde-45a1-b50d-b2d2d71d1bac admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:20.363920 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2baa5cd-fcde-45a1-b50d-b2d2d71d1bac admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:20.368002 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98254da6-fc1f-415f-94e8-ca6ddfabb5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:20.368578 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98254da6-fc1f-415f-94e8-ca6ddfabb5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:20.368866 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98254da6-fc1f-415f-94e8-ca6ddfabb5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:20.369143 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98254da6-fc1f-415f-94e8-ca6ddfabb5b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:20.369820 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98254da6-fc1f-415f-94e8-ca6ddfabb5b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:20.370119 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98254da6-fc1f-415f-94e8-ca6ddfabb5b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:20.395340 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98254da6-fc1f-415f-94e8-ca6ddfabb5b7 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:20.408419 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 594/1187] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:55:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:55:20.413812 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43615f77-7032-4f24-8193-0d90a06a59bc admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:20.422739 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43615f77-7032-4f24-8193-0d90a06a59bc admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:20.426768 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650985e9-5667-4412-8ff9-ab38937abd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:20.427483 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650985e9-5667-4412-8ff9-ab38937abd1c admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:20.428273 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650985e9-5667-4412-8ff9-ab38937abd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:20.428619 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650985e9-5667-4412-8ff9-ab38937abd1c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:20.438076 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650985e9-5667-4412-8ff9-ab38937abd1c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:20.463685 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650985e9-5667-4412-8ff9-ab38937abd1c admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:20.477057 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-650985e9-5667-4412-8ff9-ab38937abd1c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:55:20.478134 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 594/1188] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:55:20 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:55:20.484005 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98254da6-fc1f-415f-94e8-ca6ddfabb5b7 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:20.493677 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98254da6-fc1f-415f-94e8-ca6ddfabb5b7 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:20.497749 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c8b7b-82d8-41ff-a97a-efcb295bfcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:20.498322 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c8b7b-82d8-41ff-a97a-efcb295bfcf2 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:20.498605 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c8b7b-82d8-41ff-a97a-efcb295bfcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:20.498883 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c8b7b-82d8-41ff-a97a-efcb295bfcf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:20.499648 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c8b7b-82d8-41ff-a97a-efcb295bfcf2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:20.499947 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c8b7b-82d8-41ff-a97a-efcb295bfcf2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:20.525401 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c8b7b-82d8-41ff-a97a-efcb295bfcf2 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:20.538125 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 595/1189] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:55:20 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:20.543638 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650985e9-5667-4412-8ff9-ab38937abd1c admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:20.553227 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650985e9-5667-4412-8ff9-ab38937abd1c admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:20.557221 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318d77a3-fa6f-4d53-acf2-86357afe106e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:20.558004 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d77a3-fa6f-4d53-acf2-86357afe106e admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:20.558288 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d77a3-fa6f-4d53-acf2-86357afe106e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:20.558561 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318d77a3-fa6f-4d53-acf2-86357afe106e admin admin] PATH_INFO: `/v3/projects/f79f19c59cfd43c48871b51d6aaf501f/users/fcbab075fd5b4a889c2002639ca9d60a/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:20.560304 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318d77a3-fa6f-4d53-acf2-86357afe106e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79f19c59cfd43c48871b51d6aaf501f, user_id=fcbab075fd5b4a889c2002639ca9d60a, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:20.586725 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318d77a3-fa6f-4d53-acf2-86357afe106e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:20.599170 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 595/1190] 10.222.0.89 () {58 vars in 1460 bytes} [Wed Oct 27 14:55:20 2021] PUT /identity/v3/projects/f79f19c59cfd43c48871b51d6aaf501f/users/fcbab075fd5b4a889c2002639ca9d60a/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 14:55:22.547001 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e28a4-ecb6-4955-8bb4-e691adc703c8 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:22.547592 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e28a4-ecb6-4955-8bb4-e691adc703c8 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:22.547592 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0e28a4-ecb6-4955-8bb4-e691adc703c8 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:22.549211 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 596/1191] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:55:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:55:22.555014 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf530ce-a400-42b9-826f-9a16c853fe5a None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:22.555419 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf530ce-a400-42b9-826f-9a16c853fe5a None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:22.555607 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf530ce-a400-42b9-826f-9a16c853fe5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:22.577469 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-baf530ce-a400-42b9-826f-9a16c853fe5a None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:55:22.578587 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-baf530ce-a400-42b9-826f-9a16c853fe5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:55:22.639719 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 596/1192] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:55:22 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:55:22.663225 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e28a4-ecb6-4955-8bb4-e691adc703c8 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:22.674551 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0e28a4-ecb6-4955-8bb4-e691adc703c8 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:22.678465 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b2d4c-eae9-4770-ab49-ff3423e0127b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:22.679164 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b2d4c-eae9-4770-ab49-ff3423e0127b admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:22.679464 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b2d4c-eae9-4770-ab49-ff3423e0127b admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:22.679744 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b2d4c-eae9-4770-ab49-ff3423e0127b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:22.690411 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b2d4c-eae9-4770-ab49-ff3423e0127b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:401}} Oct 27 14:55:22.696531 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-377b2d4c-eae9-4770-ab49-ff3423e0127b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 14:55:22.697566 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 597/1193] 10.222.0.89 () {56 vars in 1117 bytes} [Wed Oct 27 14:55:22 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:55:22.703157 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf530ce-a400-42b9-826f-9a16c853fe5a None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:22.712115 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf530ce-a400-42b9-826f-9a16c853fe5a None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:22.716148 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d165e-f932-4ced-97c1-d1ca943f2c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:22.716730 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d165e-f932-4ced-97c1-d1ca943f2c81 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:22.717012 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d165e-f932-4ced-97c1-d1ca943f2c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:22.717287 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d165e-f932-4ced-97c1-d1ca943f2c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:22.717986 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d165e-f932-4ced-97c1-d1ca943f2c81 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:22.718278 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d165e-f932-4ced-97c1-d1ca943f2c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:22.743739 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8d165e-f932-4ced-97c1-d1ca943f2c81 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:22.752090 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 597/1194] 10.222.0.89 () {56 vars in 1120 bytes} [Wed Oct 27 14:55:22 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:22.757212 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b2d4c-eae9-4770-ab49-ff3423e0127b admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:22.766485 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b2d4c-eae9-4770-ab49-ff3423e0127b admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:22.770491 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4fc0a-5a82-4110-bb6e-154397efbd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:22.771170 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4fc0a-5a82-4110-bb6e-154397efbd90 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:22.771996 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4fc0a-5a82-4110-bb6e-154397efbd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:22.772269 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4fc0a-5a82-4110-bb6e-154397efbd90 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:22.783241 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4fc0a-5a82-4110-bb6e-154397efbd90 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:22.808720 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4fc0a-5a82-4110-bb6e-154397efbd90 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:22.825305 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-e8a4fc0a-5a82-4110-bb6e-154397efbd90 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:55:22.826326 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 598/1195] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:55:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:55:22.831850 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d165e-f932-4ced-97c1-d1ca943f2c81 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:22.841353 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d165e-f932-4ced-97c1-d1ca943f2c81 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:22.845462 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d584d3f-eb12-4928-a940-ea43e32f3661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:22.846037 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d584d3f-eb12-4928-a940-ea43e32f3661 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:22.846324 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d584d3f-eb12-4928-a940-ea43e32f3661 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:22.846601 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d584d3f-eb12-4928-a940-ea43e32f3661 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:22.847278 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d584d3f-eb12-4928-a940-ea43e32f3661 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:22.847613 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d584d3f-eb12-4928-a940-ea43e32f3661 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:22.872937 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d584d3f-eb12-4928-a940-ea43e32f3661 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:22.885352 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 598/1196] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:55:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:22.890433 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4fc0a-5a82-4110-bb6e-154397efbd90 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:22.899776 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4fc0a-5a82-4110-bb6e-154397efbd90 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:22.903817 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635af8e-9bda-4633-ad1c-ff0cffe9a17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:22.904506 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635af8e-9bda-4633-ad1c-ff0cffe9a17d admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:22.904787 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635af8e-9bda-4633-ad1c-ff0cffe9a17d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:22.905061 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635af8e-9bda-4633-ad1c-ff0cffe9a17d admin admin] PATH_INFO: `/v3/users/placement` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:22.918136 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b635af8e-9bda-4633-ad1c-ff0cffe9a17d admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:22.943074 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b635af8e-9bda-4633-ad1c-ff0cffe9a17d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:22.960617 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-b635af8e-9bda-4633-ad1c-ff0cffe9a17d admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 14:55:22.961625 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 599/1197] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:55:22 2021] GET /identity/v3/users/placement => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 14:55:22.966985 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d584d3f-eb12-4928-a940-ea43e32f3661 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:22.976530 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d584d3f-eb12-4928-a940-ea43e32f3661 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:22.980568 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416251c-7073-4473-a78c-28343ab84222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:22.981149 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416251c-7073-4473-a78c-28343ab84222 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:22.981440 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416251c-7073-4473-a78c-28343ab84222 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:22.981722 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416251c-7073-4473-a78c-28343ab84222 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:22.982500 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416251c-7073-4473-a78c-28343ab84222 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:22.982815 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416251c-7073-4473-a78c-28343ab84222 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:23.008313 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416251c-7073-4473-a78c-28343ab84222 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:23.036802 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 599/1198] 10.222.0.89 () {56 vars in 1164 bytes} [Wed Oct 27 14:55:22 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:23.042159 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635af8e-9bda-4633-ad1c-ff0cffe9a17d admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:23.051060 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635af8e-9bda-4633-ad1c-ff0cffe9a17d admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:23.055043 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3841412-b5f6-4d71-b772-8a14c4ce01ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:23.055632 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3841412-b5f6-4d71-b772-8a14c4ce01ff admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:23.055917 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3841412-b5f6-4d71-b772-8a14c4ce01ff admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:23.056191 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3841412-b5f6-4d71-b772-8a14c4ce01ff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:23.063592 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3841412-b5f6-4d71-b772-8a14c4ce01ff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:23.089341 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3841412-b5f6-4d71-b772-8a14c4ce01ff admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:23.099584 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 600/1199] 10.222.0.89 () {58 vars in 1324 bytes} [Wed Oct 27 14:55:23 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:55:23.104899 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416251c-7073-4473-a78c-28343ab84222 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:23.113872 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416251c-7073-4473-a78c-28343ab84222 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:23.117952 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562cc5e4-d28a-45b3-8109-17d23ab06db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:23.118646 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cc5e4-d28a-45b3-8109-17d23ab06db4 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:23.118923 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cc5e4-d28a-45b3-8109-17d23ab06db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:23.119205 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cc5e4-d28a-45b3-8109-17d23ab06db4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:23.130498 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562cc5e4-d28a-45b3-8109-17d23ab06db4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:23.156500 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562cc5e4-d28a-45b3-8109-17d23ab06db4 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:23.172914 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-562cc5e4-d28a-45b3-8109-17d23ab06db4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 14:55:23.173942 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 600/1200] 10.222.0.89 () {56 vars in 1129 bytes} [Wed Oct 27 14:55:23 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 14:55:23.179167 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3841412-b5f6-4d71-b772-8a14c4ce01ff admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:23.187316 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3841412-b5f6-4d71-b772-8a14c4ce01ff admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:23.191350 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38abce-4dee-43b3-999c-fc21a8c00782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:23.191947 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38abce-4dee-43b3-999c-fc21a8c00782 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:23.192229 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38abce-4dee-43b3-999c-fc21a8c00782 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:23.192500 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e38abce-4dee-43b3-999c-fc21a8c00782 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:23.193644 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38abce-4dee-43b3-999c-fc21a8c00782 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:23.193953 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38abce-4dee-43b3-999c-fc21a8c00782 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:23.219859 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e38abce-4dee-43b3-999c-fc21a8c00782 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:23.232313 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 601/1201] 10.222.0.89 () {56 vars in 1130 bytes} [Wed Oct 27 14:55:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:23.237743 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562cc5e4-d28a-45b3-8109-17d23ab06db4 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:23.246902 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562cc5e4-d28a-45b3-8109-17d23ab06db4 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:23.251006 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffadf07-491c-4035-8e24-b5d1718fe2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:23.251748 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffadf07-491c-4035-8e24-b5d1718fe2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:23.252037 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffadf07-491c-4035-8e24-b5d1718fe2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:23.252316 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffadf07-491c-4035-8e24-b5d1718fe2b8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:23.261749 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffadf07-491c-4035-8e24-b5d1718fe2b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:23.287720 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffadf07-491c-4035-8e24-b5d1718fe2b8 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:23.300909 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING keystone.server.flask.application [None req-4ffadf07-491c-4035-8e24-b5d1718fe2b8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 14:55:23.301958 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 601/1202] 10.222.0.89 () {56 vars in 1132 bytes} [Wed Oct 27 14:55:23 2021] GET /identity/v3/projects/service => generated 88 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:55:23.307481 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38abce-4dee-43b3-999c-fc21a8c00782 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:23.316557 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e38abce-4dee-43b3-999c-fc21a8c00782 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:23.321023 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cad10-95e0-469c-9285-5cbb886a5056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:23.321596 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cad10-95e0-469c-9285-5cbb886a5056 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:23.321875 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cad10-95e0-469c-9285-5cbb886a5056 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:23.322145 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cad10-95e0-469c-9285-5cbb886a5056 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:23.322874 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04cad10-95e0-469c-9285-5cbb886a5056 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:23.323168 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04cad10-95e0-469c-9285-5cbb886a5056 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:23.348526 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04cad10-95e0-469c-9285-5cbb886a5056 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:23.361005 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 602/1203] 10.222.0.89 () {56 vars in 1169 bytes} [Wed Oct 27 14:55:23 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:23.366609 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffadf07-491c-4035-8e24-b5d1718fe2b8 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:23.375653 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffadf07-491c-4035-8e24-b5d1718fe2b8 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:23.379685 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585b3dc-dd8b-43b7-9af8-a1ab4e801e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:23.380249 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585b3dc-dd8b-43b7-9af8-a1ab4e801e0e admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:23.380533 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585b3dc-dd8b-43b7-9af8-a1ab4e801e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:23.381311 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585b3dc-dd8b-43b7-9af8-a1ab4e801e0e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:23.382076 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585b3dc-dd8b-43b7-9af8-a1ab4e801e0e admin admin] RBAC: Adding query filter params (role.id=c243fbeb99ae4f51910f72ddc1773778, scope.project.id=f79f19c59cfd43c48871b51d6aaf501f, user.id=fcbab075fd5b4a889c2002639ca9d60a) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:23.382375 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585b3dc-dd8b-43b7-9af8-a1ab4e801e0e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:23.408284 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585b3dc-dd8b-43b7-9af8-a1ab4e801e0e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:23.414548 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 602/1204] 10.222.0.89 () {56 vars in 1395 bytes} [Wed Oct 27 14:55:23 2021] GET /identity/v3/role_assignments?user.id=fcbab075fd5b4a889c2002639ca9d60a&scope.project.id=f79f19c59cfd43c48871b51d6aaf501f&role.id=c243fbeb99ae4f51910f72ddc1773778 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:25.398010 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700ffb1-098d-4f38-841a-d902b88417be None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:25.398533 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700ffb1-098d-4f38-841a-d902b88417be None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:25.398533 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700ffb1-098d-4f38-841a-d902b88417be None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:25.400507 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 603/1205] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:55:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:55:25.405948 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8303e82-67f4-43e8-be8f-b72c27d9ea59 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:25.406359 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8303e82-67f4-43e8-be8f-b72c27d9ea59 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:25.406516 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8303e82-67f4-43e8-be8f-b72c27d9ea59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:25.431369 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-a8303e82-67f4-43e8-be8f-b72c27d9ea59 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:55:25.432534 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-a8303e82-67f4-43e8-be8f-b72c27d9ea59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:55:25.439166 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 603/1206] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:55:25 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:55:25.460811 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700ffb1-098d-4f38-841a-d902b88417be None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:25.472380 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700ffb1-098d-4f38-841a-d902b88417be None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:25.476826 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a535e7-c8c1-4c32-97ca-f27f5fe1ed1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:25.477532 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a535e7-c8c1-4c32-97ca-f27f5fe1ed1f admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:25.477820 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a535e7-c8c1-4c32-97ca-f27f5fe1ed1f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:25.478100 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a535e7-c8c1-4c32-97ca-f27f5fe1ed1f admin admin] PATH_INFO: `/v3/services/placement` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:25.478723 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a535e7-c8c1-4c32-97ca-f27f5fe1ed1f admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:25.503971 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a535e7-c8c1-4c32-97ca-f27f5fe1ed1f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:25.514220 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-56a535e7-c8c1-4c32-97ca-f27f5fe1ed1f admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 14:55:25.515230 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 604/1207] 10.222.0.89 () {56 vars in 1138 bytes} [Wed Oct 27 14:55:25 2021] GET /identity/v3/services/placement => generated 90 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:55:25.520682 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8303e82-67f4-43e8-be8f-b72c27d9ea59 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:25.528954 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8303e82-67f4-43e8-be8f-b72c27d9ea59 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:25.533249 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dd3c24-0da5-4bc4-8982-bc1fd917d5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:25.533824 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd3c24-0da5-4bc4-8982-bc1fd917d5f8 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:25.534110 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd3c24-0da5-4bc4-8982-bc1fd917d5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:25.534389 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dd3c24-0da5-4bc4-8982-bc1fd917d5f8 admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:25.535051 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd3c24-0da5-4bc4-8982-bc1fd917d5f8 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:25.535344 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd3c24-0da5-4bc4-8982-bc1fd917d5f8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:25.561062 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dd3c24-0da5-4bc4-8982-bc1fd917d5f8 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:25.565732 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 604/1208] 10.222.0.89 () {56 vars in 1137 bytes} [Wed Oct 27 14:55:25 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:55:25.570959 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a535e7-c8c1-4c32-97ca-f27f5fe1ed1f admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:25.579898 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a535e7-c8c1-4c32-97ca-f27f5fe1ed1f admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:25.583898 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0e33b-1524-4f8e-9b45-547e9cb7b5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:25.584454 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0e33b-1524-4f8e-9b45-547e9cb7b5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:25.584736 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0e33b-1524-4f8e-9b45-547e9cb7b5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:25.585009 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0e33b-1524-4f8e-9b45-547e9cb7b5f4 admin admin] PATH_INFO: `/v3/services` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:25.585660 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0e33b-1524-4f8e-9b45-547e9cb7b5f4 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:25.585951 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0e33b-1524-4f8e-9b45-547e9cb7b5f4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:25.610974 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0e33b-1524-4f8e-9b45-547e9cb7b5f4 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:25.615052 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 605/1209] 10.222.0.89 () {56 vars in 1137 bytes} [Wed Oct 27 14:55:25 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:55:27.557375 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d3400-a16d-4d57-8388-a6bf6d49419f None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:27.557888 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d3400-a16d-4d57-8388-a6bf6d49419f None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:27.557888 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d3400-a16d-4d57-8388-a6bf6d49419f None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:27.559525 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 605/1210] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:55:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:55:27.564663 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccacf298-5c98-4b45-982c-ab746d470f09 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:27.565098 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccacf298-5c98-4b45-982c-ab746d470f09 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:27.565226 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccacf298-5c98-4b45-982c-ab746d470f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:27.587943 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-ccacf298-5c98-4b45-982c-ab746d470f09 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:55:27.589054 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-ccacf298-5c98-4b45-982c-ab746d470f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:55:27.595720 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 606/1211] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:55:27 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:55:27.617062 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d3400-a16d-4d57-8388-a6bf6d49419f None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:27.628409 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d3400-a16d-4d57-8388-a6bf6d49419f None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:27.632856 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d78071-cc8d-4106-bff7-db2811c60e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:27.633427 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d78071-cc8d-4106-bff7-db2811c60e6f admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:27.633713 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d78071-cc8d-4106-bff7-db2811c60e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:27.633990 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d78071-cc8d-4106-bff7-db2811c60e6f admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:27.634664 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d78071-cc8d-4106-bff7-db2811c60e6f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:27.660137 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d78071-cc8d-4106-bff7-db2811c60e6f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:27.672521 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 606/1212] 10.222.0.89 () {60 vars in 1162 bytes} [Wed Oct 27 14:55:27 2021] POST /identity/v3/services => generated 246 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:55:29.605103 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e79a1b-c264-47bc-92b0-ab08fc391bb3 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:29.605599 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e79a1b-c264-47bc-92b0-ab08fc391bb3 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:29.605599 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e79a1b-c264-47bc-92b0-ab08fc391bb3 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:29.607219 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 607/1213] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:55:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:55:29.612248 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d600a-79e6-401e-aff5-9ef4cc4babaf None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:29.612664 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d600a-79e6-401e-aff5-9ef4cc4babaf None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:29.612809 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d600a-79e6-401e-aff5-9ef4cc4babaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:29.635708 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-8e8d600a-79e6-401e-aff5-9ef4cc4babaf None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:55:29.636838 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-8e8d600a-79e6-401e-aff5-9ef4cc4babaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:55:29.654403 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 607/1214] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:55:29 2021] POST /identity/v3/auth/tokens => generated 3516 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:55:29.676011 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e79a1b-c264-47bc-92b0-ab08fc391bb3 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:29.687835 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e79a1b-c264-47bc-92b0-ab08fc391bb3 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:29.691778 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485939fb-a26c-4f28-9479-000d258259c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:29.692476 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485939fb-a26c-4f28-9479-000d258259c0 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:29.692758 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485939fb-a26c-4f28-9479-000d258259c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:29.693033 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485939fb-a26c-4f28-9479-000d258259c0 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:29.694208 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485939fb-a26c-4f28-9479-000d258259c0 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:29.718809 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485939fb-a26c-4f28-9479-000d258259c0 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:29.728795 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-485939fb-a26c-4f28-9479-000d258259c0 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 14:55:29.729807 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 608/1215] 10.222.0.89 () {56 vars in 1138 bytes} [Wed Oct 27 14:55:29 2021] GET /identity/v3/services/placement => generated 90 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:55:29.735392 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d600a-79e6-401e-aff5-9ef4cc4babaf None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:29.744277 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d600a-79e6-401e-aff5-9ef4cc4babaf None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:29.748297 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0a690-5ad4-469b-a1bd-5ecf72399c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:29.748876 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0a690-5ad4-469b-a1bd-5ecf72399c62 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:29.749160 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0a690-5ad4-469b-a1bd-5ecf72399c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:29.749437 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0a690-5ad4-469b-a1bd-5ecf72399c62 admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:29.750101 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0a690-5ad4-469b-a1bd-5ecf72399c62 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:29.750397 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0a690-5ad4-469b-a1bd-5ecf72399c62 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:29.775801 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0a690-5ad4-469b-a1bd-5ecf72399c62 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:29.780769 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 608/1216] 10.222.0.89 () {56 vars in 1137 bytes} [Wed Oct 27 14:55:29 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:29.786484 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485939fb-a26c-4f28-9479-000d258259c0 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:29.795741 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485939fb-a26c-4f28-9479-000d258259c0 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:29.799695 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04b00b-f0e9-44e7-b215-3cfdb590fed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:29.800242 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04b00b-f0e9-44e7-b215-3cfdb590fed0 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:29.800523 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04b00b-f0e9-44e7-b215-3cfdb590fed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:29.800796 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04b00b-f0e9-44e7-b215-3cfdb590fed0 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:29.801518 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04b00b-f0e9-44e7-b215-3cfdb590fed0 admin admin] RBAC: Adding query filter params (interface=public, service_id=0ef05420a8414ffb9e85df53c54086d1, region_id=RegionOne) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:29.801812 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04b00b-f0e9-44e7-b215-3cfdb590fed0 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:29.826791 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04b00b-f0e9-44e7-b215-3cfdb590fed0 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:29.831854 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 609/1217] 10.222.0.89 () {56 vars in 1272 bytes} [Wed Oct 27 14:55:29 2021] GET /identity/v3/endpoints?service_id=0ef05420a8414ffb9e85df53c54086d1&interface=public®ion_id=RegionOne => generated 194 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:55:29.836782 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0a690-5ad4-469b-a1bd-5ecf72399c62 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:29.845613 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0a690-5ad4-469b-a1bd-5ecf72399c62 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:29.850151 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d58266-df0c-42d9-9480-79262a67f54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:29.850704 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d58266-df0c-42d9-9480-79262a67f54a admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:29.850990 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d58266-df0c-42d9-9480-79262a67f54a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:29.851267 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d58266-df0c-42d9-9480-79262a67f54a admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:29.851936 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d58266-df0c-42d9-9480-79262a67f54a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:29.877139 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d58266-df0c-42d9-9480-79262a67f54a admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:29.883965 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 609/1218] 10.222.0.89 () {56 vars in 1108 bytes} [Wed Oct 27 14:55:29 2021] GET /identity/v3/services => generated 2430 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 14:55:31.827115 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc010d9-bc83-41c8-8324-ffe96468e76f None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:31.827675 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc010d9-bc83-41c8-8324-ffe96468e76f None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:31.827789 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc010d9-bc83-41c8-8324-ffe96468e76f None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:31.829346 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 610/1219] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:55:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:55:31.834887 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130671d-b287-4400-92cd-78e36d84b0c8 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:31.835309 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130671d-b287-4400-92cd-78e36d84b0c8 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:31.835455 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130671d-b287-4400-92cd-78e36d84b0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:31.857933 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-a130671d-b287-4400-92cd-78e36d84b0c8 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:55:31.859060 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-a130671d-b287-4400-92cd-78e36d84b0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:55:31.865850 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 610/1220] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:55:31 2021] POST /identity/v3/auth/tokens => generated 3516 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:55:31.887113 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc010d9-bc83-41c8-8324-ffe96468e76f None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:31.898943 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc010d9-bc83-41c8-8324-ffe96468e76f None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:31.903023 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc289501-4ee1-4e78-bf0a-b1f2ebd1d74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:31.903751 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc289501-4ee1-4e78-bf0a-b1f2ebd1d74b admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:31.904037 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc289501-4ee1-4e78-bf0a-b1f2ebd1d74b admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:31.904311 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc289501-4ee1-4e78-bf0a-b1f2ebd1d74b admin admin] PATH_INFO: `/v3/services/placement` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:31.904929 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc289501-4ee1-4e78-bf0a-b1f2ebd1d74b admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:31.930547 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc289501-4ee1-4e78-bf0a-b1f2ebd1d74b admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:31.940673 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING keystone.server.flask.application [None req-fc289501-4ee1-4e78-bf0a-b1f2ebd1d74b admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 14:55:31.941704 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 611/1221] 10.222.0.89 () {56 vars in 1138 bytes} [Wed Oct 27 14:55:31 2021] GET /identity/v3/services/placement => generated 90 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 14:55:31.947172 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130671d-b287-4400-92cd-78e36d84b0c8 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:31.955497 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130671d-b287-4400-92cd-78e36d84b0c8 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:31.960034 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a90c6-f2b1-4947-beff-393273c2f957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:31.960612 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a90c6-f2b1-4947-beff-393273c2f957 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:31.960900 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a90c6-f2b1-4947-beff-393273c2f957 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:31.961176 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a90c6-f2b1-4947-beff-393273c2f957 admin admin] PATH_INFO: `/v3/services` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:31.961841 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a90c6-f2b1-4947-beff-393273c2f957 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:55:31.962137 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a90c6-f2b1-4947-beff-393273c2f957 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:31.987236 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a90c6-f2b1-4947-beff-393273c2f957 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:31.992253 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 611/1222] 10.222.0.89 () {56 vars in 1137 bytes} [Wed Oct 27 14:55:31 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:55:31.997388 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc289501-4ee1-4e78-bf0a-b1f2ebd1d74b admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:55:32.007832 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc289501-4ee1-4e78-bf0a-b1f2ebd1d74b admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:55:32.011922 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04174f39-b96d-4174-a19f-2424742ddb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:55:32.012477 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04174f39-b96d-4174-a19f-2424742ddb35 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:55:32.012795 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04174f39-b96d-4174-a19f-2424742ddb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:55:32.013079 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04174f39-b96d-4174-a19f-2424742ddb35 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:55:32.013761 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04174f39-b96d-4174-a19f-2424742ddb35 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:55:32.039357 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04174f39-b96d-4174-a19f-2424742ddb35 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:55:32.056585 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 612/1223] 10.222.0.89 () {60 vars in 1165 bytes} [Wed Oct 27 14:55:31 2021] POST /identity/v3/endpoints => generated 331 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 14:57:09.649658 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60972295-7277-4f78-9e07-cd4fe1728f19 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:09.650210 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60972295-7277-4f78-9e07-cd4fe1728f19 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:09.650210 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60972295-7277-4f78-9e07-cd4fe1728f19 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:09.651946 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 612/1224] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:57:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:57:09.657062 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc6f25-0a8a-4c16-90b4-e7f9ab0be03e None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:09.658089 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc6f25-0a8a-4c16-90b4-e7f9ab0be03e None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:09.658524 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc6f25-0a8a-4c16-90b4-e7f9ab0be03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:09.746219 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-8edc6f25-0a8a-4c16-90b4-e7f9ab0be03e None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:57:09.747373 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-8edc6f25-0a8a-4c16-90b4-e7f9ab0be03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:09.856149 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 613/1225] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:57:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:57:09.878814 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60972295-7277-4f78-9e07-cd4fe1728f19 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:57:09.880632 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-60972295-7277-4f78-9e07-cd4fe1728f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:10.032479 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60972295-7277-4f78-9e07-cd4fe1728f19 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:57:10.133635 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cc4de-6f73-47af-8579-f8ab913228fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:57:10.134230 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cc4de-6f73-47af-8579-f8ab913228fe admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:10.134515 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cc4de-6f73-47af-8579-f8ab913228fe admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:10.134793 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cc4de-6f73-47af-8579-f8ab913228fe admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:10.135507 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cc4de-6f73-47af-8579-f8ab913228fe admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:57:10.160812 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cc4de-6f73-47af-8579-f8ab913228fe admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:57:10.175426 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 613/1226] 10.222.0.89 () {56 vars in 1108 bytes} [Wed Oct 27 14:57:09 2021] GET /identity/v3/projects => generated 2553 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:57:12.206402 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7576bd0-ad72-4b62-a8eb-314c63bc9d0a None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:12.206973 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7576bd0-ad72-4b62-a8eb-314c63bc9d0a None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:12.206973 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7576bd0-ad72-4b62-a8eb-314c63bc9d0a None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:12.208807 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 614/1227] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:57:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:57:12.213673 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81439ad1-eaa1-4432-9724-9e42a74b0804 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:12.214078 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81439ad1-eaa1-4432-9724-9e42a74b0804 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:12.214236 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81439ad1-eaa1-4432-9724-9e42a74b0804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:12.299734 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-81439ad1-eaa1-4432-9724-9e42a74b0804 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:57:12.300854 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-81439ad1-eaa1-4432-9724-9e42a74b0804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:12.403754 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 614/1228] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:57:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:57:12.451163 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bfede-07f4-46bc-ae32-796de70f333b None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:12.451480 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bfede-07f4-46bc-ae32-796de70f333b None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:12.451769 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542bfede-07f4-46bc-ae32-796de70f333b None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:12.453428 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 615/1229] 10.222.0.89 () {54 vars in 963 bytes} [Wed Oct 27 14:57:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:57:12.459050 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637e2c5-1208-4603-a046-c95f9f7eef23 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:12.459288 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637e2c5-1208-4603-a046-c95f9f7eef23 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:12.459611 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637e2c5-1208-4603-a046-c95f9f7eef23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:12.553126 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-6637e2c5-1208-4603-a046-c95f9f7eef23 None None] MFA Rules not processed for user `ab1b41f8980348fc878e492e26078e33`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:57:12.554258 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-6637e2c5-1208-4603-a046-c95f9f7eef23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:12.637634 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 615/1230] 10.222.0.89 () {58 vars in 1060 bytes} [Wed Oct 27 14:57:12 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:57:12.646729 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542bfede-07f4-46bc-ae32-796de70f333b None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:57:12.648179 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-542bfede-07f4-46bc-ae32-796de70f333b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:12.764029 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542bfede-07f4-46bc-ae32-796de70f333b None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:57:12.844721 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351030f3-2d8f-4aad-91a5-bce4de52ad9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:57:12.845293 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351030f3-2d8f-4aad-91a5-bce4de52ad9e service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:12.845578 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351030f3-2d8f-4aad-91a5-bce4de52ad9e service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:12.845853 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351030f3-2d8f-4aad-91a5-bce4de52ad9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:12.847352 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-351030f3-2d8f-4aad-91a5-bce4de52ad9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:12.965816 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351030f3-2d8f-4aad-91a5-bce4de52ad9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:57:12.991314 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351030f3-2d8f-4aad-91a5-bce4de52ad9e service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:57:13.012383 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 616/1231] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:57:12 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:57:15.228406 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a90dbb-0c1e-43d1-9d06-82e98533d63e None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:15.228928 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a90dbb-0c1e-43d1-9d06-82e98533d63e None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:15.229019 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a90dbb-0c1e-43d1-9d06-82e98533d63e None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:15.230722 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 616/1232] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:57:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:57:15.236444 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd822471-c795-4c88-ac1c-734a95186ec7 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:15.236878 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd822471-c795-4c88-ac1c-734a95186ec7 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:15.236998 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd822471-c795-4c88-ac1c-734a95186ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:15.320603 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-fd822471-c795-4c88-ac1c-734a95186ec7 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:57:15.321741 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-fd822471-c795-4c88-ac1c-734a95186ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:15.423228 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 617/1233] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:57:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:57:15.461235 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a90dbb-0c1e-43d1-9d06-82e98533d63e None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:57:15.462718 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-75a90dbb-0c1e-43d1-9d06-82e98533d63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:15.577691 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a90dbb-0c1e-43d1-9d06-82e98533d63e None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:57:15.656848 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2dd59c-a123-4423-8a7b-a97745fcf742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:57:15.657411 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dd59c-a123-4423-8a7b-a97745fcf742 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:15.657691 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dd59c-a123-4423-8a7b-a97745fcf742 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:15.658228 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dd59c-a123-4423-8a7b-a97745fcf742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:15.659731 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-7b2dd59c-a123-4423-8a7b-a97745fcf742 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:15.780620 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2dd59c-a123-4423-8a7b-a97745fcf742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:57:15.806565 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2dd59c-a123-4423-8a7b-a97745fcf742 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:57:15.832966 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 617/1234] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:57:15 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:57:18.026264 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bd21c-bf8e-4aaf-9d45-4a24a9aa4768 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:18.026862 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bd21c-bf8e-4aaf-9d45-4a24a9aa4768 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:18.026862 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931bd21c-bf8e-4aaf-9d45-4a24a9aa4768 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:18.028633 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 618/1235] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:57:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:57:18.034564 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670c422-b9d9-466c-9c69-52c9a0993547 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:18.034989 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670c422-b9d9-466c-9c69-52c9a0993547 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:18.035120 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670c422-b9d9-466c-9c69-52c9a0993547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:18.118778 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-a670c422-b9d9-466c-9c69-52c9a0993547 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:57:18.119951 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-a670c422-b9d9-466c-9c69-52c9a0993547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:18.222399 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 618/1236] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:57:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:57:18.256670 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bd21c-bf8e-4aaf-9d45-4a24a9aa4768 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:57:18.258097 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-931bd21c-bf8e-4aaf-9d45-4a24a9aa4768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:18.395472 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931bd21c-bf8e-4aaf-9d45-4a24a9aa4768 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:57:18.494504 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd945a9-03ed-4fe2-a9c7-ec98da768949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:57:18.495282 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd945a9-03ed-4fe2-a9c7-ec98da768949 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:18.495613 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd945a9-03ed-4fe2-a9c7-ec98da768949 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:18.495888 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd945a9-03ed-4fe2-a9c7-ec98da768949 admin admin] PATH_INFO: `/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:18.506296 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd945a9-03ed-4fe2-a9c7-ec98da768949 admin admin] RBAC: Authorizing `identity:get_project(project_id=055ce8b96eed43db9c8ea4bb1307f9ad)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:57:18.532505 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd945a9-03ed-4fe2-a9c7-ec98da768949 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:57:18.534297 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 619/1237] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:57:18 2021] GET /identity/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:57:18.546410 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670c422-b9d9-466c-9c69-52c9a0993547 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:57:18.547609 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-a670c422-b9d9-466c-9c69-52c9a0993547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:18.650958 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670c422-b9d9-466c-9c69-52c9a0993547 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:57:18.731460 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c77c8-40d7-48b3-8021-ab01e9fd1805 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:57:18.732057 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c77c8-40d7-48b3-8021-ab01e9fd1805 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:18.732345 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c77c8-40d7-48b3-8021-ab01e9fd1805 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:18.732624 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c77c8-40d7-48b3-8021-ab01e9fd1805 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:18.734158 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-580c77c8-40d7-48b3-8021-ab01e9fd1805 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:18.852956 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c77c8-40d7-48b3-8021-ab01e9fd1805 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:57:18.878028 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580c77c8-40d7-48b3-8021-ab01e9fd1805 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:57:18.897573 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 619/1238] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:57:18 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:57:21.436461 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fbcb3-9b01-4271-918f-7ac7a6a18646 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:21.437022 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fbcb3-9b01-4271-918f-7ac7a6a18646 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:21.437125 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fbcb3-9b01-4271-918f-7ac7a6a18646 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:21.438725 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 620/1239] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:57:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:57:21.443933 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0b05a-4d8b-4b07-b71f-362e625bb0d9 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:21.444370 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0b05a-4d8b-4b07-b71f-362e625bb0d9 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:21.444481 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0b05a-4d8b-4b07-b71f-362e625bb0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:21.529470 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-ece0b05a-4d8b-4b07-b71f-362e625bb0d9 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:57:21.530531 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-ece0b05a-4d8b-4b07-b71f-362e625bb0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:21.633724 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 620/1240] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:57:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:57:21.666874 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27fbcb3-9b01-4271-918f-7ac7a6a18646 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:57:21.668340 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-f27fbcb3-9b01-4271-918f-7ac7a6a18646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:21.805525 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27fbcb3-9b01-4271-918f-7ac7a6a18646 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:57:21.906339 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d451cd-162d-4010-841d-3857fd953362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:57:21.907108 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d451cd-162d-4010-841d-3857fd953362 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:21.907393 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d451cd-162d-4010-841d-3857fd953362 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:21.907698 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d451cd-162d-4010-841d-3857fd953362 admin admin] PATH_INFO: `/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:21.918196 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d451cd-162d-4010-841d-3857fd953362 admin admin] RBAC: Authorizing `identity:get_project(project_id=055ce8b96eed43db9c8ea4bb1307f9ad)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:57:21.943774 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d451cd-162d-4010-841d-3857fd953362 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:57:21.945279 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 621/1241] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:57:21 2021] GET /identity/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:57:21.957696 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0b05a-4d8b-4b07-b71f-362e625bb0d9 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:57:21.958844 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-ece0b05a-4d8b-4b07-b71f-362e625bb0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:22.059885 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0b05a-4d8b-4b07-b71f-362e625bb0d9 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:57:22.140336 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465acb73-5db9-4355-b8ca-d782fc357102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:57:22.140912 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465acb73-5db9-4355-b8ca-d782fc357102 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:22.141192 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465acb73-5db9-4355-b8ca-d782fc357102 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:22.141463 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465acb73-5db9-4355-b8ca-d782fc357102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:22.142965 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-465acb73-5db9-4355-b8ca-d782fc357102 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:22.272788 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465acb73-5db9-4355-b8ca-d782fc357102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:57:22.298228 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465acb73-5db9-4355-b8ca-d782fc357102 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:57:22.318306 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 621/1242] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:57:21 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:57:24.925881 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807890c-c6bc-4a94-92e6-5005cb7f718f None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:24.926433 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807890c-c6bc-4a94-92e6-5005cb7f718f None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:24.926433 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807890c-c6bc-4a94-92e6-5005cb7f718f None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:24.928109 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 622/1243] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:57:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:57:24.933206 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9079e9-6ce2-4ec5-89c4-113eea325bb4 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:24.933640 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9079e9-6ce2-4ec5-89c4-113eea325bb4 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:24.933898 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9079e9-6ce2-4ec5-89c4-113eea325bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:25.019736 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-5a9079e9-6ce2-4ec5-89c4-113eea325bb4 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:57:25.020822 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-5a9079e9-6ce2-4ec5-89c4-113eea325bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:25.129673 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 622/1244] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:57:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:57:25.180470 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e772236-d6b7-42a5-8ffa-8cb03ceb048c None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:25.180861 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e772236-d6b7-42a5-8ffa-8cb03ceb048c None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:25.181212 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e772236-d6b7-42a5-8ffa-8cb03ceb048c None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:25.182997 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 623/1245] 10.222.0.89 () {54 vars in 963 bytes} [Wed Oct 27 14:57:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:57:25.190295 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723f7ad-8cfe-4255-aff5-cdc4c90f1013 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:25.190589 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723f7ad-8cfe-4255-aff5-cdc4c90f1013 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:25.190868 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723f7ad-8cfe-4255-aff5-cdc4c90f1013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:25.295324 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-b723f7ad-8cfe-4255-aff5-cdc4c90f1013 None None] MFA Rules not processed for user `ab1b41f8980348fc878e492e26078e33`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:57:25.297062 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-b723f7ad-8cfe-4255-aff5-cdc4c90f1013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:25.382393 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 623/1246] 10.222.0.89 () {58 vars in 1060 bytes} [Wed Oct 27 14:57:25 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:57:25.391401 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e772236-d6b7-42a5-8ffa-8cb03ceb048c None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:57:25.392921 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-0e772236-d6b7-42a5-8ffa-8cb03ceb048c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:25.510748 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e772236-d6b7-42a5-8ffa-8cb03ceb048c None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:57:25.592290 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91026451-062e-435e-b8cf-d55134c01777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:57:25.592791 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91026451-062e-435e-b8cf-d55134c01777 service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:25.593078 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91026451-062e-435e-b8cf-d55134c01777 service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:25.593870 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91026451-062e-435e-b8cf-d55134c01777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:25.595385 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-91026451-062e-435e-b8cf-d55134c01777 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:25.714836 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91026451-062e-435e-b8cf-d55134c01777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:57:25.740571 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91026451-062e-435e-b8cf-d55134c01777 service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:57:25.761900 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 624/1247] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:57:25 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:57:28.040434 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2110f-836a-4fb0-9c7c-237652eb17e6 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:28.040879 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2110f-836a-4fb0-9c7c-237652eb17e6 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:28.040879 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2110f-836a-4fb0-9c7c-237652eb17e6 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:28.042615 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 624/1248] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:57:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:57:28.048790 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f0a87-de1b-42e7-9905-cadbe09bd596 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:28.049265 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f0a87-de1b-42e7-9905-cadbe09bd596 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:28.049369 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f0a87-de1b-42e7-9905-cadbe09bd596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:28.146726 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-af3f0a87-de1b-42e7-9905-cadbe09bd596 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:57:28.147947 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-af3f0a87-de1b-42e7-9905-cadbe09bd596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:28.256523 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 625/1249] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:57:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:57:28.293851 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2110f-836a-4fb0-9c7c-237652eb17e6 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:57:28.295305 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-69b2110f-836a-4fb0-9c7c-237652eb17e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:28.415136 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2110f-836a-4fb0-9c7c-237652eb17e6 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:57:28.499920 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaacb55-89f4-4da1-8105-65dfe290ce59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:57:28.500505 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaacb55-89f4-4da1-8105-65dfe290ce59 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:28.500792 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaacb55-89f4-4da1-8105-65dfe290ce59 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:28.501069 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaacb55-89f4-4da1-8105-65dfe290ce59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:28.502618 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-daaacb55-89f4-4da1-8105-65dfe290ce59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:28.622067 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaacb55-89f4-4da1-8105-65dfe290ce59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:57:28.646588 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaacb55-89f4-4da1-8105-65dfe290ce59 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:57:28.666563 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 625/1250] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:57:28 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:57:30.675757 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d34841-c5e8-4c5f-8aee-9255eeba7d3e None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:30.676296 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d34841-c5e8-4c5f-8aee-9255eeba7d3e None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:30.676393 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d34841-c5e8-4c5f-8aee-9255eeba7d3e None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:30.678002 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 626/1251] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:57:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:57:30.683129 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860d0a7-07bf-4ab7-85a9-2cf2f730f934 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:30.683574 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860d0a7-07bf-4ab7-85a9-2cf2f730f934 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:30.683721 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7860d0a7-07bf-4ab7-85a9-2cf2f730f934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:30.765910 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-7860d0a7-07bf-4ab7-85a9-2cf2f730f934 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:57:30.767027 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-7860d0a7-07bf-4ab7-85a9-2cf2f730f934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:30.948684 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 626/1252] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:57:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:57:30.980207 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d34841-c5e8-4c5f-8aee-9255eeba7d3e None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:57:30.981638 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-32d34841-c5e8-4c5f-8aee-9255eeba7d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:31.120293 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d34841-c5e8-4c5f-8aee-9255eeba7d3e None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:57:31.223974 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5f2a2-5f8a-476e-885f-65b3385fec36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:57:31.224677 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5f2a2-5f8a-476e-885f-65b3385fec36 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:31.224982 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5f2a2-5f8a-476e-885f-65b3385fec36 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:31.225242 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5f2a2-5f8a-476e-885f-65b3385fec36 admin admin] PATH_INFO: `/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:31.236710 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5f2a2-5f8a-476e-885f-65b3385fec36 admin admin] RBAC: Authorizing `identity:get_project(project_id=055ce8b96eed43db9c8ea4bb1307f9ad)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:57:31.263607 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5f2a2-5f8a-476e-885f-65b3385fec36 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:57:31.265976 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 627/1253] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:57:30 2021] GET /identity/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad => generated 298 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:57:31.277933 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860d0a7-07bf-4ab7-85a9-2cf2f730f934 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:57:31.279060 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-7860d0a7-07bf-4ab7-85a9-2cf2f730f934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:31.381087 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7860d0a7-07bf-4ab7-85a9-2cf2f730f934 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:57:31.461946 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159dc009-34a2-4d87-a164-984dd5807216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:57:31.462523 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159dc009-34a2-4d87-a164-984dd5807216 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:31.462811 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159dc009-34a2-4d87-a164-984dd5807216 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:31.463089 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159dc009-34a2-4d87-a164-984dd5807216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:31.464624 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-159dc009-34a2-4d87-a164-984dd5807216 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:31.583812 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159dc009-34a2-4d87-a164-984dd5807216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:57:31.612376 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159dc009-34a2-4d87-a164-984dd5807216 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:57:31.633620 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 627/1254] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:57:31 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:57:33.795775 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c578a-e704-4885-b9ab-0a32d9eba2c8 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:33.796586 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c578a-e704-4885-b9ab-0a32d9eba2c8 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:33.796586 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c578a-e704-4885-b9ab-0a32d9eba2c8 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:33.798059 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 628/1255] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:57:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:57:33.803256 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c262f4-cbcc-4b54-8392-e12e17822e21 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:33.803689 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c262f4-cbcc-4b54-8392-e12e17822e21 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:33.803859 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c262f4-cbcc-4b54-8392-e12e17822e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:33.887536 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-c3c262f4-cbcc-4b54-8392-e12e17822e21 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:57:33.888678 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-c3c262f4-cbcc-4b54-8392-e12e17822e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:33.992135 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 628/1256] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:57:33 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:57:34.027904 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c578a-e704-4885-b9ab-0a32d9eba2c8 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:57:34.029344 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-561c578a-e704-4885-b9ab-0a32d9eba2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:34.146327 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c578a-e704-4885-b9ab-0a32d9eba2c8 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:57:34.226829 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcce0c8-c508-444a-9217-37f60d9aa0d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:57:34.227407 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcce0c8-c508-444a-9217-37f60d9aa0d1 service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:34.227728 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcce0c8-c508-444a-9217-37f60d9aa0d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:34.228004 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcce0c8-c508-444a-9217-37f60d9aa0d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:34.229516 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-0dcce0c8-c508-444a-9217-37f60d9aa0d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:34.352895 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcce0c8-c508-444a-9217-37f60d9aa0d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:57:34.378646 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcce0c8-c508-444a-9217-37f60d9aa0d1 service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:57:34.397977 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 629/1257] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:57:34 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:57:36.395080 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc3898-fb9f-4b3d-82f9-6d852280bb72 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:36.395661 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc3898-fb9f-4b3d-82f9-6d852280bb72 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:36.395756 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc3898-fb9f-4b3d-82f9-6d852280bb72 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:36.397371 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 629/1258] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:57:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:57:36.402471 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe507a7-f82c-43ae-88c1-eda50b52ca09 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:36.402854 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe507a7-f82c-43ae-88c1-eda50b52ca09 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:36.403025 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe507a7-f82c-43ae-88c1-eda50b52ca09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:36.486703 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-1fe507a7-f82c-43ae-88c1-eda50b52ca09 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:57:36.487928 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-1fe507a7-f82c-43ae-88c1-eda50b52ca09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:36.595071 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 630/1259] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:57:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:57:36.634721 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc3898-fb9f-4b3d-82f9-6d852280bb72 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:57:36.636202 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-aefc3898-fb9f-4b3d-82f9-6d852280bb72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:36.753888 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc3898-fb9f-4b3d-82f9-6d852280bb72 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:57:36.834966 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca0914-726f-46c6-838d-d6b66b9b87f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:57:36.835567 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca0914-726f-46c6-838d-d6b66b9b87f0 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:36.835856 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca0914-726f-46c6-838d-d6b66b9b87f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:36.836136 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca0914-726f-46c6-838d-d6b66b9b87f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:36.837650 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-41ca0914-726f-46c6-838d-d6b66b9b87f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:36.956705 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca0914-726f-46c6-838d-d6b66b9b87f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:57:36.981496 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca0914-726f-46c6-838d-d6b66b9b87f0 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:57:37.001453 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 630/1260] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:57:36 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:57:39.559939 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15600d73-8d7e-483b-9bdc-beb8a8b5937d None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:39.560489 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15600d73-8d7e-483b-9bdc-beb8a8b5937d None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:39.560489 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15600d73-8d7e-483b-9bdc-beb8a8b5937d None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:39.562772 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 631/1261] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:57:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:57:39.568009 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37466d-cb43-4bf6-911d-d44e21079b15 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:39.568396 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37466d-cb43-4bf6-911d-d44e21079b15 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:39.568566 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37466d-cb43-4bf6-911d-d44e21079b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:39.652967 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-5f37466d-cb43-4bf6-911d-d44e21079b15 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:57:39.654092 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-5f37466d-cb43-4bf6-911d-d44e21079b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:39.756141 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 631/1262] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:57:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:57:39.792614 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15600d73-8d7e-483b-9bdc-beb8a8b5937d None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:57:39.795564 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-15600d73-8d7e-483b-9bdc-beb8a8b5937d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:39.920899 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15600d73-8d7e-483b-9bdc-beb8a8b5937d None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:57:39.924855 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a09243-d0e3-4901-b219-6de111880f85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:57:39.925432 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a09243-d0e3-4901-b219-6de111880f85 service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:39.925719 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a09243-d0e3-4901-b219-6de111880f85 service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:39.925998 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a09243-d0e3-4901-b219-6de111880f85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:39.927653 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-e8a09243-d0e3-4901-b219-6de111880f85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:40.041866 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a09243-d0e3-4901-b219-6de111880f85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:57:40.066470 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a09243-d0e3-4901-b219-6de111880f85 service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:57:40.086499 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 632/1263] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:57:39 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:57:44.417068 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346db545-e69d-4665-8d3c-6e988b87a2d9 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:44.417561 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346db545-e69d-4665-8d3c-6e988b87a2d9 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:44.417654 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346db545-e69d-4665-8d3c-6e988b87a2d9 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:44.419305 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 632/1264] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:57:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:57:44.424699 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642581c2-c1f1-45ef-bb34-bbc915326987 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:44.425087 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642581c2-c1f1-45ef-bb34-bbc915326987 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:44.425358 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642581c2-c1f1-45ef-bb34-bbc915326987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:44.488650 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-642581c2-c1f1-45ef-bb34-bbc915326987 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:57:44.489909 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-642581c2-c1f1-45ef-bb34-bbc915326987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:44.496872 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 633/1265] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:57:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:57:44.535888 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346db545-e69d-4665-8d3c-6e988b87a2d9 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:57:44.537978 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-346db545-e69d-4665-8d3c-6e988b87a2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:44.551929 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346db545-e69d-4665-8d3c-6e988b87a2d9 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:57:44.555086 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29c3b8-8f40-485d-970c-90e43b21ed80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:57:44.555692 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29c3b8-8f40-485d-970c-90e43b21ed80 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:44.555978 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29c3b8-8f40-485d-970c-90e43b21ed80 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:44.556256 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29c3b8-8f40-485d-970c-90e43b21ed80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:44.565375 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29c3b8-8f40-485d-970c-90e43b21ed80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:57:44.590453 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29c3b8-8f40-485d-970c-90e43b21ed80 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:57:44.599843 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 633/1266] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:57:44 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:57:47.344296 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063d047-7a86-47a4-b61c-f521c19c15af None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:47.344837 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063d047-7a86-47a4-b61c-f521c19c15af None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:47.344937 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063d047-7a86-47a4-b61c-f521c19c15af None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:47.346737 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 634/1267] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:57:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:57:47.352021 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e144cde-4562-49b4-a947-e3f317f25ae9 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:47.352463 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e144cde-4562-49b4-a947-e3f317f25ae9 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:47.352564 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e144cde-4562-49b4-a947-e3f317f25ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:47.375024 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-2e144cde-4562-49b4-a947-e3f317f25ae9 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:57:47.376181 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-2e144cde-4562-49b4-a947-e3f317f25ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:47.382944 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 634/1268] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:57:47 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:57:47.420567 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063d047-7a86-47a4-b61c-f521c19c15af None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:57:47.431258 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063d047-7a86-47a4-b61c-f521c19c15af None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:57:47.434746 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4232a0-cda4-4cee-9f5e-6b9560332c3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:57:47.435338 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4232a0-cda4-4cee-9f5e-6b9560332c3a service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:47.435672 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4232a0-cda4-4cee-9f5e-6b9560332c3a service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:47.436002 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4232a0-cda4-4cee-9f5e-6b9560332c3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:47.445442 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4232a0-cda4-4cee-9f5e-6b9560332c3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:57:47.471231 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4232a0-cda4-4cee-9f5e-6b9560332c3a service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:57:47.480850 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 635/1269] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:57:47 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:57:51.885596 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e56f1-93e4-45cb-a800-2ffc04e92946 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:51.886082 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e56f1-93e4-45cb-a800-2ffc04e92946 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:51.886203 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e56f1-93e4-45cb-a800-2ffc04e92946 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:51.887904 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 635/1270] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:57:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:57:51.893398 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d7c74-26f7-4288-8752-ce40dbff8f76 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:51.893941 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d7c74-26f7-4288-8752-ce40dbff8f76 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:51.894044 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3d7c74-26f7-4288-8752-ce40dbff8f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:51.993828 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-af3d7c74-26f7-4288-8752-ce40dbff8f76 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:57:51.994967 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-af3d7c74-26f7-4288-8752-ce40dbff8f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:52.001973 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 636/1271] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:57:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:57:52.040163 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e56f1-93e4-45cb-a800-2ffc04e92946 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:57:52.050438 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e56f1-93e4-45cb-a800-2ffc04e92946 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:57:52.053596 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78695a-893c-42f4-a464-85ba76998e22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:57:52.054163 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78695a-893c-42f4-a464-85ba76998e22 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:52.054449 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78695a-893c-42f4-a464-85ba76998e22 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:52.054727 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78695a-893c-42f4-a464-85ba76998e22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:52.063079 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78695a-893c-42f4-a464-85ba76998e22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:57:52.088038 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78695a-893c-42f4-a464-85ba76998e22 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:57:52.097668 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 636/1272] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:57:52 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:57:56.518780 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47635b3e-972e-483e-a006-81b9bbf2a46e None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:56.519253 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47635b3e-972e-483e-a006-81b9bbf2a46e None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:56.519755 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47635b3e-972e-483e-a006-81b9bbf2a46e None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:56.524493 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 637/1273] 10.222.0.89 () {54 vars in 921 bytes} [Wed Oct 27 14:57:56 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:57:56.531558 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14f54a-37a5-4548-8bbe-bb46aea14bc2 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:56.531558 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14f54a-37a5-4548-8bbe-bb46aea14bc2 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:56.531558 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14f54a-37a5-4548-8bbe-bb46aea14bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:56.644279 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-ff14f54a-37a5-4548-8bbe-bb46aea14bc2 None None] MFA Rules not processed for user `fcbab075fd5b4a889c2002639ca9d60a`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:57:56.645429 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-ff14f54a-37a5-4548-8bbe-bb46aea14bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:56.743889 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 637/1274] 10.222.0.89 () {58 vars in 1018 bytes} [Wed Oct 27 14:57:56 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:57:57.161530 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db769429-206a-45fb-80d7-b70ededd3380 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:57.162087 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db769429-206a-45fb-80d7-b70ededd3380 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:57.162655 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db769429-206a-45fb-80d7-b70ededd3380 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:57.164744 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 638/1275] 10.222.0.89 () {54 vars in 921 bytes} [Wed Oct 27 14:57:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:57:57.169455 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d88535-c228-44e0-b076-3a3771a6793b None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:57:57.170091 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d88535-c228-44e0-b076-3a3771a6793b None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:57:57.170519 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d88535-c228-44e0-b076-3a3771a6793b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:57:57.194174 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-a0d88535-c228-44e0-b076-3a3771a6793b None None] MFA Rules not processed for user `fcbab075fd5b4a889c2002639ca9d60a`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:57:57.195573 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-a0d88535-c228-44e0-b076-3a3771a6793b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:57:57.209198 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 638/1276] 10.222.0.89 () {58 vars in 1018 bytes} [Wed Oct 27 14:57:57 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:58:01.099098 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943c517-84f2-4548-b1df-b6ddc3c653e2 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:01.099643 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943c517-84f2-4548-b1df-b6ddc3c653e2 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:01.099643 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943c517-84f2-4548-b1df-b6ddc3c653e2 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:01.101277 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 639/1277] 10.222.0.89 () {54 vars in 921 bytes} [Wed Oct 27 14:58:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:58:01.106624 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54220ba2-c74c-4cea-b1f4-0b233a3d4678 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:01.107498 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54220ba2-c74c-4cea-b1f4-0b233a3d4678 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:01.108018 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54220ba2-c74c-4cea-b1f4-0b233a3d4678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:01.133398 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-54220ba2-c74c-4cea-b1f4-0b233a3d4678 None None] MFA Rules not processed for user `fcbab075fd5b4a889c2002639ca9d60a`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:58:01.135000 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-54220ba2-c74c-4cea-b1f4-0b233a3d4678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:58:01.144490 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 639/1278] 10.222.0.89 () {58 vars in 1018 bytes} [Wed Oct 27 14:58:01 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:58:02.583118 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a111b50-6fc0-4582-ae9e-42c75d99daca None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:02.583642 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a111b50-6fc0-4582-ae9e-42c75d99daca None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:02.583642 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a111b50-6fc0-4582-ae9e-42c75d99daca None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:02.585404 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 640/1279] 10.222.0.89 () {54 vars in 921 bytes} [Wed Oct 27 14:58:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:58:02.590366 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbe8c3-5ad4-4a39-ad19-abd9cab11f85 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:02.590799 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbe8c3-5ad4-4a39-ad19-abd9cab11f85 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:02.590926 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbe8c3-5ad4-4a39-ad19-abd9cab11f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:02.613423 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-1bdbe8c3-5ad4-4a39-ad19-abd9cab11f85 None None] MFA Rules not processed for user `fcbab075fd5b4a889c2002639ca9d60a`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:58:02.614788 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-1bdbe8c3-5ad4-4a39-ad19-abd9cab11f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:58:02.623484 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 640/1280] 10.222.0.89 () {58 vars in 1018 bytes} [Wed Oct 27 14:58:02 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:58:05.846950 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b1350-a653-4665-ad5e-5ad2318b6383 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:05.847513 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b1350-a653-4665-ad5e-5ad2318b6383 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:05.847606 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b1350-a653-4665-ad5e-5ad2318b6383 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:05.849186 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 641/1281] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:58:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:58:05.854205 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b8b57-0a68-4110-aa2c-206ae88e32fd None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:05.854647 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b8b57-0a68-4110-aa2c-206ae88e32fd None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:05.854795 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b8b57-0a68-4110-aa2c-206ae88e32fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:05.877680 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-8c3b8b57-0a68-4110-aa2c-206ae88e32fd None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:58:05.878802 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-8c3b8b57-0a68-4110-aa2c-206ae88e32fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:58:05.885990 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 641/1282] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:58:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:58:05.975052 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207be49-4be7-417b-ae4f-587832dfe84c None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:05.975369 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207be49-4be7-417b-ae4f-587832dfe84c None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:05.975676 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207be49-4be7-417b-ae4f-587832dfe84c None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:05.977319 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 642/1283] 10.222.0.89 () {54 vars in 954 bytes} [Wed Oct 27 14:58:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:58:05.982329 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d941e-ea2b-48d5-9d23-38c400d3ec48 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:05.982621 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d941e-ea2b-48d5-9d23-38c400d3ec48 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:05.982904 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d941e-ea2b-48d5-9d23-38c400d3ec48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:06.051519 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-075d941e-ea2b-48d5-9d23-38c400d3ec48 None None] MFA Rules not processed for user `01acdb65e66441418d4abe1f0ed804bc`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:58:06.052667 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-075d941e-ea2b-48d5-9d23-38c400d3ec48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:58:06.137384 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 642/1284] 10.222.0.89 () {58 vars in 1051 bytes} [Wed Oct 27 14:58:05 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:58:06.145333 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207be49-4be7-417b-ae4f-587832dfe84c None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:58:06.161229 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207be49-4be7-417b-ae4f-587832dfe84c None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:58:06.166183 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c12991-b2c4-4586-8e14-79e4390c49cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:58:06.166754 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c12991-b2c4-4586-8e14-79e4390c49cd service nova] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:06.167038 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c12991-b2c4-4586-8e14-79e4390c49cd service nova] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:06.167316 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c12991-b2c4-4586-8e14-79e4390c49cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:06.175820 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c12991-b2c4-4586-8e14-79e4390c49cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:58:06.200343 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c12991-b2c4-4586-8e14-79e4390c49cd service nova] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:58:06.209065 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 643/1285] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:58:06 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:58:08.357279 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348c7b9-b074-4d2a-b915-fe065d6faf67 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:08.357843 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348c7b9-b074-4d2a-b915-fe065d6faf67 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:08.357954 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348c7b9-b074-4d2a-b915-fe065d6faf67 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:08.359557 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 643/1286] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:58:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:58:08.364765 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a549b0-5644-4ca3-99e2-6c8a6a014af1 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:08.365157 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a549b0-5644-4ca3-99e2-6c8a6a014af1 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:08.365333 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a549b0-5644-4ca3-99e2-6c8a6a014af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:08.387722 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-04a549b0-5644-4ca3-99e2-6c8a6a014af1 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:58:08.388855 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-04a549b0-5644-4ca3-99e2-6c8a6a014af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:58:08.396426 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 644/1287] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:58:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:58:08.487401 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74418340-5d13-4627-b2ee-55e55e3274b5 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:08.487718 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74418340-5d13-4627-b2ee-55e55e3274b5 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:08.488004 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74418340-5d13-4627-b2ee-55e55e3274b5 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:08.489701 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 644/1288] 10.222.0.89 () {54 vars in 954 bytes} [Wed Oct 27 14:58:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:58:08.494725 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd723918-835e-4d59-a8ed-e589cf41a45f None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:08.495022 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd723918-835e-4d59-a8ed-e589cf41a45f None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:08.495332 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd723918-835e-4d59-a8ed-e589cf41a45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:08.517877 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-fd723918-835e-4d59-a8ed-e589cf41a45f None None] MFA Rules not processed for user `01acdb65e66441418d4abe1f0ed804bc`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:58:08.518984 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-fd723918-835e-4d59-a8ed-e589cf41a45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:58:08.527040 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 645/1289] 10.222.0.89 () {58 vars in 1051 bytes} [Wed Oct 27 14:58:08 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:58:08.534683 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74418340-5d13-4627-b2ee-55e55e3274b5 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:58:08.548204 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74418340-5d13-4627-b2ee-55e55e3274b5 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:58:08.553080 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2bc299-b546-40ca-88ea-4f978eb17776 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:58:08.553636 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bc299-b546-40ca-88ea-4f978eb17776 service nova] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:08.553918 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bc299-b546-40ca-88ea-4f978eb17776 service nova] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:08.554194 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2bc299-b546-40ca-88ea-4f978eb17776 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:08.562714 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2bc299-b546-40ca-88ea-4f978eb17776 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:58:08.587550 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2bc299-b546-40ca-88ea-4f978eb17776 service nova] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:58:08.596414 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 645/1290] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:58:08 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:58:10.872405 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea118c3-b923-4462-b0f4-45363b0f90ea None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:10.872918 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea118c3-b923-4462-b0f4-45363b0f90ea None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:10.873033 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea118c3-b923-4462-b0f4-45363b0f90ea None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:10.875379 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 646/1291] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:58:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:58:10.880614 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb503bb0-593d-49a2-a4f5-01f8df937588 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:10.881015 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb503bb0-593d-49a2-a4f5-01f8df937588 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:10.881183 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb503bb0-593d-49a2-a4f5-01f8df937588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:10.903081 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-cb503bb0-593d-49a2-a4f5-01f8df937588 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:58:10.904247 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-cb503bb0-593d-49a2-a4f5-01f8df937588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:58:10.911390 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 646/1292] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:58:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:58:10.997544 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea118c3-b923-4462-b0f4-45363b0f90ea None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:58:11.011334 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea118c3-b923-4462-b0f4-45363b0f90ea None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:58:11.016380 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63460847-c874-441b-a9cf-7195c9a0b5d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:58:11.016940 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63460847-c874-441b-a9cf-7195c9a0b5d7 service nova] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:11.017223 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63460847-c874-441b-a9cf-7195c9a0b5d7 service nova] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:11.017499 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63460847-c874-441b-a9cf-7195c9a0b5d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:11.025086 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63460847-c874-441b-a9cf-7195c9a0b5d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:58:11.050915 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63460847-c874-441b-a9cf-7195c9a0b5d7 service nova] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:58:11.059590 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 647/1293] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:58:10 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:58:13.263538 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee7fa6-e027-4785-8f3f-3ea39414b776 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:13.264614 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee7fa6-e027-4785-8f3f-3ea39414b776 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:13.264725 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee7fa6-e027-4785-8f3f-3ea39414b776 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:13.266521 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 647/1294] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:58:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:58:13.271544 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b4eeb-1c76-4dea-b1f9-a4ca1ffaad78 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:13.271972 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b4eeb-1c76-4dea-b1f9-a4ca1ffaad78 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:13.272106 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b4eeb-1c76-4dea-b1f9-a4ca1ffaad78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:13.295470 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-062b4eeb-1c76-4dea-b1f9-a4ca1ffaad78 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:58:13.296610 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-062b4eeb-1c76-4dea-b1f9-a4ca1ffaad78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:58:13.303351 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 648/1295] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:58:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:58:13.390380 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee7fa6-e027-4785-8f3f-3ea39414b776 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:58:13.403557 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee7fa6-e027-4785-8f3f-3ea39414b776 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:58:13.408827 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d60340-d017-4a97-aac5-c848d516b1df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:58:13.409395 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d60340-d017-4a97-aac5-c848d516b1df service nova] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:13.409686 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d60340-d017-4a97-aac5-c848d516b1df service nova] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:13.409967 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d60340-d017-4a97-aac5-c848d516b1df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:13.417712 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d60340-d017-4a97-aac5-c848d516b1df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:58:13.444189 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d60340-d017-4a97-aac5-c848d516b1df service nova] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:58:13.454000 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 648/1296] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:58:13 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:58:15.609401 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e99b9-fb1d-4445-89cb-c1227e12e0f9 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:15.609915 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e99b9-fb1d-4445-89cb-c1227e12e0f9 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:15.609915 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e99b9-fb1d-4445-89cb-c1227e12e0f9 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:15.612044 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 649/1297] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:58:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:58:15.617478 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc2f90-bcd3-42fc-9403-3ed767bdb88b None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:15.617905 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc2f90-bcd3-42fc-9403-3ed767bdb88b None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:15.618064 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc2f90-bcd3-42fc-9403-3ed767bdb88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:15.641571 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-a1cc2f90-bcd3-42fc-9403-3ed767bdb88b None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:58:15.642685 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-a1cc2f90-bcd3-42fc-9403-3ed767bdb88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:58:15.649683 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 649/1298] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:58:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:58:15.736922 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e99b9-fb1d-4445-89cb-c1227e12e0f9 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:58:15.750219 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e99b9-fb1d-4445-89cb-c1227e12e0f9 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:58:15.754987 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb98066-6202-467d-bd1d-0febdf0bdbbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:58:15.755585 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb98066-6202-467d-bd1d-0febdf0bdbbb service nova] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:15.755874 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb98066-6202-467d-bd1d-0febdf0bdbbb service nova] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:15.756152 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb98066-6202-467d-bd1d-0febdf0bdbbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:15.764043 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb98066-6202-467d-bd1d-0febdf0bdbbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:58:15.789517 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb98066-6202-467d-bd1d-0febdf0bdbbb service nova] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:58:15.799044 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 650/1299] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:58:15 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:58:17.859725 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaef37a-3ced-423c-8559-e1ccf5456d15 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:17.860298 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaef37a-3ced-423c-8559-e1ccf5456d15 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:17.860298 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaef37a-3ced-423c-8559-e1ccf5456d15 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:17.862231 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 650/1300] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:58:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:58:17.867556 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8aefa-e5d8-455a-a68a-6cacc36c0718 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:17.867998 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8aefa-e5d8-455a-a68a-6cacc36c0718 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:17.868125 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8aefa-e5d8-455a-a68a-6cacc36c0718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:17.891426 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-41e8aefa-e5d8-455a-a68a-6cacc36c0718 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:58:17.892596 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-41e8aefa-e5d8-455a-a68a-6cacc36c0718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:58:17.899945 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 651/1301] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:58:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:58:17.997049 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaef37a-3ced-423c-8559-e1ccf5456d15 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:58:18.010779 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaef37a-3ced-423c-8559-e1ccf5456d15 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:58:18.015866 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b895f3-f7bc-4894-be8a-f0472fd05ad4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:58:18.016472 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b895f3-f7bc-4894-be8a-f0472fd05ad4 service nova] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:18.016779 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b895f3-f7bc-4894-be8a-f0472fd05ad4 service nova] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:18.017079 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b895f3-f7bc-4894-be8a-f0472fd05ad4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:18.025173 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b895f3-f7bc-4894-be8a-f0472fd05ad4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:58:18.052667 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b895f3-f7bc-4894-be8a-f0472fd05ad4 service nova] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:58:18.062608 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 651/1302] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:58:17 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:58:20.117653 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca5887-158a-4864-affc-5fcb2001f86d None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:20.118234 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca5887-158a-4864-affc-5fcb2001f86d None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:20.118341 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca5887-158a-4864-affc-5fcb2001f86d None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:20.120214 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 652/1303] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:58:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:58:20.125799 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc4cbb-d88d-4b9b-860d-94f915cf32ad None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:20.126217 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc4cbb-d88d-4b9b-860d-94f915cf32ad None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:20.126373 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc4cbb-d88d-4b9b-860d-94f915cf32ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:20.148956 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-b0dc4cbb-d88d-4b9b-860d-94f915cf32ad None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:58:20.150082 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-b0dc4cbb-d88d-4b9b-860d-94f915cf32ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:58:20.157021 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 652/1304] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:58:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:58:20.242344 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca5887-158a-4864-affc-5fcb2001f86d None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:58:20.255856 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca5887-158a-4864-affc-5fcb2001f86d None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:58:20.260724 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b69bed-42c1-4aef-9548-7533f87219d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:58:20.261288 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b69bed-42c1-4aef-9548-7533f87219d6 service nova] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:20.261570 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b69bed-42c1-4aef-9548-7533f87219d6 service nova] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:20.261953 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b69bed-42c1-4aef-9548-7533f87219d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:20.269588 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b69bed-42c1-4aef-9548-7533f87219d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:58:20.294989 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b69bed-42c1-4aef-9548-7533f87219d6 service nova] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:58:20.304497 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 653/1305] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:58:20 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:58:22.251095 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5fa78-23b8-440b-8417-8eeb1711388c None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:22.251699 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5fa78-23b8-440b-8417-8eeb1711388c None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:22.251699 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5fa78-23b8-440b-8417-8eeb1711388c None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:22.253331 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 653/1306] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:58:22 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:58:22.258552 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480033d-13c0-4f05-b8ba-3c7bfcb24ed8 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:22.258995 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480033d-13c0-4f05-b8ba-3c7bfcb24ed8 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:22.259125 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c480033d-13c0-4f05-b8ba-3c7bfcb24ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:22.281818 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-c480033d-13c0-4f05-b8ba-3c7bfcb24ed8 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:58:22.283214 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-c480033d-13c0-4f05-b8ba-3c7bfcb24ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:58:22.290150 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 654/1307] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:58:22 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:58:22.376155 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5fa78-23b8-440b-8417-8eeb1711388c None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:58:22.389334 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5fa78-23b8-440b-8417-8eeb1711388c None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:58:22.394202 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2dc7dc-03c1-4cbe-beac-2e68e1256c59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:58:22.394772 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dc7dc-03c1-4cbe-beac-2e68e1256c59 service nova] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:22.395057 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dc7dc-03c1-4cbe-beac-2e68e1256c59 service nova] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:22.395337 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2dc7dc-03c1-4cbe-beac-2e68e1256c59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:22.403026 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2dc7dc-03c1-4cbe-beac-2e68e1256c59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:58:22.428997 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2dc7dc-03c1-4cbe-beac-2e68e1256c59 service nova] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:58:22.437765 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 654/1308] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:58:22 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:58:24.501417 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610745ff-8d4d-492d-ac7f-b2bc4c51bb05 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:24.501417 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610745ff-8d4d-492d-ac7f-b2bc4c51bb05 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:24.502057 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610745ff-8d4d-492d-ac7f-b2bc4c51bb05 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:24.503159 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 655/1309] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:58:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:58:24.508624 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2273ab-4624-4753-8ea3-442692400619 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:24.509039 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2273ab-4624-4753-8ea3-442692400619 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:24.509195 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2273ab-4624-4753-8ea3-442692400619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:24.532860 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-7f2273ab-4624-4753-8ea3-442692400619 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:58:24.533920 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-7f2273ab-4624-4753-8ea3-442692400619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:58:24.540616 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 655/1310] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:58:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:58:24.626400 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610745ff-8d4d-492d-ac7f-b2bc4c51bb05 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:58:24.639893 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610745ff-8d4d-492d-ac7f-b2bc4c51bb05 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:58:24.644663 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d9a46-99fe-4332-b8fc-0aa5cdc2f976 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:58:24.645223 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d9a46-99fe-4332-b8fc-0aa5cdc2f976 service nova] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:24.645506 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d9a46-99fe-4332-b8fc-0aa5cdc2f976 service nova] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:24.645781 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d9a46-99fe-4332-b8fc-0aa5cdc2f976 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:24.653398 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d9a46-99fe-4332-b8fc-0aa5cdc2f976 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:58:24.678185 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d9a46-99fe-4332-b8fc-0aa5cdc2f976 service nova] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:58:24.687352 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 656/1311] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:58:24 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:58:26.741734 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78759a2b-cc24-49a5-bb6b-4e69de908f0d None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:26.742333 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78759a2b-cc24-49a5-bb6b-4e69de908f0d None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:26.742333 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78759a2b-cc24-49a5-bb6b-4e69de908f0d None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:26.744017 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 656/1312] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:58:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:58:26.749868 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14bcbc-1a7e-4338-a20d-4e74772d29d3 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:26.750289 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14bcbc-1a7e-4338-a20d-4e74772d29d3 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:26.750456 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14bcbc-1a7e-4338-a20d-4e74772d29d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:26.772050 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-6e14bcbc-1a7e-4338-a20d-4e74772d29d3 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:58:26.773165 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-6e14bcbc-1a7e-4338-a20d-4e74772d29d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:58:26.779909 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 657/1313] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:58:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:58:26.866648 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78759a2b-cc24-49a5-bb6b-4e69de908f0d None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:58:26.881179 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78759a2b-cc24-49a5-bb6b-4e69de908f0d None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:58:26.886015 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782cfd7-bda4-47fa-93d6-00de98d1ac86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:58:26.886586 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782cfd7-bda4-47fa-93d6-00de98d1ac86 service nova] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:26.886875 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782cfd7-bda4-47fa-93d6-00de98d1ac86 service nova] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:26.887155 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782cfd7-bda4-47fa-93d6-00de98d1ac86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:26.894956 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782cfd7-bda4-47fa-93d6-00de98d1ac86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:58:26.921268 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782cfd7-bda4-47fa-93d6-00de98d1ac86 service nova] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:58:26.930182 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 657/1314] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:58:26 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:58:28.996633 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4f030-42b3-4f7b-958f-ff80aec2b341 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:28.997227 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4f030-42b3-4f7b-958f-ff80aec2b341 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:28.997227 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4f030-42b3-4f7b-958f-ff80aec2b341 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:28.999507 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 658/1315] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:58:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:58:29.004654 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42906447-d820-4e51-acd0-7827ce49ac70 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:29.005103 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42906447-d820-4e51-acd0-7827ce49ac70 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:29.005205 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42906447-d820-4e51-acd0-7827ce49ac70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:29.027237 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-42906447-d820-4e51-acd0-7827ce49ac70 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:58:29.028438 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-42906447-d820-4e51-acd0-7827ce49ac70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:58:29.035571 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 658/1316] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:58:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:58:29.121534 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4f030-42b3-4f7b-958f-ff80aec2b341 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:58:29.135149 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4f030-42b3-4f7b-958f-ff80aec2b341 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:58:29.139979 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b87bac-e81b-4b85-9655-03c296d22b7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:58:29.140552 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b87bac-e81b-4b85-9655-03c296d22b7e service nova] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:29.140840 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b87bac-e81b-4b85-9655-03c296d22b7e service nova] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:29.141118 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b87bac-e81b-4b85-9655-03c296d22b7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:29.148804 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b87bac-e81b-4b85-9655-03c296d22b7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:58:29.174802 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b87bac-e81b-4b85-9655-03c296d22b7e service nova] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:58:29.183633 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 659/1317] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:58:29 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:58:31.246758 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7456a1-ea65-486c-ac85-17d712edd8a0 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:31.247346 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7456a1-ea65-486c-ac85-17d712edd8a0 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:31.247346 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7456a1-ea65-486c-ac85-17d712edd8a0 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:31.249232 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 659/1318] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:58:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:58:31.254206 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcef5f2-df83-441b-b9bf-20e6b0b62272 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:31.254650 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcef5f2-df83-441b-b9bf-20e6b0b62272 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:31.254763 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcef5f2-df83-441b-b9bf-20e6b0b62272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:31.276804 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-0dcef5f2-df83-441b-b9bf-20e6b0b62272 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:58:31.277943 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-0dcef5f2-df83-441b-b9bf-20e6b0b62272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:58:31.285636 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 660/1319] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:58:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:58:31.372561 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7456a1-ea65-486c-ac85-17d712edd8a0 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:58:31.385714 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7456a1-ea65-486c-ac85-17d712edd8a0 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:58:31.391095 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97452ed2-097f-4fcf-9113-130232e89466 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:58:31.391700 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97452ed2-097f-4fcf-9113-130232e89466 service nova] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:31.391988 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97452ed2-097f-4fcf-9113-130232e89466 service nova] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:31.392267 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97452ed2-097f-4fcf-9113-130232e89466 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:31.400015 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97452ed2-097f-4fcf-9113-130232e89466 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:58:31.425579 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97452ed2-097f-4fcf-9113-130232e89466 service nova] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:58:31.434375 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 660/1320] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:58:31 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:58:41.432604 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c69a3-619e-484a-b1d8-d4d34cc296a6 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:41.433158 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c69a3-619e-484a-b1d8-d4d34cc296a6 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:41.433158 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c69a3-619e-484a-b1d8-d4d34cc296a6 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:41.434843 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 661/1321] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:58:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:58:41.440700 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c342089-450a-4193-aa7f-58fd7f2f8faf None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:41.441136 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c342089-450a-4193-aa7f-58fd7f2f8faf None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:41.441399 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c342089-450a-4193-aa7f-58fd7f2f8faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:41.464221 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-9c342089-450a-4193-aa7f-58fd7f2f8faf None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:58:41.465356 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-9c342089-450a-4193-aa7f-58fd7f2f8faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:58:41.472932 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 661/1322] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:58:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:58:41.534775 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544fa76-371c-4704-9a98-a7a2378a028a None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:41.534994 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544fa76-371c-4704-9a98-a7a2378a028a None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:41.535274 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544fa76-371c-4704-9a98-a7a2378a028a None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:41.536978 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 662/1323] 10.222.0.89 () {54 vars in 961 bytes} [Wed Oct 27 14:58:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:58:41.541852 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb34ef-ba50-411a-b955-fef4c3a8d2c2 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:41.542153 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb34ef-ba50-411a-b955-fef4c3a8d2c2 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:41.542432 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb34ef-ba50-411a-b955-fef4c3a8d2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:41.608506 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-bbbb34ef-ba50-411a-b955-fef4c3a8d2c2 None None] MFA Rules not processed for user `0fca8f0282ea40ce9b378260b95b3d01`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:58:41.609643 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-bbbb34ef-ba50-411a-b955-fef4c3a8d2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:58:41.675819 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 662/1324] 10.222.0.89 () {58 vars in 1058 bytes} [Wed Oct 27 14:58:41 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:58:41.683623 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544fa76-371c-4704-9a98-a7a2378a028a None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:58:41.694372 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544fa76-371c-4704-9a98-a7a2378a028a None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:58:41.697532 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b911bb-068a-4328-8ffb-f7fc47acc0eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:58:41.698087 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b911bb-068a-4328-8ffb-f7fc47acc0eb service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:41.698367 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b911bb-068a-4328-8ffb-f7fc47acc0eb service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:41.698640 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b911bb-068a-4328-8ffb-f7fc47acc0eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:41.707628 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b911bb-068a-4328-8ffb-f7fc47acc0eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:58:41.732293 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b911bb-068a-4328-8ffb-f7fc47acc0eb service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:58:41.741184 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 663/1325] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:58:41 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:58:54.972876 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ceb8d3-778d-440c-a7ac-a9de23bd4507 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:54.973461 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ceb8d3-778d-440c-a7ac-a9de23bd4507 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:54.973461 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ceb8d3-778d-440c-a7ac-a9de23bd4507 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:54.975116 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 663/1326] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:58:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 14:58:54.980302 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9043743-c387-43b7-9bd3-cc900ecbaa81 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:54.980714 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9043743-c387-43b7-9bd3-cc900ecbaa81 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:54.980893 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9043743-c387-43b7-9bd3-cc900ecbaa81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:55.003378 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-b9043743-c387-43b7-9bd3-cc900ecbaa81 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:58:55.004544 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-b9043743-c387-43b7-9bd3-cc900ecbaa81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:58:55.011387 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 664/1327] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:58:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:58:55.073323 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ca260-d516-4ea5-a65e-e406a6f9e2bd None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:55.073616 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ca260-d516-4ea5-a65e-e406a6f9e2bd None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:55.073897 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15ca260-d516-4ea5-a65e-e406a6f9e2bd None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:55.075597 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 664/1328] 10.222.0.89 () {54 vars in 956 bytes} [Wed Oct 27 14:58:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:58:55.081711 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dae23c-b4d9-4b08-b9f0-5d07166b6672 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:55.082002 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dae23c-b4d9-4b08-b9f0-5d07166b6672 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:55.082279 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dae23c-b4d9-4b08-b9f0-5d07166b6672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:55.149232 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-10dae23c-b4d9-4b08-b9f0-5d07166b6672 None None] MFA Rules not processed for user `17c345fc642242469346303afbeda2f6`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:58:55.150361 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-10dae23c-b4d9-4b08-b9f0-5d07166b6672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:58:55.214850 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 665/1329] 10.222.0.89 () {58 vars in 1053 bytes} [Wed Oct 27 14:58:55 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:58:55.224612 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ca260-d516-4ea5-a65e-e406a6f9e2bd None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:58:55.235014 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15ca260-d516-4ea5-a65e-e406a6f9e2bd None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:58:55.238310 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e0c16-1639-4626-8103-8f9cd970def7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c345fc642242469346303afbeda2f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:58:55.238958 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e0c16-1639-4626-8103-8f9cd970def7 service glance] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:55.239315 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e0c16-1639-4626-8103-8f9cd970def7 service glance] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:55.239693 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e0c16-1639-4626-8103-8f9cd970def7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:55.248255 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e0c16-1639-4626-8103-8f9cd970def7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:58:55.273515 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e0c16-1639-4626-8103-8f9cd970def7 service glance] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:58:55.283501 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 665/1330] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:58:55 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:58:55.670499 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a571c5-5dcf-490f-b690-ddf9f6b2db0e None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:55.670776 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a571c5-5dcf-490f-b690-ddf9f6b2db0e None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:55.671052 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a571c5-5dcf-490f-b690-ddf9f6b2db0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:55.736364 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-47a571c5-5dcf-490f-b690-ddf9f6b2db0e None None] MFA Rules not processed for user `ed972e6b35be47a8af2e86651ccc6911`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:58:55.737487 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-47a571c5-5dcf-490f-b690-ddf9f6b2db0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:58:55.807276 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 666/1331] 10.222.0.89 () {58 vars in 1014 bytes} [Wed Oct 27 14:58:55 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:58:55.847090 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4c4f7-3339-42b0-b93f-da1f533ca714 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:55.847394 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4c4f7-3339-42b0-b93f-da1f533ca714 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:55.847712 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4c4f7-3339-42b0-b93f-da1f533ca714 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:55.849396 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 666/1332] 10.222.0.89 () {54 vars in 942 bytes} [Wed Oct 27 14:58:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:58:55.855135 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca3ba7-1975-4ea9-aa07-50acc733a346 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:55.855459 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca3ba7-1975-4ea9-aa07-50acc733a346 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:55.855750 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca3ba7-1975-4ea9-aa07-50acc733a346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:55.924203 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-22ca3ba7-1975-4ea9-aa07-50acc733a346 None None] MFA Rules not processed for user `ffba82bc9ddf42069a813b932bd310ba`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:58:55.925340 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-22ca3ba7-1975-4ea9-aa07-50acc733a346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:58:56.000797 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 667/1333] 10.222.0.89 () {58 vars in 1039 bytes} [Wed Oct 27 14:58:55 2021] POST /identity/v3/auth/tokens => generated 3734 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:58:56.009350 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4c4f7-3339-42b0-b93f-da1f533ca714 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:58:56.021802 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4c4f7-3339-42b0-b93f-da1f533ca714 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:58:56.026314 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefe75f-5ac5-4706-b2dd-9694a20c6d6f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffba82bc9ddf42069a813b932bd310ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:58:56.026887 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefe75f-5ac5-4706-b2dd-9694a20c6d6f service swift] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:58:56.027174 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefe75f-5ac5-4706-b2dd-9694a20c6d6f service swift] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:58:56.027481 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefe75f-5ac5-4706-b2dd-9694a20c6d6f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:58:56.035619 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefe75f-5ac5-4706-b2dd-9694a20c6d6f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:58:56.060894 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefe75f-5ac5-4706-b2dd-9694a20c6d6f service swift] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:58:56.069134 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 667/1334] 10.222.0.89 () {60 vars in 1384 bytes} [Wed Oct 27 14:58:56 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 14:59:15.175969 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3ce9e-09f9-4434-9641-e1c0a04a6d05 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:15.176545 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3ce9e-09f9-4434-9641-e1c0a04a6d05 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:15.176545 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3ce9e-09f9-4434-9641-e1c0a04a6d05 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:15.178203 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 668/1335] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:59:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:59:15.183263 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f497a-b01f-4f71-ab1a-54dd06fbab74 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:15.183709 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f497a-b01f-4f71-ab1a-54dd06fbab74 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:15.183865 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f497a-b01f-4f71-ab1a-54dd06fbab74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:15.206875 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-e33f497a-b01f-4f71-ab1a-54dd06fbab74 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:59:15.208050 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-e33f497a-b01f-4f71-ab1a-54dd06fbab74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:59:15.215423 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 668/1336] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:59:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:59:15.238752 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3ce9e-09f9-4434-9641-e1c0a04a6d05 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:15.253625 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3ce9e-09f9-4434-9641-e1c0a04a6d05 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:15.258156 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f554be71-0477-4fd1-b64b-37c8cbad81ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:15.258816 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554be71-0477-4fd1-b64b-37c8cbad81ea admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:15.259109 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554be71-0477-4fd1-b64b-37c8cbad81ea admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:15.259390 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f554be71-0477-4fd1-b64b-37c8cbad81ea admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:15.260157 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554be71-0477-4fd1-b64b-37c8cbad81ea admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:15.285834 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f554be71-0477-4fd1-b64b-37c8cbad81ea admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:15.301658 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 669/1337] 10.222.0.89 () {56 vars in 1108 bytes} [Wed Oct 27 14:59:15 2021] GET /identity/v3/projects => generated 2553 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:59:17.226170 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b56cf-8ccc-4caf-a79b-4c2b42cf7e4a None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:17.226746 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b56cf-8ccc-4caf-a79b-4c2b42cf7e4a None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:17.226746 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b56cf-8ccc-4caf-a79b-4c2b42cf7e4a None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:17.228443 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 669/1338] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:59:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:59:17.234082 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bfce70-5eb1-46a3-accf-85dabcbc7a16 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:17.234481 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bfce70-5eb1-46a3-accf-85dabcbc7a16 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:17.234644 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bfce70-5eb1-46a3-accf-85dabcbc7a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:17.256388 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-77bfce70-5eb1-46a3-accf-85dabcbc7a16 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:59:17.257550 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-77bfce70-5eb1-46a3-accf-85dabcbc7a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:59:17.264655 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 670/1339] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:59:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:59:17.287233 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b56cf-8ccc-4caf-a79b-4c2b42cf7e4a None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:17.299689 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b56cf-8ccc-4caf-a79b-4c2b42cf7e4a None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:17.303718 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0d7e5-08fa-40fb-9e06-a3906dfe989b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:17.304541 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0d7e5-08fa-40fb-9e06-a3906dfe989b admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:17.304826 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0d7e5-08fa-40fb-9e06-a3906dfe989b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:17.305101 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c0d7e5-08fa-40fb-9e06-a3906dfe989b admin admin] PATH_INFO: `/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:17.318488 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0d7e5-08fa-40fb-9e06-a3906dfe989b admin admin] RBAC: Authorizing `identity:get_project(project_id=055ce8b96eed43db9c8ea4bb1307f9ad)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:17.344054 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c0d7e5-08fa-40fb-9e06-a3906dfe989b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:17.345599 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 670/1340] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:59:17 2021] GET /identity/v3/projects/055ce8b96eed43db9c8ea4bb1307f9ad => generated 298 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:59:17.351465 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bfce70-5eb1-46a3-accf-85dabcbc7a16 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:17.360799 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bfce70-5eb1-46a3-accf-85dabcbc7a16 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:17.364859 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274dadd-7fe1-409d-8cb8-b16c01b4c337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:17.365435 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274dadd-7fe1-409d-8cb8-b16c01b4c337 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:17.365725 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274dadd-7fe1-409d-8cb8-b16c01b4c337 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:17.366004 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274dadd-7fe1-409d-8cb8-b16c01b4c337 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:17.366734 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274dadd-7fe1-409d-8cb8-b16c01b4c337 admin admin] RBAC: Adding query filter params (scope.project.id=055ce8b96eed43db9c8ea4bb1307f9ad) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:59:17.367029 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274dadd-7fe1-409d-8cb8-b16c01b4c337 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:17.392142 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274dadd-7fe1-409d-8cb8-b16c01b4c337 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:17.398547 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 671/1341] 10.222.0.89 () {56 vars in 1231 bytes} [Wed Oct 27 14:59:17 2021] GET /identity/v3/role_assignments?scope.project.id=055ce8b96eed43db9c8ea4bb1307f9ad => generated 1934 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:59:17.404115 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0d7e5-08fa-40fb-9e06-a3906dfe989b admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:17.413918 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c0d7e5-08fa-40fb-9e06-a3906dfe989b admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:17.417937 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a33183-de22-4fe6-9295-811f8258da12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:17.418705 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a33183-de22-4fe6-9295-811f8258da12 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:17.418986 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a33183-de22-4fe6-9295-811f8258da12 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:17.419258 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a33183-de22-4fe6-9295-811f8258da12 admin admin] PATH_INFO: `/v3/users/7a0c9dc56e154415a03704cd0f1b81e6` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:17.437886 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a33183-de22-4fe6-9295-811f8258da12 admin admin] RBAC: Authorizing `identity:get_user(user_id=7a0c9dc56e154415a03704cd0f1b81e6)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:17.462843 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a33183-de22-4fe6-9295-811f8258da12 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:17.464304 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 671/1342] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:59:17 2021] GET /identity/v3/users/7a0c9dc56e154415a03704cd0f1b81e6 => generated 275 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:59:17.470402 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274dadd-7fe1-409d-8cb8-b16c01b4c337 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:17.479692 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274dadd-7fe1-409d-8cb8-b16c01b4c337 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:17.483790 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27f11b-8924-4738-8e26-144e0af2ed08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:17.484567 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27f11b-8924-4738-8e26-144e0af2ed08 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:17.484855 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27f11b-8924-4738-8e26-144e0af2ed08 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:17.485137 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27f11b-8924-4738-8e26-144e0af2ed08 admin admin] PATH_INFO: `/v3/users/99b1f8461d2e454c9cd6d6d3c9dc623c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:17.486211 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27f11b-8924-4738-8e26-144e0af2ed08 admin admin] RBAC: Authorizing `identity:get_user(user_id=99b1f8461d2e454c9cd6d6d3c9dc623c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:17.511250 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27f11b-8924-4738-8e26-144e0af2ed08 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:17.512699 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 672/1343] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:59:17 2021] GET /identity/v3/users/99b1f8461d2e454c9cd6d6d3c9dc623c => generated 247 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:59:19.546460 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98902d38-402e-448d-94c6-0cce3b648c26 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:19.546976 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98902d38-402e-448d-94c6-0cce3b648c26 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:19.546976 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98902d38-402e-448d-94c6-0cce3b648c26 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:19.548621 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 672/1344] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:59:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:59:19.553890 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f85afe-06c2-4154-9662-7fea99f63ddb None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:19.554367 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f85afe-06c2-4154-9662-7fea99f63ddb None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:19.554470 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f85afe-06c2-4154-9662-7fea99f63ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:19.576809 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-59f85afe-06c2-4154-9662-7fea99f63ddb None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:59:19.578533 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-59f85afe-06c2-4154-9662-7fea99f63ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:59:19.585305 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 673/1345] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:59:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:59:19.606980 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98902d38-402e-448d-94c6-0cce3b648c26 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:19.618406 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98902d38-402e-448d-94c6-0cce3b648c26 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:19.622395 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73117c41-dd9f-4b38-bce6-f3a56a7acb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:19.623148 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73117c41-dd9f-4b38-bce6-f3a56a7acb6c admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:19.623426 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73117c41-dd9f-4b38-bce6-f3a56a7acb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:19.624235 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73117c41-dd9f-4b38-bce6-f3a56a7acb6c admin admin] PATH_INFO: `/v3/projects/64ff4a8a24b34d5fb9629c9202180b1d` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:19.636141 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73117c41-dd9f-4b38-bce6-f3a56a7acb6c admin admin] RBAC: Authorizing `identity:get_project(project_id=64ff4a8a24b34d5fb9629c9202180b1d)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:19.662038 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73117c41-dd9f-4b38-bce6-f3a56a7acb6c admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:19.663603 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 673/1346] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:59:19 2021] GET /identity/v3/projects/64ff4a8a24b34d5fb9629c9202180b1d => generated 311 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:59:19.669601 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f85afe-06c2-4154-9662-7fea99f63ddb None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:19.678595 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f85afe-06c2-4154-9662-7fea99f63ddb None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:19.682759 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7516a23-4767-423c-b339-e0d0c5a83add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:19.683337 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7516a23-4767-423c-b339-e0d0c5a83add admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:19.683657 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7516a23-4767-423c-b339-e0d0c5a83add admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:19.683940 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7516a23-4767-423c-b339-e0d0c5a83add admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:19.684664 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7516a23-4767-423c-b339-e0d0c5a83add admin admin] RBAC: Adding query filter params (scope.project.id=64ff4a8a24b34d5fb9629c9202180b1d) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:59:19.684963 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7516a23-4767-423c-b339-e0d0c5a83add admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:19.711117 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7516a23-4767-423c-b339-e0d0c5a83add admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:19.716471 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 674/1347] 10.222.0.89 () {56 vars in 1231 bytes} [Wed Oct 27 14:59:19 2021] GET /identity/v3/role_assignments?scope.project.id=64ff4a8a24b34d5fb9629c9202180b1d => generated 526 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:59:19.722028 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73117c41-dd9f-4b38-bce6-f3a56a7acb6c admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:19.731318 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73117c41-dd9f-4b38-bce6-f3a56a7acb6c admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:19.735930 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69ad316-6ad8-4219-a01e-2c2a751e62fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:19.736704 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ad316-6ad8-4219-a01e-2c2a751e62fa admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:19.736992 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ad316-6ad8-4219-a01e-2c2a751e62fa admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:19.737270 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69ad316-6ad8-4219-a01e-2c2a751e62fa admin admin] PATH_INFO: `/v3/users/e894d961b69e44e1bb4a315988f44915` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:19.756072 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ad316-6ad8-4219-a01e-2c2a751e62fa admin admin] RBAC: Authorizing `identity:get_user(user_id=e894d961b69e44e1bb4a315988f44915)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:19.782520 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69ad316-6ad8-4219-a01e-2c2a751e62fa admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:19.784018 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 674/1348] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:59:19 2021] GET /identity/v3/users/e894d961b69e44e1bb4a315988f44915 => generated 286 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:59:21.750883 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b32adf-9e5f-4d18-bb83-b6a64f0671db None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:21.751467 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b32adf-9e5f-4d18-bb83-b6a64f0671db None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:21.751467 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b32adf-9e5f-4d18-bb83-b6a64f0671db None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:21.753217 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 675/1349] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:59:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:59:21.758410 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7262bde-b2ac-419f-bf4d-3539d176fe98 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:21.758853 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7262bde-b2ac-419f-bf4d-3539d176fe98 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:21.758980 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7262bde-b2ac-419f-bf4d-3539d176fe98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:21.781381 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-b7262bde-b2ac-419f-bf4d-3539d176fe98 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:59:21.782780 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-b7262bde-b2ac-419f-bf4d-3539d176fe98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:59:21.789550 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 675/1350] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:59:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:59:21.811680 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b32adf-9e5f-4d18-bb83-b6a64f0671db None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:21.823427 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b32adf-9e5f-4d18-bb83-b6a64f0671db None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:21.827316 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b88abd-a96a-4050-8aa0-dfff8554e6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:21.828119 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b88abd-a96a-4050-8aa0-dfff8554e6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:21.828430 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b88abd-a96a-4050-8aa0-dfff8554e6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:21.828705 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b88abd-a96a-4050-8aa0-dfff8554e6a3 admin admin] PATH_INFO: `/v3/projects/788e6d12550a446aa50a0962b825388d` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:21.829763 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b88abd-a96a-4050-8aa0-dfff8554e6a3 admin admin] RBAC: Authorizing `identity:get_project(project_id=788e6d12550a446aa50a0962b825388d)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:21.855062 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b88abd-a96a-4050-8aa0-dfff8554e6a3 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:21.856567 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 676/1351] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:59:21 2021] GET /identity/v3/projects/788e6d12550a446aa50a0962b825388d => generated 344 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:59:21.862758 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7262bde-b2ac-419f-bf4d-3539d176fe98 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:21.871164 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7262bde-b2ac-419f-bf4d-3539d176fe98 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:21.875210 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aefb2c0-a572-42ec-8e79-434e3e67bc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:21.875809 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefb2c0-a572-42ec-8e79-434e3e67bc47 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:21.876095 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefb2c0-a572-42ec-8e79-434e3e67bc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:21.876373 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aefb2c0-a572-42ec-8e79-434e3e67bc47 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:21.877079 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aefb2c0-a572-42ec-8e79-434e3e67bc47 admin admin] RBAC: Adding query filter params (scope.project.id=788e6d12550a446aa50a0962b825388d) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:59:21.877372 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aefb2c0-a572-42ec-8e79-434e3e67bc47 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:21.902223 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aefb2c0-a572-42ec-8e79-434e3e67bc47 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:21.908487 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 676/1352] 10.222.0.89 () {56 vars in 1231 bytes} [Wed Oct 27 14:59:21 2021] GET /identity/v3/role_assignments?scope.project.id=788e6d12550a446aa50a0962b825388d => generated 879 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:59:21.913990 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b88abd-a96a-4050-8aa0-dfff8554e6a3 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:21.923796 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b88abd-a96a-4050-8aa0-dfff8554e6a3 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:21.927940 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84474b85-1e4e-4062-a824-98489e72d53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:21.928714 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84474b85-1e4e-4062-a824-98489e72d53f admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:21.929003 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84474b85-1e4e-4062-a824-98489e72d53f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:21.929283 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84474b85-1e4e-4062-a824-98489e72d53f admin admin] PATH_INFO: `/v3/users/99b1f8461d2e454c9cd6d6d3c9dc623c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:21.930352 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84474b85-1e4e-4062-a824-98489e72d53f admin admin] RBAC: Authorizing `identity:get_user(user_id=99b1f8461d2e454c9cd6d6d3c9dc623c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:21.955272 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84474b85-1e4e-4062-a824-98489e72d53f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:21.956722 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 677/1353] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:59:21 2021] GET /identity/v3/users/99b1f8461d2e454c9cd6d6d3c9dc623c => generated 247 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:59:23.920711 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60faa2f8-7c1f-4948-a948-9efe53f70d3a None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:23.921281 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60faa2f8-7c1f-4948-a948-9efe53f70d3a None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:23.921281 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60faa2f8-7c1f-4948-a948-9efe53f70d3a None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:23.922915 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 677/1354] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:59:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:59:23.928082 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86006f48-21ed-4bef-848f-6f4da5cc85f0 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:23.928487 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86006f48-21ed-4bef-848f-6f4da5cc85f0 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:23.928638 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86006f48-21ed-4bef-848f-6f4da5cc85f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:23.951299 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-86006f48-21ed-4bef-848f-6f4da5cc85f0 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:59:23.953338 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-86006f48-21ed-4bef-848f-6f4da5cc85f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:59:23.960304 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 678/1355] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:59:23 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:59:23.981742 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60faa2f8-7c1f-4948-a948-9efe53f70d3a None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:23.993187 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60faa2f8-7c1f-4948-a948-9efe53f70d3a None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:23.997120 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87ba1c-c73b-4025-a1f2-e3cebbdd6399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:23.997873 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87ba1c-c73b-4025-a1f2-e3cebbdd6399 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:23.998155 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87ba1c-c73b-4025-a1f2-e3cebbdd6399 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:23.998431 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87ba1c-c73b-4025-a1f2-e3cebbdd6399 admin admin] PATH_INFO: `/v3/projects/bb46db492f3b46c2a485e8105b6d02fa` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:24.011012 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87ba1c-c73b-4025-a1f2-e3cebbdd6399 admin admin] RBAC: Authorizing `identity:get_project(project_id=bb46db492f3b46c2a485e8105b6d02fa)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:24.036802 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb87ba1c-c73b-4025-a1f2-e3cebbdd6399 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:24.038317 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 678/1356] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:59:23 2021] GET /identity/v3/projects/bb46db492f3b46c2a485e8105b6d02fa => generated 361 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:59:24.044143 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86006f48-21ed-4bef-848f-6f4da5cc85f0 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:24.052717 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86006f48-21ed-4bef-848f-6f4da5cc85f0 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:24.056839 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc12c1-23c3-4703-8dd7-70a12f38c78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:24.057409 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc12c1-23c3-4703-8dd7-70a12f38c78a admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:24.057694 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc12c1-23c3-4703-8dd7-70a12f38c78a admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:24.057972 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc12c1-23c3-4703-8dd7-70a12f38c78a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:24.058690 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc12c1-23c3-4703-8dd7-70a12f38c78a admin admin] RBAC: Adding query filter params (scope.project.id=bb46db492f3b46c2a485e8105b6d02fa) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:59:24.058987 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc12c1-23c3-4703-8dd7-70a12f38c78a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:24.085306 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc12c1-23c3-4703-8dd7-70a12f38c78a admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:24.090552 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 679/1357] 10.222.0.89 () {56 vars in 1231 bytes} [Wed Oct 27 14:59:24 2021] GET /identity/v3/role_assignments?scope.project.id=bb46db492f3b46c2a485e8105b6d02fa => generated 526 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:59:24.096210 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87ba1c-c73b-4025-a1f2-e3cebbdd6399 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:24.105192 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87ba1c-c73b-4025-a1f2-e3cebbdd6399 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:24.109283 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8786130-02ff-4c52-af2a-c7c9744ef4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:24.110053 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8786130-02ff-4c52-af2a-c7c9744ef4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:24.110337 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8786130-02ff-4c52-af2a-c7c9744ef4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:24.110610 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8786130-02ff-4c52-af2a-c7c9744ef4a0 admin admin] PATH_INFO: `/v3/users/3729fae8d3fb4ec08dbfb9be93562977` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:24.129130 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8786130-02ff-4c52-af2a-c7c9744ef4a0 admin admin] RBAC: Authorizing `identity:get_user(user_id=3729fae8d3fb4ec08dbfb9be93562977)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:24.154671 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8786130-02ff-4c52-af2a-c7c9744ef4a0 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:24.156142 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 679/1358] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:59:24 2021] GET /identity/v3/users/3729fae8d3fb4ec08dbfb9be93562977 => generated 311 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:59:26.128958 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67038d-b050-48a5-8d71-9a6bd968562e None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:26.129503 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67038d-b050-48a5-8d71-9a6bd968562e None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:26.129503 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67038d-b050-48a5-8d71-9a6bd968562e None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:26.131224 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 680/1359] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:59:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:59:26.136349 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5ab26-421e-40c7-9a52-fc79d13e052a None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:26.136775 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5ab26-421e-40c7-9a52-fc79d13e052a None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:26.136926 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5ab26-421e-40c7-9a52-fc79d13e052a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:26.159835 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-6fc5ab26-421e-40c7-9a52-fc79d13e052a None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:59:26.160966 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-6fc5ab26-421e-40c7-9a52-fc79d13e052a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:59:26.167778 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 680/1360] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:59:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 14:59:26.190226 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67038d-b050-48a5-8d71-9a6bd968562e None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:26.203059 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67038d-b050-48a5-8d71-9a6bd968562e None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:26.207061 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ecc65-1a61-488c-baf5-011d9aba9173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:26.207864 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ecc65-1a61-488c-baf5-011d9aba9173 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:26.208151 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ecc65-1a61-488c-baf5-011d9aba9173 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:26.208429 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ecc65-1a61-488c-baf5-011d9aba9173 admin admin] PATH_INFO: `/v3/projects/cdc84d93949743579c8913af0813494a` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:26.220959 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ecc65-1a61-488c-baf5-011d9aba9173 admin admin] RBAC: Authorizing `identity:get_project(project_id=cdc84d93949743579c8913af0813494a)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:26.249545 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9ecc65-1a61-488c-baf5-011d9aba9173 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:26.251166 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 681/1361] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:59:26 2021] GET /identity/v3/projects/cdc84d93949743579c8913af0813494a => generated 302 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:59:26.257114 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5ab26-421e-40c7-9a52-fc79d13e052a None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:26.266464 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5ab26-421e-40c7-9a52-fc79d13e052a None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:26.270602 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11877140-cf1f-4862-b314-071cf4fde13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:26.271181 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11877140-cf1f-4862-b314-071cf4fde13f admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:26.271565 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11877140-cf1f-4862-b314-071cf4fde13f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:26.271868 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11877140-cf1f-4862-b314-071cf4fde13f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:26.272963 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11877140-cf1f-4862-b314-071cf4fde13f admin admin] RBAC: Adding query filter params (scope.project.id=cdc84d93949743579c8913af0813494a) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:59:26.273268 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11877140-cf1f-4862-b314-071cf4fde13f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:26.299877 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11877140-cf1f-4862-b314-071cf4fde13f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:26.306819 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 681/1362] 10.222.0.89 () {56 vars in 1231 bytes} [Wed Oct 27 14:59:26 2021] GET /identity/v3/role_assignments?scope.project.id=cdc84d93949743579c8913af0813494a => generated 1934 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 14:59:26.313398 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ecc65-1a61-488c-baf5-011d9aba9173 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:26.323110 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ecc65-1a61-488c-baf5-011d9aba9173 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:26.327854 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a102732-1841-4bbc-9a49-0dd29e6fc894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:26.328685 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a102732-1841-4bbc-9a49-0dd29e6fc894 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:26.328967 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a102732-1841-4bbc-9a49-0dd29e6fc894 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:26.329240 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a102732-1841-4bbc-9a49-0dd29e6fc894 admin admin] PATH_INFO: `/v3/users/3d6d5c3a153c45f19a677d9902ebcf2a` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:26.348028 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a102732-1841-4bbc-9a49-0dd29e6fc894 admin admin] RBAC: Authorizing `identity:get_user(user_id=3d6d5c3a153c45f19a677d9902ebcf2a)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:26.373865 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a102732-1841-4bbc-9a49-0dd29e6fc894 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:26.375342 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 682/1363] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:59:26 2021] GET /identity/v3/users/3d6d5c3a153c45f19a677d9902ebcf2a => generated 283 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:59:26.381179 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11877140-cf1f-4862-b314-071cf4fde13f admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:26.390296 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11877140-cf1f-4862-b314-071cf4fde13f admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:26.394412 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62697c8b-2abc-47a6-8bb0-15c60d2e40e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:26.395188 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62697c8b-2abc-47a6-8bb0-15c60d2e40e4 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:26.395502 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62697c8b-2abc-47a6-8bb0-15c60d2e40e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:26.395785 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62697c8b-2abc-47a6-8bb0-15c60d2e40e4 admin admin] PATH_INFO: `/v3/users/99b1f8461d2e454c9cd6d6d3c9dc623c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:26.396856 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62697c8b-2abc-47a6-8bb0-15c60d2e40e4 admin admin] RBAC: Authorizing `identity:get_user(user_id=99b1f8461d2e454c9cd6d6d3c9dc623c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:26.423087 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62697c8b-2abc-47a6-8bb0-15c60d2e40e4 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:26.424545 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 682/1364] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:59:26 2021] GET /identity/v3/users/99b1f8461d2e454c9cd6d6d3c9dc623c => generated 247 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:59:28.455933 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31e186-50b3-44b7-b382-d1df92c10566 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:28.456476 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31e186-50b3-44b7-b382-d1df92c10566 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:28.456476 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31e186-50b3-44b7-b382-d1df92c10566 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:28.458184 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 683/1365] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:59:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:59:28.463368 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2f559-2610-44b1-b66c-e029b08d60c7 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:28.463816 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2f559-2610-44b1-b66c-e029b08d60c7 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:28.463954 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2f559-2610-44b1-b66c-e029b08d60c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:28.485879 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-ccb2f559-2610-44b1-b66c-e029b08d60c7 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:59:28.487002 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-ccb2f559-2610-44b1-b66c-e029b08d60c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:59:28.493683 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 683/1366] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:59:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:59:28.517146 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31e186-50b3-44b7-b382-d1df92c10566 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:28.528832 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e31e186-50b3-44b7-b382-d1df92c10566 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:28.533192 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954594c-2bfb-4c4b-a7c3-8aa5b49cfb3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:28.533945 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954594c-2bfb-4c4b-a7c3-8aa5b49cfb3b admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:28.534235 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954594c-2bfb-4c4b-a7c3-8aa5b49cfb3b admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:28.534571 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954594c-2bfb-4c4b-a7c3-8aa5b49cfb3b admin admin] PATH_INFO: `/v3/projects/d9060ccbdeba4080b6b83d9884d2eb3e` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:28.546847 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954594c-2bfb-4c4b-a7c3-8aa5b49cfb3b admin admin] RBAC: Authorizing `identity:get_project(project_id=d9060ccbdeba4080b6b83d9884d2eb3e)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:28.573041 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954594c-2bfb-4c4b-a7c3-8aa5b49cfb3b admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:28.574562 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 684/1367] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:59:28 2021] GET /identity/v3/projects/d9060ccbdeba4080b6b83d9884d2eb3e => generated 311 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:59:28.580946 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2f559-2610-44b1-b66c-e029b08d60c7 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:28.589395 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2f559-2610-44b1-b66c-e029b08d60c7 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:28.593553 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1a0b4-332b-4f67-be88-3db92013ec46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:28.594119 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1a0b4-332b-4f67-be88-3db92013ec46 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:28.594402 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1a0b4-332b-4f67-be88-3db92013ec46 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:28.594676 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1a0b4-332b-4f67-be88-3db92013ec46 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:28.595387 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1a0b4-332b-4f67-be88-3db92013ec46 admin admin] RBAC: Adding query filter params (scope.project.id=d9060ccbdeba4080b6b83d9884d2eb3e) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:59:28.595736 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1a0b4-332b-4f67-be88-3db92013ec46 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:28.621346 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1a0b4-332b-4f67-be88-3db92013ec46 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:28.627644 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 684/1368] 10.222.0.89 () {56 vars in 1231 bytes} [Wed Oct 27 14:59:28 2021] GET /identity/v3/role_assignments?scope.project.id=d9060ccbdeba4080b6b83d9884d2eb3e => generated 877 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:59:28.633374 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954594c-2bfb-4c4b-a7c3-8aa5b49cfb3b admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:28.643224 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954594c-2bfb-4c4b-a7c3-8aa5b49cfb3b admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:28.647424 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b1330-e193-4146-93c2-05ff39e2480d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:28.648241 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b1330-e193-4146-93c2-05ff39e2480d admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:28.648531 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b1330-e193-4146-93c2-05ff39e2480d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:28.648814 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b1330-e193-4146-93c2-05ff39e2480d admin admin] PATH_INFO: `/v3/users/88161958c7b047a288a16c270621dd16` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:28.667478 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b1330-e193-4146-93c2-05ff39e2480d admin admin] RBAC: Authorizing `identity:get_user(user_id=88161958c7b047a288a16c270621dd16)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:28.693899 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b1330-e193-4146-93c2-05ff39e2480d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:28.695373 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 685/1369] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:59:28 2021] GET /identity/v3/users/88161958c7b047a288a16c270621dd16 => generated 286 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:59:28.700910 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1a0b4-332b-4f67-be88-3db92013ec46 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:28.710739 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1a0b4-332b-4f67-be88-3db92013ec46 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:28.714839 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca4120-0794-4b89-bfb7-7ad530c521a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:28.715656 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca4120-0794-4b89-bfb7-7ad530c521a8 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:28.715946 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca4120-0794-4b89-bfb7-7ad530c521a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:28.716225 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca4120-0794-4b89-bfb7-7ad530c521a8 admin admin] PATH_INFO: `/v3/users/3a6bfc723b354784af63c6adfbe4642d` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:28.734981 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca4120-0794-4b89-bfb7-7ad530c521a8 admin admin] RBAC: Authorizing `identity:get_user(user_id=3a6bfc723b354784af63c6adfbe4642d)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:28.760854 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ca4120-0794-4b89-bfb7-7ad530c521a8 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:28.762316 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 685/1370] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:59:28 2021] GET /identity/v3/users/3a6bfc723b354784af63c6adfbe4642d => generated 285 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:59:30.809474 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392e0c1-8124-4dae-bae5-f437f9db5d95 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:30.809961 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392e0c1-8124-4dae-bae5-f437f9db5d95 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:30.810063 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392e0c1-8124-4dae-bae5-f437f9db5d95 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:30.811802 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 686/1371] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:59:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:59:30.817036 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2691c3f-8e54-4dd4-a077-a34845268963 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:30.817475 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2691c3f-8e54-4dd4-a077-a34845268963 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:30.817585 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2691c3f-8e54-4dd4-a077-a34845268963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:30.839451 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-a2691c3f-8e54-4dd4-a077-a34845268963 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:59:30.840589 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-a2691c3f-8e54-4dd4-a077-a34845268963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:59:30.847905 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 686/1372] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:59:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:59:30.870246 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392e0c1-8124-4dae-bae5-f437f9db5d95 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:30.881886 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392e0c1-8124-4dae-bae5-f437f9db5d95 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:30.885897 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9d05e-b1ea-4b70-b6a5-ca40328c51a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:30.886660 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9d05e-b1ea-4b70-b6a5-ca40328c51a6 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:30.886944 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9d05e-b1ea-4b70-b6a5-ca40328c51a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:30.887221 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9d05e-b1ea-4b70-b6a5-ca40328c51a6 admin admin] PATH_INFO: `/v3/projects/da81f6b96b55426c97bf64a1a3847193` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:30.899228 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9d05e-b1ea-4b70-b6a5-ca40328c51a6 admin admin] RBAC: Authorizing `identity:get_project(project_id=da81f6b96b55426c97bf64a1a3847193)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:30.925832 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9d05e-b1ea-4b70-b6a5-ca40328c51a6 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:30.927355 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 687/1373] 10.222.0.89 () {56 vars in 1207 bytes} [Wed Oct 27 14:59:30 2021] GET /identity/v3/projects/da81f6b96b55426c97bf64a1a3847193 => generated 312 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:59:30.933069 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2691c3f-8e54-4dd4-a077-a34845268963 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:30.941648 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2691c3f-8e54-4dd4-a077-a34845268963 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:30.945780 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca434d7-2b34-4955-9b8d-21542da2b250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:30.946350 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca434d7-2b34-4955-9b8d-21542da2b250 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:30.946634 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca434d7-2b34-4955-9b8d-21542da2b250 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:30.946910 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca434d7-2b34-4955-9b8d-21542da2b250 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:30.947664 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca434d7-2b34-4955-9b8d-21542da2b250 admin admin] RBAC: Adding query filter params (scope.project.id=da81f6b96b55426c97bf64a1a3847193) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 14:59:30.947965 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca434d7-2b34-4955-9b8d-21542da2b250 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:30.973367 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca434d7-2b34-4955-9b8d-21542da2b250 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:30.978798 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 687/1374] 10.222.0.89 () {56 vars in 1231 bytes} [Wed Oct 27 14:59:30 2021] GET /identity/v3/role_assignments?scope.project.id=da81f6b96b55426c97bf64a1a3847193 => generated 526 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 14:59:30.984954 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9d05e-b1ea-4b70-b6a5-ca40328c51a6 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:30.997281 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9d05e-b1ea-4b70-b6a5-ca40328c51a6 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:31.001975 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa866d0a-7391-40f7-b76b-c27a9932f086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:31.002764 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa866d0a-7391-40f7-b76b-c27a9932f086 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:31.003050 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa866d0a-7391-40f7-b76b-c27a9932f086 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:31.003329 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa866d0a-7391-40f7-b76b-c27a9932f086 admin admin] PATH_INFO: `/v3/users/7a0c9dc56e154415a03704cd0f1b81e6` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:31.004437 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa866d0a-7391-40f7-b76b-c27a9932f086 admin admin] RBAC: Authorizing `identity:get_user(user_id=7a0c9dc56e154415a03704cd0f1b81e6)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:31.030882 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa866d0a-7391-40f7-b76b-c27a9932f086 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:31.032554 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 688/1375] 10.222.0.89 () {56 vars in 1198 bytes} [Wed Oct 27 14:59:30 2021] GET /identity/v3/users/7a0c9dc56e154415a03704cd0f1b81e6 => generated 275 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 14:59:35.610415 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef33de-6efe-4807-bf45-109633231549 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:35.610976 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef33de-6efe-4807-bf45-109633231549 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:35.610976 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef33de-6efe-4807-bf45-109633231549 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:35.612607 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 688/1376] 10.222.0.89 () {54 vars in 918 bytes} [Wed Oct 27 14:59:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:59:35.617719 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bd680-9bda-4190-8ac1-1791a60fae7c None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:35.618137 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bd680-9bda-4190-8ac1-1791a60fae7c None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:35.618282 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bd680-9bda-4190-8ac1-1791a60fae7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:35.642775 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-3d6bd680-9bda-4190-8ac1-1791a60fae7c None None] MFA Rules not processed for user `fcbab075fd5b4a889c2002639ca9d60a`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:59:35.643915 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-3d6bd680-9bda-4190-8ac1-1791a60fae7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:59:35.651064 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 689/1377] 10.222.0.89 () {58 vars in 1015 bytes} [Wed Oct 27 14:59:35 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:59:35.710110 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57db3d-59d1-420e-81d8-e9501d9bd8e0 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:35.710502 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57db3d-59d1-420e-81d8-e9501d9bd8e0 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:35.710792 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f57db3d-59d1-420e-81d8-e9501d9bd8e0 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:35.712590 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 689/1378] 10.222.0.89 () {54 vars in 918 bytes} [Wed Oct 27 14:59:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:59:35.717350 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f2e52-1996-4037-8dc7-bb6db52f70a2 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:35.717657 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f2e52-1996-4037-8dc7-bb6db52f70a2 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:35.717943 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027f2e52-1996-4037-8dc7-bb6db52f70a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:35.740427 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-027f2e52-1996-4037-8dc7-bb6db52f70a2 None None] MFA Rules not processed for user `01acdb65e66441418d4abe1f0ed804bc`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:59:35.741561 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-027f2e52-1996-4037-8dc7-bb6db52f70a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:59:35.750399 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 690/1379] 10.222.0.89 () {58 vars in 1015 bytes} [Wed Oct 27 14:59:35 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:59:38.100707 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a468c3-a912-4415-896c-09f137f7f66a None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:38.101444 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a468c3-a912-4415-896c-09f137f7f66a None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:38.101444 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a468c3-a912-4415-896c-09f137f7f66a None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:38.103194 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 690/1380] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:59:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:59:38.109324 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5564b-6b95-44b8-ad76-0fd6ef07e6af None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:38.109762 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5564b-6b95-44b8-ad76-0fd6ef07e6af None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:38.109906 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b5564b-6b95-44b8-ad76-0fd6ef07e6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:38.133277 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-e6b5564b-6b95-44b8-ad76-0fd6ef07e6af None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:59:38.134485 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-e6b5564b-6b95-44b8-ad76-0fd6ef07e6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:59:38.141634 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 691/1381] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:59:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:59:38.226878 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a468c3-a912-4415-896c-09f137f7f66a None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:38.240826 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a468c3-a912-4415-896c-09f137f7f66a None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:38.246595 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c8b15-d35f-4bf6-85a3-975431f8c750 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:38.247326 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c8b15-d35f-4bf6-85a3-975431f8c750 service nova] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:38.247697 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c8b15-d35f-4bf6-85a3-975431f8c750 service nova] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:38.247980 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c8b15-d35f-4bf6-85a3-975431f8c750 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:38.256434 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c8b15-d35f-4bf6-85a3-975431f8c750 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:38.282768 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c8b15-d35f-4bf6-85a3-975431f8c750 service nova] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:38.292536 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 691/1382] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:59:38 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:59:39.736502 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe348dc7-8879-4d1e-afa0-f2a2a1d88efe None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:39.737069 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe348dc7-8879-4d1e-afa0-f2a2a1d88efe None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:39.737069 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe348dc7-8879-4d1e-afa0-f2a2a1d88efe None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:39.738747 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 692/1383] 10.222.0.89 () {54 vars in 911 bytes} [Wed Oct 27 14:59:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:59:39.743926 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d84dd-eb14-4c0a-899b-ce12e4cc93e1 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:39.744325 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d84dd-eb14-4c0a-899b-ce12e4cc93e1 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:39.744556 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d84dd-eb14-4c0a-899b-ce12e4cc93e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:39.769024 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-3d4d84dd-eb14-4c0a-899b-ce12e4cc93e1 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:59:39.770246 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-3d4d84dd-eb14-4c0a-899b-ce12e4cc93e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:59:39.777514 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 692/1384] 10.222.0.89 () {58 vars in 1008 bytes} [Wed Oct 27 14:59:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:59:39.924134 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe348dc7-8879-4d1e-afa0-f2a2a1d88efe None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:39.938006 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe348dc7-8879-4d1e-afa0-f2a2a1d88efe None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:39.942743 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fd9ee-d537-4b3c-8a59-806cbe5b7768 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:39.943309 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fd9ee-d537-4b3c-8a59-806cbe5b7768 service nova] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:39.943636 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fd9ee-d537-4b3c-8a59-806cbe5b7768 service nova] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:39.943918 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fd9ee-d537-4b3c-8a59-806cbe5b7768 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:39.952417 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3fd9ee-d537-4b3c-8a59-806cbe5b7768 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:39.976903 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3fd9ee-d537-4b3c-8a59-806cbe5b7768 service nova] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:39.986580 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 693/1385] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:59:39 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:59:41.399921 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c596d-7948-41bb-819b-bbd67e6a0f97 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:41.400509 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c596d-7948-41bb-819b-bbd67e6a0f97 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:41.400509 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688c596d-7948-41bb-819b-bbd67e6a0f97 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:41.402144 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 693/1386] 10.222.0.89 () {54 vars in 911 bytes} [Wed Oct 27 14:59:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:59:41.407740 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130f9b6-1630-441b-8dc0-722a443e145f None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:41.408146 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130f9b6-1630-441b-8dc0-722a443e145f None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:41.408308 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130f9b6-1630-441b-8dc0-722a443e145f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:41.431232 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-d130f9b6-1630-441b-8dc0-722a443e145f None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:59:41.432393 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-d130f9b6-1630-441b-8dc0-722a443e145f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:59:41.439133 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 694/1387] 10.222.0.89 () {58 vars in 1008 bytes} [Wed Oct 27 14:59:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:59:41.583940 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c596d-7948-41bb-819b-bbd67e6a0f97 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:41.596802 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688c596d-7948-41bb-819b-bbd67e6a0f97 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:41.601529 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5c9e9-c86c-4f3e-9bd3-a0748ef811af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:41.602094 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5c9e9-c86c-4f3e-9bd3-a0748ef811af service nova] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:41.602374 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5c9e9-c86c-4f3e-9bd3-a0748ef811af service nova] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:41.602676 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5c9e9-c86c-4f3e-9bd3-a0748ef811af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:41.611048 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5c9e9-c86c-4f3e-9bd3-a0748ef811af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:41.636548 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5c9e9-c86c-4f3e-9bd3-a0748ef811af service nova] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:41.646191 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 694/1388] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:59:41 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:59:43.053733 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fea0d5-dff6-4a00-b128-0c00c9b05229 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:43.054239 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fea0d5-dff6-4a00-b128-0c00c9b05229 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:43.054239 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fea0d5-dff6-4a00-b128-0c00c9b05229 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:43.055923 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 695/1389] 10.222.0.89 () {54 vars in 911 bytes} [Wed Oct 27 14:59:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:59:43.060902 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d551e9-ed7c-4e52-8a05-fcbd4947b50a None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:43.061329 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d551e9-ed7c-4e52-8a05-fcbd4947b50a None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:43.061468 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d551e9-ed7c-4e52-8a05-fcbd4947b50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:43.085216 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-17d551e9-ed7c-4e52-8a05-fcbd4947b50a None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:59:43.086353 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-17d551e9-ed7c-4e52-8a05-fcbd4947b50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:59:43.094361 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 695/1390] 10.222.0.89 () {58 vars in 1008 bytes} [Wed Oct 27 14:59:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:59:43.238745 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fea0d5-dff6-4a00-b128-0c00c9b05229 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:43.253389 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fea0d5-dff6-4a00-b128-0c00c9b05229 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:43.258304 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db2663-5651-4d4c-8e81-a816c23adc71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:43.258868 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db2663-5651-4d4c-8e81-a816c23adc71 service nova] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:43.259148 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db2663-5651-4d4c-8e81-a816c23adc71 service nova] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:43.259454 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db2663-5651-4d4c-8e81-a816c23adc71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:43.267832 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db2663-5651-4d4c-8e81-a816c23adc71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:43.293203 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db2663-5651-4d4c-8e81-a816c23adc71 service nova] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:43.302368 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 696/1391] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:59:43 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:59:44.722791 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452732b1-f467-4028-9b37-c9621a313a08 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:44.723347 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452732b1-f467-4028-9b37-c9621a313a08 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:44.723347 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452732b1-f467-4028-9b37-c9621a313a08 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:44.725027 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 696/1392] 10.222.0.89 () {54 vars in 911 bytes} [Wed Oct 27 14:59:44 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:59:44.729673 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5418bb-d8e9-47ec-bfeb-130c7b362db8 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:44.730122 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5418bb-d8e9-47ec-bfeb-130c7b362db8 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:44.730225 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5418bb-d8e9-47ec-bfeb-130c7b362db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:44.752027 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-2b5418bb-d8e9-47ec-bfeb-130c7b362db8 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:59:44.753169 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-2b5418bb-d8e9-47ec-bfeb-130c7b362db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:59:44.759850 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 697/1393] 10.222.0.89 () {58 vars in 1008 bytes} [Wed Oct 27 14:59:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:59:44.906568 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452732b1-f467-4028-9b37-c9621a313a08 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:44.919716 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452732b1-f467-4028-9b37-c9621a313a08 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:44.924722 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cadd5a-d98a-4aae-8b77-bd5f692a17b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:44.925290 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cadd5a-d98a-4aae-8b77-bd5f692a17b8 service nova] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:44.925572 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cadd5a-d98a-4aae-8b77-bd5f692a17b8 service nova] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:44.925857 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cadd5a-d98a-4aae-8b77-bd5f692a17b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:44.933709 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cadd5a-d98a-4aae-8b77-bd5f692a17b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:44.959527 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cadd5a-d98a-4aae-8b77-bd5f692a17b8 service nova] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:44.968189 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 697/1394] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:59:44 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:59:46.309482 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d93b0-ceb9-4405-a6c0-ee9af95635fc None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:46.309937 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d93b0-ceb9-4405-a6c0-ee9af95635fc None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:46.310075 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d93b0-ceb9-4405-a6c0-ee9af95635fc None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:46.311826 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 698/1395] 10.222.0.89 () {54 vars in 911 bytes} [Wed Oct 27 14:59:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:59:46.316616 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803b29e-0bc3-429f-b5ce-fe028345dbc9 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:46.317038 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803b29e-0bc3-429f-b5ce-fe028345dbc9 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:46.317185 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b803b29e-0bc3-429f-b5ce-fe028345dbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:46.339480 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-b803b29e-0bc3-429f-b5ce-fe028345dbc9 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:59:46.340611 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-b803b29e-0bc3-429f-b5ce-fe028345dbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:59:46.347974 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 698/1396] 10.222.0.89 () {58 vars in 1008 bytes} [Wed Oct 27 14:59:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:59:46.502004 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d93b0-ceb9-4405-a6c0-ee9af95635fc None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:46.515916 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d93b0-ceb9-4405-a6c0-ee9af95635fc None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:46.520918 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a6ea4-8b2f-4b36-9ae9-552ae53c2f16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:46.521535 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a6ea4-8b2f-4b36-9ae9-552ae53c2f16 service nova] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:46.521827 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a6ea4-8b2f-4b36-9ae9-552ae53c2f16 service nova] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:46.522105 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a6ea4-8b2f-4b36-9ae9-552ae53c2f16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:46.530286 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a6ea4-8b2f-4b36-9ae9-552ae53c2f16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:46.555268 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a6ea4-8b2f-4b36-9ae9-552ae53c2f16 service nova] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:46.564633 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 699/1397] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:59:46 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:59:47.894656 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753751f-1709-4ea3-9dc5-0e783f75594f None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:47.895202 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753751f-1709-4ea3-9dc5-0e783f75594f None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:47.895202 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e753751f-1709-4ea3-9dc5-0e783f75594f None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:47.896936 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 699/1398] 10.222.0.89 () {54 vars in 911 bytes} [Wed Oct 27 14:59:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 14:59:47.901770 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e824e-7183-4c4d-9396-7cd50fdd874e None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:47.902189 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e824e-7183-4c4d-9396-7cd50fdd874e None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:47.902380 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e824e-7183-4c4d-9396-7cd50fdd874e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:47.924452 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-069e824e-7183-4c4d-9396-7cd50fdd874e None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:59:47.925561 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-069e824e-7183-4c4d-9396-7cd50fdd874e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:59:47.932262 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 700/1399] 10.222.0.89 () {58 vars in 1008 bytes} [Wed Oct 27 14:59:47 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:59:48.077147 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753751f-1709-4ea3-9dc5-0e783f75594f None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:48.090199 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e753751f-1709-4ea3-9dc5-0e783f75594f None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:48.095507 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922d1f9-d488-4b70-93b3-f8e3e9b69616 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:48.096085 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922d1f9-d488-4b70-93b3-f8e3e9b69616 service nova] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:48.096374 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922d1f9-d488-4b70-93b3-f8e3e9b69616 service nova] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:48.096651 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922d1f9-d488-4b70-93b3-f8e3e9b69616 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:48.105090 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d922d1f9-d488-4b70-93b3-f8e3e9b69616 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:48.130778 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d922d1f9-d488-4b70-93b3-f8e3e9b69616 service nova] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:48.140158 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 700/1400] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:59:48 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:59:49.477277 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f04cd-3246-4b5b-978e-7c5f8c3e3689 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:49.477836 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f04cd-3246-4b5b-978e-7c5f8c3e3689 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:49.477836 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f04cd-3246-4b5b-978e-7c5f8c3e3689 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:49.479554 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 701/1401] 10.222.0.89 () {54 vars in 911 bytes} [Wed Oct 27 14:59:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:59:49.484971 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b09d8-68f7-4769-a660-48cf0c18f2ed None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:49.485430 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b09d8-68f7-4769-a660-48cf0c18f2ed None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:49.485538 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b09d8-68f7-4769-a660-48cf0c18f2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:49.507286 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-de2b09d8-68f7-4769-a660-48cf0c18f2ed None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:59:49.508500 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-de2b09d8-68f7-4769-a660-48cf0c18f2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:59:49.515205 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 701/1402] 10.222.0.89 () {58 vars in 1008 bytes} [Wed Oct 27 14:59:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:59:49.660506 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f04cd-3246-4b5b-978e-7c5f8c3e3689 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:49.674124 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f04cd-3246-4b5b-978e-7c5f8c3e3689 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:49.679120 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587c61b-e8b7-4088-a06b-47945ce0b561 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:49.679761 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587c61b-e8b7-4088-a06b-47945ce0b561 service nova] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:49.680052 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587c61b-e8b7-4088-a06b-47945ce0b561 service nova] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:49.680333 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587c61b-e8b7-4088-a06b-47945ce0b561 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:49.688296 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587c61b-e8b7-4088-a06b-47945ce0b561 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:49.713832 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587c61b-e8b7-4088-a06b-47945ce0b561 service nova] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:49.723107 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 702/1403] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:59:49 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:59:51.064289 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ffab1-ea18-4efc-8212-3514f51f7f20 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:51.064854 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ffab1-ea18-4efc-8212-3514f51f7f20 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:51.064854 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ffab1-ea18-4efc-8212-3514f51f7f20 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:51.066425 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 702/1404] 10.222.0.89 () {54 vars in 911 bytes} [Wed Oct 27 14:59:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:59:51.071251 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31000271-7404-494a-a06d-86348b6d5281 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:51.071709 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31000271-7404-494a-a06d-86348b6d5281 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:51.071859 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31000271-7404-494a-a06d-86348b6d5281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:51.095549 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-31000271-7404-494a-a06d-86348b6d5281 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:59:51.096697 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-31000271-7404-494a-a06d-86348b6d5281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:59:51.103594 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 703/1405] 10.222.0.89 () {58 vars in 1008 bytes} [Wed Oct 27 14:59:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:59:51.250929 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ffab1-ea18-4efc-8212-3514f51f7f20 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:51.264258 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ffab1-ea18-4efc-8212-3514f51f7f20 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:51.269071 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c0076-c6a4-4517-833e-006b8a6d8990 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:51.269638 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c0076-c6a4-4517-833e-006b8a6d8990 service nova] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:51.269925 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c0076-c6a4-4517-833e-006b8a6d8990 service nova] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:51.270206 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c0076-c6a4-4517-833e-006b8a6d8990 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:51.278122 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c0076-c6a4-4517-833e-006b8a6d8990 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:51.303389 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c0076-c6a4-4517-833e-006b8a6d8990 service nova] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:51.312996 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 703/1406] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:59:51 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:59:53.238201 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40009c3c-8aff-4fc5-b152-1093349fe060 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:53.238732 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40009c3c-8aff-4fc5-b152-1093349fe060 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:53.238842 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40009c3c-8aff-4fc5-b152-1093349fe060 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:53.240529 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 704/1407] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:59:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:59:53.246715 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c82fa1-8486-4bde-b2d7-7b464517fb77 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:53.247153 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c82fa1-8486-4bde-b2d7-7b464517fb77 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:53.247418 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c82fa1-8486-4bde-b2d7-7b464517fb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:53.271114 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-a3c82fa1-8486-4bde-b2d7-7b464517fb77 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:59:53.272280 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-a3c82fa1-8486-4bde-b2d7-7b464517fb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:59:53.279084 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 704/1408] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:59:53 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:59:53.317169 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40009c3c-8aff-4fc5-b152-1093349fe060 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:53.328075 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40009c3c-8aff-4fc5-b152-1093349fe060 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:53.331226 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b77586-38e3-483c-8334-8a8a6e0df99f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:53.331827 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b77586-38e3-483c-8334-8a8a6e0df99f service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:53.332110 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b77586-38e3-483c-8334-8a8a6e0df99f service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:53.332385 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b77586-38e3-483c-8334-8a8a6e0df99f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:53.340707 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b77586-38e3-483c-8334-8a8a6e0df99f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:53.366217 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b77586-38e3-483c-8334-8a8a6e0df99f service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:53.374912 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 705/1409] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:59:53 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 14:59:55.471346 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42cc45-8c39-43b9-8e9e-2e0fb36e5e62 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:55.471941 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42cc45-8c39-43b9-8e9e-2e0fb36e5e62 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:55.471941 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42cc45-8c39-43b9-8e9e-2e0fb36e5e62 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:55.473610 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 705/1410] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:59:55 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:59:55.478852 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c729f1-4321-4136-9c83-82cc12414d0f None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:55.479260 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c729f1-4321-4136-9c83-82cc12414d0f None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:55.479416 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c729f1-4321-4136-9c83-82cc12414d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:55.501823 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-e0c729f1-4321-4136-9c83-82cc12414d0f None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:59:55.502976 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-e0c729f1-4321-4136-9c83-82cc12414d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:59:55.509779 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 706/1411] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:59:55 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:59:55.548310 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42cc45-8c39-43b9-8e9e-2e0fb36e5e62 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:55.558996 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42cc45-8c39-43b9-8e9e-2e0fb36e5e62 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:55.562394 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e9bcad-0593-416a-a9dc-0404699713a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:55.562964 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9bcad-0593-416a-a9dc-0404699713a5 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:55.563247 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9bcad-0593-416a-a9dc-0404699713a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:55.563556 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9bcad-0593-416a-a9dc-0404699713a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:55.572056 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9bcad-0593-416a-a9dc-0404699713a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:55.596984 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e9bcad-0593-416a-a9dc-0404699713a5 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:55.605674 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 706/1412] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:59:55 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 14:59:57.981871 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a936a-d48a-4749-b3fd-4ddd5113dab1 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:57.983008 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a936a-d48a-4749-b3fd-4ddd5113dab1 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:57.983193 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a936a-d48a-4749-b3fd-4ddd5113dab1 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:57.984889 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 707/1413] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 14:59:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 14:59:57.990090 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af63be-4935-4f7c-8527-c43cf6060335 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:57.990492 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af63be-4935-4f7c-8527-c43cf6060335 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:57.990662 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5af63be-4935-4f7c-8527-c43cf6060335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:58.012692 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-b5af63be-4935-4f7c-8527-c43cf6060335 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 14:59:58.014315 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-b5af63be-4935-4f7c-8527-c43cf6060335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 14:59:58.021232 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 707/1414] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 14:59:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 14:59:58.059558 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a936a-d48a-4749-b3fd-4ddd5113dab1 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 14:59:58.069949 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a936a-d48a-4749-b3fd-4ddd5113dab1 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 14:59:58.073173 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31200fe9-d2af-48b5-b8ee-c6d796ed377f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 14:59:58.073743 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31200fe9-d2af-48b5-b8ee-c6d796ed377f service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 14:59:58.074030 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31200fe9-d2af-48b5-b8ee-c6d796ed377f service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 14:59:58.074312 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31200fe9-d2af-48b5-b8ee-c6d796ed377f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 14:59:58.083275 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31200fe9-d2af-48b5-b8ee-c6d796ed377f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 14:59:58.108469 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31200fe9-d2af-48b5-b8ee-c6d796ed377f service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 14:59:58.118851 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 708/1415] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 14:59:58 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:00:00.200800 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc2f72-58f6-446c-9ec7-974c63b950d1 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:00.201887 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc2f72-58f6-446c-9ec7-974c63b950d1 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:00.201993 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc2f72-58f6-446c-9ec7-974c63b950d1 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:00.203711 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 708/1416] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 15:00:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:00:00.209012 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b8a3e-5337-4b04-b2ad-174ef1a93d84 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:00.209441 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b8a3e-5337-4b04-b2ad-174ef1a93d84 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:00.209572 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9b8a3e-5337-4b04-b2ad-174ef1a93d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:00.231648 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-aa9b8a3e-5337-4b04-b2ad-174ef1a93d84 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:00:00.233283 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-aa9b8a3e-5337-4b04-b2ad-174ef1a93d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:00:00.240278 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 709/1417] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 15:00:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:00:00.278738 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc2f72-58f6-446c-9ec7-974c63b950d1 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:00:00.290119 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc2f72-58f6-446c-9ec7-974c63b950d1 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:00:00.293384 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3284b2-8af1-4ec0-86df-bef1e2478ec7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:00:00.293951 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3284b2-8af1-4ec0-86df-bef1e2478ec7 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:00.294238 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3284b2-8af1-4ec0-86df-bef1e2478ec7 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:00.295018 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3284b2-8af1-4ec0-86df-bef1e2478ec7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:00.303494 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3284b2-8af1-4ec0-86df-bef1e2478ec7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:00:00.328621 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3284b2-8af1-4ec0-86df-bef1e2478ec7 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:00:00.337448 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 709/1418] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:00:00 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:00:02.418767 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9991a96-0d91-4701-872a-92c0d3df3c61 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:02.419352 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9991a96-0d91-4701-872a-92c0d3df3c61 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:02.419352 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9991a96-0d91-4701-872a-92c0d3df3c61 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:02.421035 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 710/1419] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 15:00:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:00:02.426223 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2530d-f790-41ca-868a-a1b9a0892a84 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:02.426655 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2530d-f790-41ca-868a-a1b9a0892a84 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:02.426819 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2530d-f790-41ca-868a-a1b9a0892a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:02.449263 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-72e2530d-f790-41ca-868a-a1b9a0892a84 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:00:02.450395 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-72e2530d-f790-41ca-868a-a1b9a0892a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:00:02.458009 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 710/1420] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 15:00:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:00:02.499944 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9991a96-0d91-4701-872a-92c0d3df3c61 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:00:02.511091 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9991a96-0d91-4701-872a-92c0d3df3c61 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:00:02.514468 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ffa6c7-99c0-4b49-ba1f-e3c7afde9d6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:00:02.515041 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffa6c7-99c0-4b49-ba1f-e3c7afde9d6f service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:02.515328 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffa6c7-99c0-4b49-ba1f-e3c7afde9d6f service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:02.515648 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ffa6c7-99c0-4b49-ba1f-e3c7afde9d6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:02.524264 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ffa6c7-99c0-4b49-ba1f-e3c7afde9d6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:00:02.549575 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ffa6c7-99c0-4b49-ba1f-e3c7afde9d6f service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:00:02.558331 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 711/1421] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:00:02 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:00:04.609257 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ce50c-23a2-442b-8f95-ef9bfe870131 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:04.609761 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ce50c-23a2-442b-8f95-ef9bfe870131 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:04.609761 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ce50c-23a2-442b-8f95-ef9bfe870131 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:04.611382 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 711/1422] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 15:00:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:00:04.616576 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793a7dc-4233-45f5-a495-d723d3493b90 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:04.617038 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793a7dc-4233-45f5-a495-d723d3493b90 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:04.617141 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793a7dc-4233-45f5-a495-d723d3493b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:04.640210 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-a793a7dc-4233-45f5-a495-d723d3493b90 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:00:04.641342 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-a793a7dc-4233-45f5-a495-d723d3493b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:00:04.648237 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 712/1423] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 15:00:04 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:00:04.686361 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ce50c-23a2-442b-8f95-ef9bfe870131 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:00:04.696560 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ce50c-23a2-442b-8f95-ef9bfe870131 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:00:04.699792 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35675b92-8e8b-4314-ba1b-41873907048f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:00:04.700355 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35675b92-8e8b-4314-ba1b-41873907048f service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:04.700652 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35675b92-8e8b-4314-ba1b-41873907048f service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:04.700922 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35675b92-8e8b-4314-ba1b-41873907048f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:04.709379 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35675b92-8e8b-4314-ba1b-41873907048f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:00:04.735148 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35675b92-8e8b-4314-ba1b-41873907048f service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:00:04.744029 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 712/1424] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:00:04 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:00:06.816254 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc95a4-6651-445a-8100-a062c3e1b8a9 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:06.816762 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc95a4-6651-445a-8100-a062c3e1b8a9 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:06.816867 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc95a4-6651-445a-8100-a062c3e1b8a9 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:06.818642 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 713/1425] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 15:00:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:00:06.823982 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f92fe8-ffaa-463d-bf5d-4e77ea1f1988 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:06.824407 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f92fe8-ffaa-463d-bf5d-4e77ea1f1988 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:06.824545 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f92fe8-ffaa-463d-bf5d-4e77ea1f1988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:06.846986 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-b6f92fe8-ffaa-463d-bf5d-4e77ea1f1988 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:00:06.848143 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-b6f92fe8-ffaa-463d-bf5d-4e77ea1f1988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:00:06.854868 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 713/1426] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 15:00:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:00:06.892357 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc95a4-6651-445a-8100-a062c3e1b8a9 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:00:06.902648 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc95a4-6651-445a-8100-a062c3e1b8a9 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:00:06.905933 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07419d6-b3ce-43da-8ea6-890e6778e3e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:00:06.906511 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07419d6-b3ce-43da-8ea6-890e6778e3e5 service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:06.906801 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07419d6-b3ce-43da-8ea6-890e6778e3e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:06.907083 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07419d6-b3ce-43da-8ea6-890e6778e3e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:06.915888 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07419d6-b3ce-43da-8ea6-890e6778e3e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:00:06.941022 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07419d6-b3ce-43da-8ea6-890e6778e3e5 service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:00:06.949777 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 714/1427] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:00:06 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:00:08.931195 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5c658-68e4-4a72-b376-c033d2d3dc40 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:08.931764 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5c658-68e4-4a72-b376-c033d2d3dc40 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:08.931764 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5c658-68e4-4a72-b376-c033d2d3dc40 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:08.933477 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 714/1428] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 15:00:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:00:08.939047 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3216a1-d261-4700-b954-9bee92026e35 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:08.939479 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3216a1-d261-4700-b954-9bee92026e35 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:08.939671 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3216a1-d261-4700-b954-9bee92026e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:08.962472 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-9d3216a1-d261-4700-b954-9bee92026e35 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:00:08.963655 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-9d3216a1-d261-4700-b954-9bee92026e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:00:08.970547 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 715/1429] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 15:00:08 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:00:09.007785 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5c658-68e4-4a72-b376-c033d2d3dc40 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:00:09.018534 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5c658-68e4-4a72-b376-c033d2d3dc40 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:00:09.021794 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191e3d7-6f37-4a03-9c13-06efee311b13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:00:09.022361 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191e3d7-6f37-4a03-9c13-06efee311b13 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:09.022649 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191e3d7-6f37-4a03-9c13-06efee311b13 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:09.022925 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191e3d7-6f37-4a03-9c13-06efee311b13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:09.031347 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191e3d7-6f37-4a03-9c13-06efee311b13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:00:09.056212 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191e3d7-6f37-4a03-9c13-06efee311b13 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:00:09.065330 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 715/1430] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:00:09 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:00:11.074641 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627dab7-c859-457c-bd83-94690c479476 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:11.075164 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627dab7-c859-457c-bd83-94690c479476 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:11.075164 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627dab7-c859-457c-bd83-94690c479476 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:11.077376 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 716/1431] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 15:00:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:00:11.082619 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b632317-ce0c-436d-875c-dd05cd574490 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:11.083065 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b632317-ce0c-436d-875c-dd05cd574490 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:11.083190 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b632317-ce0c-436d-875c-dd05cd574490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:11.105701 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-6b632317-ce0c-436d-875c-dd05cd574490 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:00:11.106865 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-6b632317-ce0c-436d-875c-dd05cd574490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:00:11.113704 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 716/1432] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 15:00:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:00:11.151057 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627dab7-c859-457c-bd83-94690c479476 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:00:11.161366 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1627dab7-c859-457c-bd83-94690c479476 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:00:11.164854 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72705d9b-3761-4381-a623-777b47959e5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:00:11.165415 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72705d9b-3761-4381-a623-777b47959e5f service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:11.165699 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72705d9b-3761-4381-a623-777b47959e5f service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:11.165979 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72705d9b-3761-4381-a623-777b47959e5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:11.174518 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72705d9b-3761-4381-a623-777b47959e5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:00:11.199592 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72705d9b-3761-4381-a623-777b47959e5f service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:00:11.208906 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 717/1433] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:00:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:00:13.214122 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37deba25-6965-466d-9e85-821243b20604 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:13.214688 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37deba25-6965-466d-9e85-821243b20604 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:13.214688 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37deba25-6965-466d-9e85-821243b20604 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:13.217047 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 717/1434] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 15:00:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:00:13.222433 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f0cc3-5e60-4c89-a180-7f994a149d5d None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:13.222852 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f0cc3-5e60-4c89-a180-7f994a149d5d None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:13.222988 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f0cc3-5e60-4c89-a180-7f994a149d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:13.244683 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-4d5f0cc3-5e60-4c89-a180-7f994a149d5d None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:00:13.245807 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-4d5f0cc3-5e60-4c89-a180-7f994a149d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:00:13.252687 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 718/1435] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 15:00:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:00:13.289702 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37deba25-6965-466d-9e85-821243b20604 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:00:13.300102 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37deba25-6965-466d-9e85-821243b20604 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:00:13.303346 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c379d-826b-4085-968b-7970652cf00d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:00:13.303944 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c379d-826b-4085-968b-7970652cf00d service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:13.304235 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c379d-826b-4085-968b-7970652cf00d service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:13.304518 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c379d-826b-4085-968b-7970652cf00d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:13.313215 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c379d-826b-4085-968b-7970652cf00d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:00:13.338520 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c379d-826b-4085-968b-7970652cf00d service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:00:13.348076 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 718/1436] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:00:13 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:00:25.347797 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108530b-6b93-4080-8d81-deecd9c22389 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:25.348380 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108530b-6b93-4080-8d81-deecd9c22389 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:25.348380 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108530b-6b93-4080-8d81-deecd9c22389 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:25.350015 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 719/1437] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 15:00:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:00:25.355044 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56df9b5-c94c-4bf5-a1e4-3d85f200537e None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:25.355483 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56df9b5-c94c-4bf5-a1e4-3d85f200537e None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:25.355650 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56df9b5-c94c-4bf5-a1e4-3d85f200537e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:25.378290 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-d56df9b5-c94c-4bf5-a1e4-3d85f200537e None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:00:25.379421 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-d56df9b5-c94c-4bf5-a1e4-3d85f200537e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:00:25.386218 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 719/1438] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 15:00:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:00:25.431073 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108530b-6b93-4080-8d81-deecd9c22389 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:00:25.441411 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108530b-6b93-4080-8d81-deecd9c22389 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:00:25.444712 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eeda18-9de1-4558-ac01-cd82dff105a0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c345fc642242469346303afbeda2f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:00:25.445276 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eeda18-9de1-4558-ac01-cd82dff105a0 service glance] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:25.445564 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eeda18-9de1-4558-ac01-cd82dff105a0 service glance] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:25.445844 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eeda18-9de1-4558-ac01-cd82dff105a0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:25.454294 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eeda18-9de1-4558-ac01-cd82dff105a0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:00:25.479368 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eeda18-9de1-4558-ac01-cd82dff105a0 service glance] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:00:25.488766 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 720/1439] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:00:25 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:00:27.532102 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68eaf83-8672-43d6-a4c2-990696439459 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:27.532623 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68eaf83-8672-43d6-a4c2-990696439459 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:27.532623 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68eaf83-8672-43d6-a4c2-990696439459 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:27.534262 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 720/1440] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 15:00:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 15:00:27.539871 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb7959-d204-437e-b173-d44852baa063 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:27.540307 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb7959-d204-437e-b173-d44852baa063 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:27.540442 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb7959-d204-437e-b173-d44852baa063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:27.564820 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-4acb7959-d204-437e-b173-d44852baa063 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:00:27.565944 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-4acb7959-d204-437e-b173-d44852baa063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:00:27.572736 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 721/1441] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 15:00:27 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:00:27.595167 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68eaf83-8672-43d6-a4c2-990696439459 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:00:27.607327 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68eaf83-8672-43d6-a4c2-990696439459 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:00:27.611427 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac82486-44d6-4b3f-8c20-489bd92c2965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:00:27.612025 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac82486-44d6-4b3f-8c20-489bd92c2965 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:27.612317 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac82486-44d6-4b3f-8c20-489bd92c2965 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:27.612598 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac82486-44d6-4b3f-8c20-489bd92c2965 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:27.613290 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac82486-44d6-4b3f-8c20-489bd92c2965 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:00:27.638291 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac82486-44d6-4b3f-8c20-489bd92c2965 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:00:27.652838 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 721/1442] 10.222.0.89 () {56 vars in 1108 bytes} [Wed Oct 27 15:00:27 2021] GET /identity/v3/projects => generated 2553 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:00:29.153856 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64914910-43c8-4b80-9ec6-2d9cdf9ec14c None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:29.154391 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64914910-43c8-4b80-9ec6-2d9cdf9ec14c None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:29.154507 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64914910-43c8-4b80-9ec6-2d9cdf9ec14c None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:29.156109 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 722/1443] 10.222.0.89 () {54 vars in 911 bytes} [Wed Oct 27 15:00:29 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:00:29.160757 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c9296-7925-40c4-92fa-72f84d36dae1 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:29.161152 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c9296-7925-40c4-92fa-72f84d36dae1 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:29.161333 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c9296-7925-40c4-92fa-72f84d36dae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:29.183152 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-b26c9296-7925-40c4-92fa-72f84d36dae1 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:00:29.184322 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-b26c9296-7925-40c4-92fa-72f84d36dae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:00:29.191860 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 722/1444] 10.222.0.89 () {58 vars in 1008 bytes} [Wed Oct 27 15:00:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:00:29.338562 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64914910-43c8-4b80-9ec6-2d9cdf9ec14c None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:00:29.352352 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64914910-43c8-4b80-9ec6-2d9cdf9ec14c None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:00:29.357787 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb833a-23ab-4337-9de5-5d2ed3c67848 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:00:29.358348 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb833a-23ab-4337-9de5-5d2ed3c67848 service nova] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:29.358633 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb833a-23ab-4337-9de5-5d2ed3c67848 service nova] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:29.358908 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb833a-23ab-4337-9de5-5d2ed3c67848 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:29.366639 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb833a-23ab-4337-9de5-5d2ed3c67848 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:00:29.391177 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb833a-23ab-4337-9de5-5d2ed3c67848 service nova] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:00:29.399955 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 723/1445] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:00:29 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:00:31.397635 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb6b11-ecf0-40ba-9a6e-4a13e92250ba None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:31.398283 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb6b11-ecf0-40ba-9a6e-4a13e92250ba None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:31.398283 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb6b11-ecf0-40ba-9a6e-4a13e92250ba None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:31.399909 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 723/1446] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 15:00:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:00:31.405466 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09c1ff-8302-4c08-baba-22288f49d840 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:31.405877 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09c1ff-8302-4c08-baba-22288f49d840 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:31.406029 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc09c1ff-8302-4c08-baba-22288f49d840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:31.428620 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-bc09c1ff-8302-4c08-baba-22288f49d840 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:00:31.429746 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-bc09c1ff-8302-4c08-baba-22288f49d840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:00:31.436618 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 724/1447] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 15:00:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:00:31.472104 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb6b11-ecf0-40ba-9a6e-4a13e92250ba None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:00:31.483034 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb6b11-ecf0-40ba-9a6e-4a13e92250ba None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:00:31.486296 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9fe402-6fe0-4cf3-b92d-d68e9e4a5570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:00:31.486859 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fe402-6fe0-4cf3-b92d-d68e9e4a5570 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:31.487146 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fe402-6fe0-4cf3-b92d-d68e9e4a5570 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:31.487422 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9fe402-6fe0-4cf3-b92d-d68e9e4a5570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:31.495976 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fe402-6fe0-4cf3-b92d-d68e9e4a5570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:00:31.520550 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9fe402-6fe0-4cf3-b92d-d68e9e4a5570 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:00:31.529767 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 724/1448] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:00:31 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:00:33.525494 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e4510-6c86-40a3-b5ff-23aef4501a9c None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:33.526023 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e4510-6c86-40a3-b5ff-23aef4501a9c None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:33.526134 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e4510-6c86-40a3-b5ff-23aef4501a9c None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:33.527781 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 725/1449] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 15:00:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:00:33.533060 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38783c6e-b641-4bed-8d7c-1f1fd1e05969 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:33.533455 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38783c6e-b641-4bed-8d7c-1f1fd1e05969 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:33.533552 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38783c6e-b641-4bed-8d7c-1f1fd1e05969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:33.556067 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-38783c6e-b641-4bed-8d7c-1f1fd1e05969 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:00:33.557178 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-38783c6e-b641-4bed-8d7c-1f1fd1e05969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:00:33.564663 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 725/1450] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 15:00:33 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:00:33.603247 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e4510-6c86-40a3-b5ff-23aef4501a9c None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:00:33.614203 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e4510-6c86-40a3-b5ff-23aef4501a9c None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:00:33.617436 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102c881-4ab5-4750-91bf-c0271594bcf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:00:33.618006 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102c881-4ab5-4750-91bf-c0271594bcf9 service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:33.618295 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102c881-4ab5-4750-91bf-c0271594bcf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:33.618910 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102c881-4ab5-4750-91bf-c0271594bcf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:33.627481 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e102c881-4ab5-4750-91bf-c0271594bcf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:00:33.651992 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e102c881-4ab5-4750-91bf-c0271594bcf9 service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:00:33.661335 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 726/1451] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:00:33 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:00:35.741911 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2087bef-ea43-4f80-a6e6-aadb8a486028 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:35.742469 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2087bef-ea43-4f80-a6e6-aadb8a486028 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:35.742469 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2087bef-ea43-4f80-a6e6-aadb8a486028 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:35.744734 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 726/1452] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 15:00:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:00:35.750185 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1ebc3-12b9-43db-bc4a-a758018e5c07 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:35.750621 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1ebc3-12b9-43db-bc4a-a758018e5c07 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:35.750755 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b1ebc3-12b9-43db-bc4a-a758018e5c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:35.773390 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-f1b1ebc3-12b9-43db-bc4a-a758018e5c07 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:00:35.774545 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-f1b1ebc3-12b9-43db-bc4a-a758018e5c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:00:35.781849 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 727/1453] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 15:00:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:00:35.822616 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2087bef-ea43-4f80-a6e6-aadb8a486028 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:00:35.832805 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2087bef-ea43-4f80-a6e6-aadb8a486028 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:00:35.835986 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80abf27-d0da-4ae6-abed-74e6acdf9c69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:00:35.836555 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80abf27-d0da-4ae6-abed-74e6acdf9c69 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:35.836842 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80abf27-d0da-4ae6-abed-74e6acdf9c69 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:35.837118 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80abf27-d0da-4ae6-abed-74e6acdf9c69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:35.846161 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80abf27-d0da-4ae6-abed-74e6acdf9c69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:00:35.871340 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80abf27-d0da-4ae6-abed-74e6acdf9c69 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:00:35.880936 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 727/1454] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:00:35 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:00:38.189254 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604382d3-7e24-4426-8f46-bb8d59dc22dc None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:38.189822 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604382d3-7e24-4426-8f46-bb8d59dc22dc None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:38.189822 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604382d3-7e24-4426-8f46-bb8d59dc22dc None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:38.191502 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 728/1455] 10.222.0.89 () {54 vars in 926 bytes} [Wed Oct 27 15:00:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:00:38.196585 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c1a40-003b-490e-a39b-00df6469c982 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:38.196967 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c1a40-003b-490e-a39b-00df6469c982 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:38.197153 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c1a40-003b-490e-a39b-00df6469c982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:38.221360 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-be9c1a40-003b-490e-a39b-00df6469c982 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:00:38.222499 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-be9c1a40-003b-490e-a39b-00df6469c982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:00:38.229395 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 728/1456] 10.222.0.89 () {58 vars in 1023 bytes} [Wed Oct 27 15:00:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:00:38.268781 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604382d3-7e24-4426-8f46-bb8d59dc22dc None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:00:38.279613 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604382d3-7e24-4426-8f46-bb8d59dc22dc None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:00:38.282784 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115dc707-21e9-4ba7-8cda-955ba7ed6be4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:00:38.283505 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dc707-21e9-4ba7-8cda-955ba7ed6be4 service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:00:38.283792 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dc707-21e9-4ba7-8cda-955ba7ed6be4 service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:00:38.284064 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115dc707-21e9-4ba7-8cda-955ba7ed6be4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:00:38.293314 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115dc707-21e9-4ba7-8cda-955ba7ed6be4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:00:38.319393 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115dc707-21e9-4ba7-8cda-955ba7ed6be4 service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:00:38.329002 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 729/1457] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:00:38 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:01:39.123048 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b1278-3258-4c3f-8a02-f1ccf4c564af None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:01:39.123682 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b1278-3258-4c3f-8a02-f1ccf4c564af None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:01:39.123682 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b1278-3258-4c3f-8a02-f1ccf4c564af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:01:39.145096 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-4c0b1278-3258-4c3f-8a02-f1ccf4c564af None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:01:39.146226 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-4c0b1278-3258-4c3f-8a02-f1ccf4c564af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:01:39.153991 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 729/1458] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:01:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:01:39.162329 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77501075-2b25-4b4d-bf00-dd736b48e124 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:01:39.162860 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77501075-2b25-4b4d-bf00-dd736b48e124 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:01:39.162964 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77501075-2b25-4b4d-bf00-dd736b48e124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:01:39.185606 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-77501075-2b25-4b4d-bf00-dd736b48e124 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:01:39.186736 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-77501075-2b25-4b4d-bf00-dd736b48e124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:01:39.193516 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 730/1459] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:01:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:01:39.198035 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b1278-3258-4c3f-8a02-f1ccf4c564af None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:01:39.206999 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b1278-3258-4c3f-8a02-f1ccf4c564af None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:01:39.211603 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128e9f1-098d-4268-bb86-e8fb8b5cc7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:01:39.212200 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128e9f1-098d-4268-bb86-e8fb8b5cc7fc admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:01:39.212489 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128e9f1-098d-4268-bb86-e8fb8b5cc7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:01:39.212798 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128e9f1-098d-4268-bb86-e8fb8b5cc7fc admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:01:39.214060 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128e9f1-098d-4268-bb86-e8fb8b5cc7fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:01:39.214363 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128e9f1-098d-4268-bb86-e8fb8b5cc7fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:01:39.239666 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128e9f1-098d-4268-bb86-e8fb8b5cc7fc admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:01:39.252766 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 730/1460] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:01:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 15:01:39.261824 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77501075-2b25-4b4d-bf00-dd736b48e124 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:01:39.270757 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77501075-2b25-4b4d-bf00-dd736b48e124 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:01:39.274919 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd4d42-464f-4ef0-abbc-e26ba8154ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:01:39.275538 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd4d42-464f-4ef0-abbc-e26ba8154ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:01:39.275823 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd4d42-464f-4ef0-abbc-e26ba8154ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:01:39.276585 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd4d42-464f-4ef0-abbc-e26ba8154ae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:01:39.277230 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd4d42-464f-4ef0-abbc-e26ba8154ae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:01:39.302888 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dd4d42-464f-4ef0-abbc-e26ba8154ae7 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:01:39.339916 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 731/1461] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:01:39 2021] POST /identity/v3/projects => generated 379 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:01:39.344232 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128e9f1-098d-4268-bb86-e8fb8b5cc7fc admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:01:39.353877 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128e9f1-098d-4268-bb86-e8fb8b5cc7fc admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:01:39.414523 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee3283-ab92-4b2f-8667-fd31d964f688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:01:39.415122 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee3283-ab92-4b2f-8667-fd31d964f688 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:01:39.415409 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee3283-ab92-4b2f-8667-fd31d964f688 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:01:39.415720 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee3283-ab92-4b2f-8667-fd31d964f688 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:01:39.416363 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee3283-ab92-4b2f-8667-fd31d964f688 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:01:39.441366 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee3283-ab92-4b2f-8667-fd31d964f688 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:01:39.460599 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 731/1462] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:01:39 2021] POST /identity/v3/users => generated 290 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:01:39.465293 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd4d42-464f-4ef0-abbc-e26ba8154ae7 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:01:39.474849 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dd4d42-464f-4ef0-abbc-e26ba8154ae7 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:01:39.478901 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0572ac-a45b-4e2c-a31e-bcfe873662d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:01:39.479521 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0572ac-a45b-4e2c-a31e-bcfe873662d0 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:01:39.479813 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0572ac-a45b-4e2c-a31e-bcfe873662d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:01:39.480093 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0572ac-a45b-4e2c-a31e-bcfe873662d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:01:39.480781 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0572ac-a45b-4e2c-a31e-bcfe873662d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:01:39.505537 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0572ac-a45b-4e2c-a31e-bcfe873662d0 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:01:39.516158 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 732/1463] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:01:39 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:01:39.520325 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee3283-ab92-4b2f-8667-fd31d964f688 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:01:39.530145 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee3283-ab92-4b2f-8667-fd31d964f688 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:01:39.534272 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd4b3e-504a-4363-9843-967f6001247c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:01:39.535084 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd4b3e-504a-4363-9843-967f6001247c admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:01:39.535369 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd4b3e-504a-4363-9843-967f6001247c admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:01:39.535689 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd4b3e-504a-4363-9843-967f6001247c admin admin] PATH_INFO: `/v3/projects/e93f105b53d8486f88009ee27669c6b7/users/ea8a6ca728d24e0faaba920258cc061c/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:01:39.555284 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd4b3e-504a-4363-9843-967f6001247c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e93f105b53d8486f88009ee27669c6b7, user_id=ea8a6ca728d24e0faaba920258cc061c, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:01:39.582112 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd4b3e-504a-4363-9843-967f6001247c admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:01:39.595352 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 732/1464] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:01:39 2021] PUT /identity/v3/projects/e93f105b53d8486f88009ee27669c6b7/users/ea8a6ca728d24e0faaba920258cc061c/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:01:39.607230 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67fad1-9516-4a95-84de-e8859932eb3f None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:01:39.607555 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67fad1-9516-4a95-84de-e8859932eb3f None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:01:39.607923 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67fad1-9516-4a95-84de-e8859932eb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:01:39.643422 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-2a67fad1-9516-4a95-84de-e8859932eb3f None None] MFA Rules not processed for user `ea8a6ca728d24e0faaba920258cc061c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:01:39.644586 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-2a67fad1-9516-4a95-84de-e8859932eb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:01:39.713792 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 733/1465] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:01:39 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:01:39.723794 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd4b3e-504a-4363-9843-967f6001247c admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:01:39.799055 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd4b3e-504a-4363-9843-967f6001247c admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:01:39.803985 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8379c6c-1f21-4e5e-a2f3-a5dc8633888a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:01:39.804568 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8379c6c-1f21-4e5e-a2f3-a5dc8633888a service nova] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:01:39.804858 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8379c6c-1f21-4e5e-a2f3-a5dc8633888a service nova] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:01:39.805139 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8379c6c-1f21-4e5e-a2f3-a5dc8633888a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:01:39.813420 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8379c6c-1f21-4e5e-a2f3-a5dc8633888a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:01:39.838691 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8379c6c-1f21-4e5e-a2f3-a5dc8633888a service nova] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:01:39.847087 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 733/1466] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:01:39 2021] GET /identity/v3/auth/tokens => generated 3686 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:01:39.922876 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77180b-494d-4933-943c-225e4942b137 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:01:39.923201 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77180b-494d-4933-943c-225e4942b137 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:01:39.923510 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77180b-494d-4933-943c-225e4942b137 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:01:39.925132 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 734/1467] 10.222.0.89 () {52 vars in 829 bytes} [Wed Oct 27 15:01:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:01:39.928690 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8379c6c-1f21-4e5e-a2f3-a5dc8633888a service nova] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:01:39.996977 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8379c6c-1f21-4e5e-a2f3-a5dc8633888a service nova] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:01:40.001058 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe39ea9-85bf-42a6-9ddc-1f4739f53093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:01:40.001851 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe39ea9-85bf-42a6-9ddc-1f4739f53093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:01:40.002139 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe39ea9-85bf-42a6-9ddc-1f4739f53093 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:01:40.002421 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe39ea9-85bf-42a6-9ddc-1f4739f53093 admin admin] PATH_INFO: `/v3/users/ea8a6ca728d24e0faaba920258cc061c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:01:40.003527 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe39ea9-85bf-42a6-9ddc-1f4739f53093 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea8a6ca728d24e0faaba920258cc061c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:01:40.029370 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING py.warnings [None req-bbe39ea9-85bf-42a6-9ddc-1f4739f53093 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:01:40.029370 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: warnings.warn(msg) Oct 27 15:01:40.029370 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: Oct 27 15:01:40.030618 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe39ea9-85bf-42a6-9ddc-1f4739f53093 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:01:40.091236 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-bbe39ea9-85bf-42a6-9ddc-1f4739f53093 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea8a6ca728d24e0faaba920258cc061c'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:01:40.109043 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-bbe39ea9-85bf-42a6-9ddc-1f4739f53093 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea8a6ca728d24e0faaba920258cc061c'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:01:40.109677 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-bbe39ea9-85bf-42a6-9ddc-1f4739f53093 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea8a6ca728d24e0faaba920258cc061c'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:01:40.117305 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-bbe39ea9-85bf-42a6-9ddc-1f4739f53093 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea8a6ca728d24e0faaba920258cc061c'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:01:40.126876 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-bbe39ea9-85bf-42a6-9ddc-1f4739f53093 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea8a6ca728d24e0faaba920258cc061c'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:01:40.132725 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 734/1468] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:01:39 2021] DELETE /identity/v3/users/ea8a6ca728d24e0faaba920258cc061c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:01:40.137800 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9069f16-7975-4b36-9449-26db2e3717f7 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:01:40.138096 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9069f16-7975-4b36-9449-26db2e3717f7 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:01:40.138378 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9069f16-7975-4b36-9449-26db2e3717f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:01:40.160088 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-c9069f16-7975-4b36-9449-26db2e3717f7 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:01:40.161467 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-c9069f16-7975-4b36-9449-26db2e3717f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:01:40.223309 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 735/1469] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:01:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:01:40.233259 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe39ea9-85bf-42a6-9ddc-1f4739f53093 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:01:40.234578 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-bbe39ea9-85bf-42a6-9ddc-1f4739f53093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:01:40.297159 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe39ea9-85bf-42a6-9ddc-1f4739f53093 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:01:40.300432 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69335e-81a5-405d-8f33-2ad126cf908e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:01:40.301008 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69335e-81a5-405d-8f33-2ad126cf908e service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:01:40.301290 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69335e-81a5-405d-8f33-2ad126cf908e service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:01:40.301565 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69335e-81a5-405d-8f33-2ad126cf908e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:01:40.310503 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69335e-81a5-405d-8f33-2ad126cf908e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:01:40.335489 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69335e-81a5-405d-8f33-2ad126cf908e service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:01:40.344940 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 735/1470] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:01:40 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:01:40.734305 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9069f16-7975-4b36-9449-26db2e3717f7 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:01:40.735929 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-c9069f16-7975-4b36-9449-26db2e3717f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:01:40.749163 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9069f16-7975-4b36-9449-26db2e3717f7 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:01:40.753341 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6109cf-3bef-48ae-8977-7635d72358a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:01:40.754126 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6109cf-3bef-48ae-8977-7635d72358a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:01:40.754414 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6109cf-3bef-48ae-8977-7635d72358a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:01:40.754697 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6109cf-3bef-48ae-8977-7635d72358a9 admin admin] PATH_INFO: `/v3/projects/e93f105b53d8486f88009ee27669c6b7` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:01:40.755799 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6109cf-3bef-48ae-8977-7635d72358a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e93f105b53d8486f88009ee27669c6b7)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:01:40.780944 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING py.warnings [None req-9b6109cf-3bef-48ae-8977-7635d72358a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:01:40.780944 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: warnings.warn(msg) Oct 27 15:01:40.780944 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: Oct 27 15:01:40.782072 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6109cf-3bef-48ae-8977-7635d72358a9 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:01:40.837787 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-9b6109cf-3bef-48ae-8977-7635d72358a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e93f105b53d8486f88009ee27669c6b7', 'request_id': 'req-9b6109cf-3bef-48ae-8977-7635d72358a9'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:01:40.843028 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-9b6109cf-3bef-48ae-8977-7635d72358a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e93f105b53d8486f88009ee27669c6b7', 'request_id': 'req-9b6109cf-3bef-48ae-8977-7635d72358a9'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:01:40.854568 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-9b6109cf-3bef-48ae-8977-7635d72358a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e93f105b53d8486f88009ee27669c6b7', 'request_id': 'req-9b6109cf-3bef-48ae-8977-7635d72358a9'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:01:40.868397 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-9b6109cf-3bef-48ae-8977-7635d72358a9 admin admin] The token cache is being invalidate because project e93f105b53d8486f88009ee27669c6b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:01:40.868686 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-9b6109cf-3bef-48ae-8977-7635d72358a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:01:40.869273 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-9b6109cf-3bef-48ae-8977-7635d72358a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:01:40.871322 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 736/1471] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:01:40 2021] DELETE /identity/v3/projects/e93f105b53d8486f88009ee27669c6b7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:03:10.740375 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e716a-e2b9-4919-bf6b-1237dc53f905 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:03:10.740958 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e716a-e2b9-4919-bf6b-1237dc53f905 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:03:10.740958 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e716a-e2b9-4919-bf6b-1237dc53f905 None None] PATH_INFO: `/v3` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:03:10.742158 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 736/1472] 10.222.0.91 () {54 vars in 925 bytes} [Wed Oct 27 15:03:10 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:03:10.760555 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb05d5-eab9-4bd9-aa5c-8d3e26580393 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:03:10.761108 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb05d5-eab9-4bd9-aa5c-8d3e26580393 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:03:10.761214 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb05d5-eab9-4bd9-aa5c-8d3e26580393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:03:10.784402 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-55fb05d5-eab9-4bd9-aa5c-8d3e26580393 None None] MFA Rules not processed for user `fcbab075fd5b4a889c2002639ca9d60a`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:03:10.785792 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-55fb05d5-eab9-4bd9-aa5c-8d3e26580393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:03:10.853858 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 737/1473] 10.222.0.91 () {58 vars in 1015 bytes} [Wed Oct 27 15:03:10 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:03:11.193428 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e769b2-b475-4986-8c75-9405e8b8e369 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:03:11.193722 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e769b2-b475-4986-8c75-9405e8b8e369 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:03:11.194003 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e769b2-b475-4986-8c75-9405e8b8e369 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:03:11.195707 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 737/1474] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 27 15:03:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:03:11.200909 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d18482-95d4-4cb7-ad74-fc299ab61c9f None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:03:11.201201 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d18482-95d4-4cb7-ad74-fc299ab61c9f None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:03:11.201483 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d18482-95d4-4cb7-ad74-fc299ab61c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:03:11.224149 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-68d18482-95d4-4cb7-ad74-fc299ab61c9f None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:03:11.225285 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-68d18482-95d4-4cb7-ad74-fc299ab61c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:03:11.293107 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 738/1475] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 27 15:03:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:03:11.441509 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e769b2-b475-4986-8c75-9405e8b8e369 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:03:11.443117 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-97e769b2-b475-4986-8c75-9405e8b8e369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:03:11.521525 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e769b2-b475-4986-8c75-9405e8b8e369 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:03:11.526285 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939c899-9a30-497e-a2e4-f0895a94a9a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:03:11.526863 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939c899-9a30-497e-a2e4-f0895a94a9a7 service nova] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:03:11.527153 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939c899-9a30-497e-a2e4-f0895a94a9a7 service nova] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:03:11.527585 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939c899-9a30-497e-a2e4-f0895a94a9a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:03:11.539803 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939c899-9a30-497e-a2e4-f0895a94a9a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:03:11.564965 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939c899-9a30-497e-a2e4-f0895a94a9a7 service nova] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:03:11.574223 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 738/1476] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:03:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:03:12.939180 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4e1cf-2f69-4c65-857f-961eb5c31f51 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:03:12.939754 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4e1cf-2f69-4c65-857f-961eb5c31f51 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:03:12.939754 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4e1cf-2f69-4c65-857f-961eb5c31f51 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:03:12.941448 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 739/1477] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 27 15:03:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:03:12.947010 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bde081-c417-4b2d-9213-54b121ebd1e1 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:03:12.947794 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bde081-c417-4b2d-9213-54b121ebd1e1 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:03:12.947794 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bde081-c417-4b2d-9213-54b121ebd1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:03:12.972418 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-f8bde081-c417-4b2d-9213-54b121ebd1e1 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:03:12.973566 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-f8bde081-c417-4b2d-9213-54b121ebd1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:03:12.980822 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 739/1478] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 27 15:03:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:03:13.130634 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4e1cf-2f69-4c65-857f-961eb5c31f51 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:03:13.144653 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4e1cf-2f69-4c65-857f-961eb5c31f51 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:03:13.150234 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb94081-4a4d-47e2-8f9f-2f6d98736cc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:03:13.150839 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb94081-4a4d-47e2-8f9f-2f6d98736cc6 service nova] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:03:13.151122 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb94081-4a4d-47e2-8f9f-2f6d98736cc6 service nova] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:03:13.151422 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb94081-4a4d-47e2-8f9f-2f6d98736cc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:03:13.160358 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb94081-4a4d-47e2-8f9f-2f6d98736cc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:03:13.185578 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb94081-4a4d-47e2-8f9f-2f6d98736cc6 service nova] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:03:13.194930 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 740/1479] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:03:13 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:03:14.547815 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2bc1f-95da-4dd4-b693-cd511c49a6c6 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:03:14.548305 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2bc1f-95da-4dd4-b693-cd511c49a6c6 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:03:14.548408 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2bc1f-95da-4dd4-b693-cd511c49a6c6 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:03:14.550108 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 740/1480] 10.222.0.89 () {54 vars in 960 bytes} [Wed Oct 27 15:03:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:03:14.554872 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eff34e-683c-4b1b-909c-7195f954e246 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:03:14.555330 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eff34e-683c-4b1b-909c-7195f954e246 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:03:14.555476 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eff34e-683c-4b1b-909c-7195f954e246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:03:14.577997 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-18eff34e-683c-4b1b-909c-7195f954e246 None None] MFA Rules not processed for user `fcbab075fd5b4a889c2002639ca9d60a`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:03:14.579119 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-18eff34e-683c-4b1b-909c-7195f954e246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:03:14.586451 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 741/1481] 10.222.0.89 () {58 vars in 1057 bytes} [Wed Oct 27 15:03:14 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:03:14.594760 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2bc1f-95da-4dd4-b693-cd511c49a6c6 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:03:14.607893 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2bc1f-95da-4dd4-b693-cd511c49a6c6 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:03:14.612326 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b070f4-cd36-41b6-b3d0-ac31c55cd296 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcbab075fd5b4a889c2002639ca9d60a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:03:14.612897 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b070f4-cd36-41b6-b3d0-ac31c55cd296 service placement] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:03:14.613184 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b070f4-cd36-41b6-b3d0-ac31c55cd296 service placement] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:03:14.613465 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b070f4-cd36-41b6-b3d0-ac31c55cd296 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:03:14.622111 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b070f4-cd36-41b6-b3d0-ac31c55cd296 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:03:14.647654 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b070f4-cd36-41b6-b3d0-ac31c55cd296 service placement] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:03:14.657790 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 741/1482] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:03:14 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:03:25.004594 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163a0b6-7a64-4a3c-8b1f-c77509edcdff None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:03:25.005180 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163a0b6-7a64-4a3c-8b1f-c77509edcdff None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:03:25.005180 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3163a0b6-7a64-4a3c-8b1f-c77509edcdff None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:03:25.006861 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 742/1483] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 27 15:03:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:03:25.011790 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2ebd1-95c8-45a6-adb5-d95f3a39a813 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:03:25.012922 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2ebd1-95c8-45a6-adb5-d95f3a39a813 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:03:25.012922 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2ebd1-95c8-45a6-adb5-d95f3a39a813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:03:25.035765 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-2ea2ebd1-95c8-45a6-adb5-d95f3a39a813 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:03:25.036902 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-2ea2ebd1-95c8-45a6-adb5-d95f3a39a813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:03:25.044051 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 742/1484] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 27 15:03:25 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:03:25.192794 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163a0b6-7a64-4a3c-8b1f-c77509edcdff None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:03:25.206673 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3163a0b6-7a64-4a3c-8b1f-c77509edcdff None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:03:25.211560 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f2bcf-e4a9-4251-ac6e-43d1c4cf2e4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:03:25.212136 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f2bcf-e4a9-4251-ac6e-43d1c4cf2e4f service nova] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:03:25.212419 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f2bcf-e4a9-4251-ac6e-43d1c4cf2e4f service nova] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:03:25.212691 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f2bcf-e4a9-4251-ac6e-43d1c4cf2e4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:03:25.220636 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f2bcf-e4a9-4251-ac6e-43d1c4cf2e4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:03:25.245321 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f2bcf-e4a9-4251-ac6e-43d1c4cf2e4f service nova] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:03:25.256508 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 743/1485] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:03:25 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:03:26.614876 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2c60a-08a3-46a5-a76b-07198bc6ded2 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:03:26.615429 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2c60a-08a3-46a5-a76b-07198bc6ded2 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:03:26.615429 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2c60a-08a3-46a5-a76b-07198bc6ded2 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:03:26.617119 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 743/1486] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 27 15:03:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:03:26.621957 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a87319-51a1-4000-ad6e-791ad1ea3545 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:03:26.622588 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a87319-51a1-4000-ad6e-791ad1ea3545 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:03:26.622588 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a87319-51a1-4000-ad6e-791ad1ea3545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:03:26.644808 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-80a87319-51a1-4000-ad6e-791ad1ea3545 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:03:26.646009 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-80a87319-51a1-4000-ad6e-791ad1ea3545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:03:26.653409 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 744/1487] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 27 15:03:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:03:26.806026 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2c60a-08a3-46a5-a76b-07198bc6ded2 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:03:26.820407 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2c60a-08a3-46a5-a76b-07198bc6ded2 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:03:26.825874 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe33d3b-d963-464b-b124-27db6afef265 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:03:26.826443 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe33d3b-d963-464b-b124-27db6afef265 service nova] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:03:26.826732 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe33d3b-d963-464b-b124-27db6afef265 service nova] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:03:26.827012 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe33d3b-d963-464b-b124-27db6afef265 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:03:26.835106 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe33d3b-d963-464b-b124-27db6afef265 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:03:26.861122 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe33d3b-d963-464b-b124-27db6afef265 service nova] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:03:26.870398 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 744/1488] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:03:26 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:03:30.836342 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ecc5b-f9c9-4bf5-ad44-7b93164f8fb0 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:03:30.836892 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ecc5b-f9c9-4bf5-ad44-7b93164f8fb0 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:03:30.837018 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75ecc5b-f9c9-4bf5-ad44-7b93164f8fb0 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:03:30.838802 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 745/1489] 127.0.0.1 () {54 vars in 916 bytes} [Wed Oct 27 15:03:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:03:30.844945 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cec281-2938-4907-991b-5f40adea6859 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:03:30.845456 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cec281-2938-4907-991b-5f40adea6859 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:03:30.845563 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cec281-2938-4907-991b-5f40adea6859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:03:30.869624 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-78cec281-2938-4907-991b-5f40adea6859 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:03:30.870949 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-78cec281-2938-4907-991b-5f40adea6859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:03:30.878333 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 745/1490] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Oct 27 15:03:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:03:30.916824 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ecc5b-f9c9-4bf5-ad44-7b93164f8fb0 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:03:30.918580 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-a75ecc5b-f9c9-4bf5-ad44-7b93164f8fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:03:30.985689 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75ecc5b-f9c9-4bf5-ad44-7b93164f8fb0 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:03:30.989067 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbcbf08-f734-4e6d-aae3-2bcfdbb703cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:03:30.989648 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcbf08-f734-4e6d-aae3-2bcfdbb703cd service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:03:30.989931 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcbf08-f734-4e6d-aae3-2bcfdbb703cd service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:03:30.990206 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbcbf08-f734-4e6d-aae3-2bcfdbb703cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:03:30.999462 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbcbf08-f734-4e6d-aae3-2bcfdbb703cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:03:31.024652 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbcbf08-f734-4e6d-aae3-2bcfdbb703cd service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:03:31.035596 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 746/1491] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:03:30 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:03:33.077122 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe784d8-ef50-4ce7-b480-2b89402b0143 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:03:33.077679 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe784d8-ef50-4ce7-b480-2b89402b0143 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:03:33.077679 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe784d8-ef50-4ce7-b480-2b89402b0143 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:03:33.079339 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 746/1492] 127.0.0.1 () {54 vars in 916 bytes} [Wed Oct 27 15:03:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:03:33.084524 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d05e0b-0ad2-4e8b-93f5-a09bb417fe14 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:03:33.085019 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d05e0b-0ad2-4e8b-93f5-a09bb417fe14 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:03:33.085144 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d05e0b-0ad2-4e8b-93f5-a09bb417fe14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:03:33.107535 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-31d05e0b-0ad2-4e8b-93f5-a09bb417fe14 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:03:33.108647 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-31d05e0b-0ad2-4e8b-93f5-a09bb417fe14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:03:33.115412 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 747/1493] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Oct 27 15:03:33 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:03:33.150691 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe784d8-ef50-4ce7-b480-2b89402b0143 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:03:33.162623 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe784d8-ef50-4ce7-b480-2b89402b0143 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:03:33.165821 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e1bf9-01c7-4247-90cc-587dce472099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:03:33.166420 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e1bf9-01c7-4247-90cc-587dce472099 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:03:33.166705 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e1bf9-01c7-4247-90cc-587dce472099 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:03:33.166985 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e1bf9-01c7-4247-90cc-587dce472099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:03:33.175390 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e1bf9-01c7-4247-90cc-587dce472099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:03:33.200585 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e1bf9-01c7-4247-90cc-587dce472099 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:03:33.210869 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 747/1494] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:03:33 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:03:36.697173 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de454eec-527f-4392-a759-6f0434ede549 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:03:36.697739 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de454eec-527f-4392-a759-6f0434ede549 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:03:36.697739 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de454eec-527f-4392-a759-6f0434ede549 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:03:36.699395 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 748/1495] 127.0.0.1 () {54 vars in 916 bytes} [Wed Oct 27 15:03:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:03:36.704637 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b9dfe-f8f4-4fb7-bb32-556d00a38cdd None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:03:36.705085 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b9dfe-f8f4-4fb7-bb32-556d00a38cdd None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:03:36.705223 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b9dfe-f8f4-4fb7-bb32-556d00a38cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:03:36.727732 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-e45b9dfe-f8f4-4fb7-bb32-556d00a38cdd None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:03:36.728854 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-e45b9dfe-f8f4-4fb7-bb32-556d00a38cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:03:36.736200 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 748/1496] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Oct 27 15:03:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:03:36.793777 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de454eec-527f-4392-a759-6f0434ede549 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:03:36.795859 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-de454eec-527f-4392-a759-6f0434ede549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:03:36.858697 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de454eec-527f-4392-a759-6f0434ede549 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:03:36.861939 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876297ce-8b2f-4648-a2f7-568401413668 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:03:36.862562 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876297ce-8b2f-4648-a2f7-568401413668 service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:03:36.862871 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876297ce-8b2f-4648-a2f7-568401413668 service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:03:36.863065 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876297ce-8b2f-4648-a2f7-568401413668 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:03:36.874035 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876297ce-8b2f-4648-a2f7-568401413668 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:03:36.899124 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876297ce-8b2f-4648-a2f7-568401413668 service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:03:36.909777 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 749/1497] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:03:36 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:03:38.887654 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4f9bd-727e-457f-98e8-0ce9e111fba0 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:03:38.888311 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4f9bd-727e-457f-98e8-0ce9e111fba0 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:03:38.888311 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d4f9bd-727e-457f-98e8-0ce9e111fba0 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:03:38.889913 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 749/1498] 127.0.0.1 () {54 vars in 916 bytes} [Wed Oct 27 15:03:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:03:38.895533 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b389e6-94fd-4410-a29f-b42f68ddedfc None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:03:38.895959 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b389e6-94fd-4410-a29f-b42f68ddedfc None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:03:38.896216 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b389e6-94fd-4410-a29f-b42f68ddedfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:03:38.921602 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-18b389e6-94fd-4410-a29f-b42f68ddedfc None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:03:38.922754 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-18b389e6-94fd-4410-a29f-b42f68ddedfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:03:38.929990 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 750/1499] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Oct 27 15:03:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:03:38.987240 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0617f88-87de-4a6c-a281-3f0056ebfec4 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:03:38.987560 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0617f88-87de-4a6c-a281-3f0056ebfec4 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:03:38.987889 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0617f88-87de-4a6c-a281-3f0056ebfec4 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:03:38.989570 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 750/1500] 10.222.0.89 () {54 vars in 961 bytes} [Wed Oct 27 15:03:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:03:38.994161 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14dc5f-c8e9-42e6-9710-e1756a8019e7 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:03:38.994459 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14dc5f-c8e9-42e6-9710-e1756a8019e7 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:03:38.994745 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14dc5f-c8e9-42e6-9710-e1756a8019e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:03:39.021992 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-3d14dc5f-c8e9-42e6-9710-e1756a8019e7 None None] MFA Rules not processed for user `0fca8f0282ea40ce9b378260b95b3d01`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:03:39.023149 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-3d14dc5f-c8e9-42e6-9710-e1756a8019e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:03:39.029130 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 751/1501] 10.222.0.89 () {58 vars in 1058 bytes} [Wed Oct 27 15:03:38 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:03:39.037241 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0617f88-87de-4a6c-a281-3f0056ebfec4 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:03:39.048473 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0617f88-87de-4a6c-a281-3f0056ebfec4 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:03:39.052003 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5f9323-0c7b-40cf-9e77-070a3dc4174c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:03:39.052584 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f9323-0c7b-40cf-9e77-070a3dc4174c service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:03:39.052872 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f9323-0c7b-40cf-9e77-070a3dc4174c service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:03:39.053152 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5f9323-0c7b-40cf-9e77-070a3dc4174c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:03:39.063019 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f9323-0c7b-40cf-9e77-070a3dc4174c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:03:39.087781 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5f9323-0c7b-40cf-9e77-070a3dc4174c service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:03:39.097929 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 751/1502] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:03:39 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:12.037053 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0442018-3cc1-4d70-9643-dd0258f7bcd5 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:12.037841 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0442018-3cc1-4d70-9643-dd0258f7bcd5 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:12.037841 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0442018-3cc1-4d70-9643-dd0258f7bcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:12.065249 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-f0442018-3cc1-4d70-9643-dd0258f7bcd5 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:12.066422 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-f0442018-3cc1-4d70-9643-dd0258f7bcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:12.088069 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 752/1503] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:12.100955 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45747000-6cfb-4553-875e-2ca09609f0c7 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:12.101700 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45747000-6cfb-4553-875e-2ca09609f0c7 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:12.101700 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45747000-6cfb-4553-875e-2ca09609f0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:12.169829 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-45747000-6cfb-4553-875e-2ca09609f0c7 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:12.171899 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-45747000-6cfb-4553-875e-2ca09609f0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:12.199346 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 752/1504] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:12.204797 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0442018-3cc1-4d70-9643-dd0258f7bcd5 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:12.220795 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0442018-3cc1-4d70-9643-dd0258f7bcd5 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:12.233394 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fbfcb8-450c-46d9-b800-59742ab1d1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:12.234077 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbfcb8-450c-46d9-b800-59742ab1d1de admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:12.234426 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbfcb8-450c-46d9-b800-59742ab1d1de admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:12.234750 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fbfcb8-450c-46d9-b800-59742ab1d1de admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:12.235575 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fbfcb8-450c-46d9-b800-59742ab1d1de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:05:12.235877 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fbfcb8-450c-46d9-b800-59742ab1d1de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:12.289814 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fbfcb8-450c-46d9-b800-59742ab1d1de admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:12.311870 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 753/1505] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:05:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:05:12.322293 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45747000-6cfb-4553-875e-2ca09609f0c7 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:12.341974 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49756de0-90b4-48c9-b202-682f2c4d5b28 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:12.342319 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49756de0-90b4-48c9-b202-682f2c4d5b28 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:12.342549 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49756de0-90b4-48c9-b202-682f2c4d5b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:12.345775 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45747000-6cfb-4553-875e-2ca09609f0c7 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:12.372430 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69a6ca-02bb-41d4-a56b-98be587c8d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:12.373284 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69a6ca-02bb-41d4-a56b-98be587c8d86 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:12.373689 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69a6ca-02bb-41d4-a56b-98be587c8d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:12.374169 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69a6ca-02bb-41d4-a56b-98be587c8d86 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:12.375159 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69a6ca-02bb-41d4-a56b-98be587c8d86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:12.395649 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-49756de0-90b4-48c9-b202-682f2c4d5b28 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:12.396956 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-49756de0-90b4-48c9-b202-682f2c4d5b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:12.429888 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 754/1506] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:05:12.431189 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5513d3-b32c-408e-ab68-1e4e736aee43 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:12.431517 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5513d3-b32c-408e-ab68-1e4e736aee43 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:12.431803 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5513d3-b32c-408e-ab68-1e4e736aee43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:12.467566 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69a6ca-02bb-41d4-a56b-98be587c8d86 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:12.476777 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-6d5513d3-b32c-408e-ab68-1e4e736aee43 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:12.477951 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-6d5513d3-b32c-408e-ab68-1e4e736aee43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:12.501290 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 755/1507] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:12.502555 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8926425-c51e-48a9-b8db-22bfce3c8396 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:12.502840 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8926425-c51e-48a9-b8db-22bfce3c8396 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:12.503180 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8926425-c51e-48a9-b8db-22bfce3c8396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:12.542114 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 753/1508] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:05:12 2021] POST /identity/v3/projects => generated 387 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:12.544831 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753b0be-cd00-4983-bafb-5d568e878e04 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:12.546125 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753b0be-cd00-4983-bafb-5d568e878e04 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:12.546763 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753b0be-cd00-4983-bafb-5d568e878e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:12.560599 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-e8926425-c51e-48a9-b8db-22bfce3c8396 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:12.562389 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-e8926425-c51e-48a9-b8db-22bfce3c8396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:12.581185 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-f753b0be-cd00-4983-bafb-5d568e878e04 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:12.582509 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-f753b0be-cd00-4983-bafb-5d568e878e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:12.656335 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 756/1509] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:12.661721 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac943e4-02c7-49d4-b72f-f42e91003c1e None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:12.662087 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac943e4-02c7-49d4-b72f-f42e91003c1e None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:12.662432 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac943e4-02c7-49d4-b72f-f42e91003c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:12.673499 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 754/1510] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:12.679227 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b5660-62fd-41cc-8f3f-a6f485189260 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:12.679696 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b5660-62fd-41cc-8f3f-a6f485189260 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:12.679996 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b5660-62fd-41cc-8f3f-a6f485189260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:12.693186 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-6ac943e4-02c7-49d4-b72f-f42e91003c1e None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:12.694262 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-6ac943e4-02c7-49d4-b72f-f42e91003c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:12.702115 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 757/1511] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:12.703765 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dce1e-533c-4a37-93b1-a666610aa58a None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:12.704056 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dce1e-533c-4a37-93b1-a666610aa58a None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:12.704335 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676dce1e-533c-4a37-93b1-a666610aa58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:12.713599 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-2c6b5660-62fd-41cc-8f3f-a6f485189260 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:12.714784 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-2c6b5660-62fd-41cc-8f3f-a6f485189260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:12.722620 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 755/1512] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:12.723616 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b5660-62fd-41cc-8f3f-a6f485189260 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:12.733325 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-676dce1e-533c-4a37-93b1-a666610aa58a None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:12.734707 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-676dce1e-533c-4a37-93b1-a666610aa58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:12.736479 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b5660-62fd-41cc-8f3f-a6f485189260 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:12.741803 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56790c4-04c5-436c-814b-7c134d89838a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:12.742519 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56790c4-04c5-436c-814b-7c134d89838a admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:12.742894 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56790c4-04c5-436c-814b-7c134d89838a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:12.746476 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 758/1513] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:12.746647 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56790c4-04c5-436c-814b-7c134d89838a admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:12.746743 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bc435-95d1-4f44-ae98-55c082111d29 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:12.746845 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56790c4-04c5-436c-814b-7c134d89838a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:12.746931 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bc435-95d1-4f44-ae98-55c082111d29 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:12.746931 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6bc435-95d1-4f44-ae98-55c082111d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:12.778664 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56790c4-04c5-436c-814b-7c134d89838a admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:12.779964 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-5a6bc435-95d1-4f44-ae98-55c082111d29 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:12.781124 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-5a6bc435-95d1-4f44-ae98-55c082111d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:12.788883 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 759/1514] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:12.792895 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bc435-95d1-4f44-ae98-55c082111d29 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:12.802272 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6bc435-95d1-4f44-ae98-55c082111d29 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:12.808721 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 756/1515] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:05:12 2021] POST /identity/v3/users => generated 294 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:12.808721 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab99818-e5fd-4d67-bd79-2d7a64bb9198 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:12.808721 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab99818-e5fd-4d67-bd79-2d7a64bb9198 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:12.808721 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab99818-e5fd-4d67-bd79-2d7a64bb9198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:12.810951 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab4d9f-14c3-40ba-a865-0c1eac0a7629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:12.811578 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab4d9f-14c3-40ba-a865-0c1eac0a7629 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:12.811892 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab4d9f-14c3-40ba-a865-0c1eac0a7629 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:12.812170 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab4d9f-14c3-40ba-a865-0c1eac0a7629 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:12.812866 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab4d9f-14c3-40ba-a865-0c1eac0a7629 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:05:12.813163 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab4d9f-14c3-40ba-a865-0c1eac0a7629 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:12.842640 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-3ab99818-e5fd-4d67-bd79-2d7a64bb9198 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:12.843196 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab4d9f-14c3-40ba-a865-0c1eac0a7629 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:12.844283 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-3ab99818-e5fd-4d67-bd79-2d7a64bb9198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:12.857147 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 757/1516] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:12.858419 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e790bb-d86a-4421-9167-4955d0053db1 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:12.858717 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e790bb-d86a-4421-9167-4955d0053db1 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:12.859026 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e790bb-d86a-4421-9167-4955d0053db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:12.866481 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 760/1517] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:05:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:05:12.868634 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678d431-1d82-4386-bbc1-c33a01ad2144 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:12.868987 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678d431-1d82-4386-bbc1-c33a01ad2144 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:12.869320 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678d431-1d82-4386-bbc1-c33a01ad2144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:12.886126 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-24e790bb-d86a-4421-9167-4955d0053db1 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:12.887925 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-24e790bb-d86a-4421-9167-4955d0053db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:12.894212 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-1678d431-1d82-4386-bbc1-c33a01ad2144 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:12.895342 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 758/1518] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:12.895502 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-1678d431-1d82-4386-bbc1-c33a01ad2144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:12.898876 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e790bb-d86a-4421-9167-4955d0053db1 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:12.907392 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 761/1519] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:12.907392 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47449ba-6336-4d6d-ac2e-c908d254745d None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:12.907392 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47449ba-6336-4d6d-ac2e-c908d254745d None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:12.907392 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47449ba-6336-4d6d-ac2e-c908d254745d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:12.913303 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e790bb-d86a-4421-9167-4955d0053db1 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:12.917462 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6abd8-a1e0-42cb-98cd-7d205ecf8083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:12.918078 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6abd8-a1e0-42cb-98cd-7d205ecf8083 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:12.918367 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6abd8-a1e0-42cb-98cd-7d205ecf8083 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:12.918645 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6abd8-a1e0-42cb-98cd-7d205ecf8083 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:12.919333 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6abd8-a1e0-42cb-98cd-7d205ecf8083 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:05:12.919657 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6abd8-a1e0-42cb-98cd-7d205ecf8083 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:12.928296 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-a47449ba-6336-4d6d-ac2e-c908d254745d None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:12.929415 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-a47449ba-6336-4d6d-ac2e-c908d254745d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:12.937664 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 762/1520] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:12.937664 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4e471-3927-4bd7-b81a-453d0d4eff32 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:12.937664 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4e471-3927-4bd7-b81a-453d0d4eff32 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:12.937664 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4e471-3927-4bd7-b81a-453d0d4eff32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:12.945592 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6abd8-a1e0-42cb-98cd-7d205ecf8083 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:12.961214 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 759/1521] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:05:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:05:12.962051 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6abd8-a1e0-42cb-98cd-7d205ecf8083 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:12.969630 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-89d4e471-3927-4bd7-b81a-453d0d4eff32 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:12.970818 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-89d4e471-3927-4bd7-b81a-453d0d4eff32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:12.971508 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6abd8-a1e0-42cb-98cd-7d205ecf8083 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:12.975960 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348215c2-e331-4292-a41c-80d4711e8f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:12.976512 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348215c2-e331-4292-a41c-80d4711e8f32 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:12.976805 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348215c2-e331-4292-a41c-80d4711e8f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:12.977090 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348215c2-e331-4292-a41c-80d4711e8f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:12.977785 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348215c2-e331-4292-a41c-80d4711e8f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:12.979337 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 763/1522] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:12.980607 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c83b93-668e-4e51-989e-d8ca442c9bf8 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:12.980903 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c83b93-668e-4e51-989e-d8ca442c9bf8 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:12.981217 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c83b93-668e-4e51-989e-d8ca442c9bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:13.003857 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348215c2-e331-4292-a41c-80d4711e8f32 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:13.005769 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-67c83b93-668e-4e51-989e-d8ca442c9bf8 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:13.007809 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-67c83b93-668e-4e51-989e-d8ca442c9bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:13.016200 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 764/1523] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:12 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:13.017521 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 760/1524] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:12 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:13.020877 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c83b93-668e-4e51-989e-d8ca442c9bf8 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:13.021443 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348215c2-e331-4292-a41c-80d4711e8f32 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:13.030840 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348215c2-e331-4292-a41c-80d4711e8f32 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:13.031019 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c83b93-668e-4e51-989e-d8ca442c9bf8 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:13.035267 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994b779-be30-4782-8d2a-655b615b75bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:13.035422 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe3fe8-e8f4-454d-b966-f2d2aa311183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:13.035888 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994b779-be30-4782-8d2a-655b615b75bd admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:13.036076 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe3fe8-e8f4-454d-b966-f2d2aa311183 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:13.036173 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994b779-be30-4782-8d2a-655b615b75bd admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:13.036363 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe3fe8-e8f4-454d-b966-f2d2aa311183 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:13.036465 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994b779-be30-4782-8d2a-655b615b75bd admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:13.036642 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe3fe8-e8f4-454d-b966-f2d2aa311183 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:13.037140 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994b779-be30-4782-8d2a-655b615b75bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:05:13.037411 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe3fe8-e8f4-454d-b966-f2d2aa311183 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:13.038216 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994b779-be30-4782-8d2a-655b615b75bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:13.063235 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994b779-be30-4782-8d2a-655b615b75bd admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:13.063501 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fe3fe8-e8f4-454d-b966-f2d2aa311183 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:13.078121 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 761/1525] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:05:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:05:13.079157 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994b779-be30-4782-8d2a-655b615b75bd admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:13.088833 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994b779-be30-4782-8d2a-655b615b75bd admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:13.094098 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585f603-6e87-4ecd-83f9-78865572f73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:13.094746 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585f603-6e87-4ecd-83f9-78865572f73c admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:13.095102 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585f603-6e87-4ecd-83f9-78865572f73c admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:13.095373 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585f603-6e87-4ecd-83f9-78865572f73c admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:13.096161 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585f603-6e87-4ecd-83f9-78865572f73c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:05:13.096465 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585f603-6e87-4ecd-83f9-78865572f73c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:13.098989 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 765/1526] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:05:13 2021] POST /identity/v3/projects => generated 393 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:13.100166 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe3fe8-e8f4-454d-b966-f2d2aa311183 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:13.128848 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585f603-6e87-4ecd-83f9-78865572f73c admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:13.144296 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 762/1527] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:05:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:05:13.147581 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585f603-6e87-4ecd-83f9-78865572f73c admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:13.162169 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585f603-6e87-4ecd-83f9-78865572f73c admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:13.182862 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fe3fe8-e8f4-454d-b966-f2d2aa311183 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:13.187954 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087f0e3-74bc-4574-a048-26d577569a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:13.188633 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087f0e3-74bc-4574-a048-26d577569a10 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:13.188996 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087f0e3-74bc-4574-a048-26d577569a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:13.189365 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f087f0e3-74bc-4574-a048-26d577569a10 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:13.190117 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087f0e3-74bc-4574-a048-26d577569a10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:05:13.190489 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087f0e3-74bc-4574-a048-26d577569a10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:13.217150 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f087f0e3-74bc-4574-a048-26d577569a10 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:13.231520 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 766/1528] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:05:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:05:13.239708 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ba388-9ff7-4f9e-899b-095f0a2c54d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:13.240569 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ba388-9ff7-4f9e-899b-095f0a2c54d2 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:13.240782 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087f0e3-74bc-4574-a048-26d577569a10 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:13.240953 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ba388-9ff7-4f9e-899b-095f0a2c54d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:13.241113 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ba388-9ff7-4f9e-899b-095f0a2c54d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:13.241751 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ba388-9ff7-4f9e-899b-095f0a2c54d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:13.254372 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f087f0e3-74bc-4574-a048-26d577569a10 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:13.259300 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68eb2e-f05a-473d-a107-43fdbf830a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:13.259994 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68eb2e-f05a-473d-a107-43fdbf830a03 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:13.260333 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68eb2e-f05a-473d-a107-43fdbf830a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:13.260615 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a68eb2e-f05a-473d-a107-43fdbf830a03 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:13.261332 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68eb2e-f05a-473d-a107-43fdbf830a03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:05:13.261856 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68eb2e-f05a-473d-a107-43fdbf830a03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:13.267741 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106ba388-9ff7-4f9e-899b-095f0a2c54d2 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:13.288707 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a68eb2e-f05a-473d-a107-43fdbf830a03 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:13.300024 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 763/1529] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:05:13 2021] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:13.301577 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ba388-9ff7-4f9e-899b-095f0a2c54d2 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:13.312407 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 767/1530] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:05:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:05:13.312407 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68eb2e-f05a-473d-a107-43fdbf830a03 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:13.326188 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a68eb2e-f05a-473d-a107-43fdbf830a03 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:13.391872 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8504e-cd25-4bd9-a2cd-7389614881aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:13.392710 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8504e-cd25-4bd9-a2cd-7389614881aa admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:13.392826 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ba388-9ff7-4f9e-899b-095f0a2c54d2 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:13.392979 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8504e-cd25-4bd9-a2cd-7389614881aa admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:13.393249 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8504e-cd25-4bd9-a2cd-7389614881aa admin admin] PATH_INFO: `/v3/projects/de1d8ecb9cee4384aa3b3542ed76ee99/users/5eca6611d0c74d55a07c52cf5f42d0d7/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:13.398269 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b25df-b4ea-498c-9f60-be19014946e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:13.398917 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b25df-b4ea-498c-9f60-be19014946e4 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:13.399213 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b25df-b4ea-498c-9f60-be19014946e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:13.399568 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b25df-b4ea-498c-9f60-be19014946e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:13.400298 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b25df-b4ea-498c-9f60-be19014946e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:05:13.400596 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b25df-b4ea-498c-9f60-be19014946e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:13.413024 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8504e-cd25-4bd9-a2cd-7389614881aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=de1d8ecb9cee4384aa3b3542ed76ee99, user_id=5eca6611d0c74d55a07c52cf5f42d0d7, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:13.427129 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87b25df-b4ea-498c-9f60-be19014946e4 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:13.440557 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 764/1531] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:05:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:05:13.440752 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8504e-cd25-4bd9-a2cd-7389614881aa admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:13.442112 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b25df-b4ea-498c-9f60-be19014946e4 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:13.452025 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b25df-b4ea-498c-9f60-be19014946e4 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:13.465684 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 768/1532] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:13 2021] PUT /identity/v3/projects/de1d8ecb9cee4384aa3b3542ed76ee99/users/5eca6611d0c74d55a07c52cf5f42d0d7/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:13.465684 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8504e-cd25-4bd9-a2cd-7389614881aa admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:13.521822 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c048cdc-0bad-4d93-b2d2-cd787b440bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:13.522527 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c048cdc-0bad-4d93-b2d2-cd787b440bde admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:13.522887 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c048cdc-0bad-4d93-b2d2-cd787b440bde admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:13.523238 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c048cdc-0bad-4d93-b2d2-cd787b440bde admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:13.523915 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c048cdc-0bad-4d93-b2d2-cd787b440bde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:13.542658 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8504e-cd25-4bd9-a2cd-7389614881aa admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:13.547396 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a403e20-7200-4523-8213-4dc4173f19e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:13.548035 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a403e20-7200-4523-8213-4dc4173f19e7 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:13.548323 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a403e20-7200-4523-8213-4dc4173f19e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:13.548607 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a403e20-7200-4523-8213-4dc4173f19e7 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:13.549249 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a403e20-7200-4523-8213-4dc4173f19e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:13.551209 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c048cdc-0bad-4d93-b2d2-cd787b440bde admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:13.575182 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a403e20-7200-4523-8213-4dc4173f19e7 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:13.581800 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 765/1533] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:05:13 2021] POST /identity/v3/projects => generated 379 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:13.582473 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c048cdc-0bad-4d93-b2d2-cd787b440bde admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:13.596637 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 769/1534] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:05:13 2021] POST /identity/v3/users => generated 297 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:13.597290 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a403e20-7200-4523-8213-4dc4173f19e7 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:13.609517 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a403e20-7200-4523-8213-4dc4173f19e7 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:13.659987 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c048cdc-0bad-4d93-b2d2-cd787b440bde admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:13.664308 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e81eca-e9a5-4428-a354-5f102c4cc400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:13.664902 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e81eca-e9a5-4428-a354-5f102c4cc400 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:13.665186 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e81eca-e9a5-4428-a354-5f102c4cc400 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:13.665462 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e81eca-e9a5-4428-a354-5f102c4cc400 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:13.666097 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e81eca-e9a5-4428-a354-5f102c4cc400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:13.680792 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83707f-2124-477c-94e1-e882b614839a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:13.681498 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83707f-2124-477c-94e1-e882b614839a admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:13.681789 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83707f-2124-477c-94e1-e882b614839a admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:13.682066 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f83707f-2124-477c-94e1-e882b614839a admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:13.682704 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f83707f-2124-477c-94e1-e882b614839a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:13.692946 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e81eca-e9a5-4428-a354-5f102c4cc400 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:13.708002 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f83707f-2124-477c-94e1-e882b614839a admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:13.722814 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 766/1535] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:05:13 2021] POST /identity/v3/projects => generated 389 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:13.723984 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e81eca-e9a5-4428-a354-5f102c4cc400 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:13.741582 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 770/1536] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:05:13 2021] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:13.742801 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83707f-2124-477c-94e1-e882b614839a admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:13.797292 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e81eca-e9a5-4428-a354-5f102c4cc400 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:13.815577 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f83707f-2124-477c-94e1-e882b614839a admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:13.821678 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18236e-cb72-4b2b-990d-7731f7e82b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:13.822458 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18236e-cb72-4b2b-990d-7731f7e82b81 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:13.822762 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18236e-cb72-4b2b-990d-7731f7e82b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:13.823213 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f18236e-cb72-4b2b-990d-7731f7e82b81 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:13.823876 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18236e-cb72-4b2b-990d-7731f7e82b81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:13.851893 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f18236e-cb72-4b2b-990d-7731f7e82b81 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:13.880283 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44daefa5-565d-40ef-889b-9c1fd027b59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:13.880903 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44daefa5-565d-40ef-889b-9c1fd027b59b admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:13.881263 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44daefa5-565d-40ef-889b-9c1fd027b59b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:13.881641 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44daefa5-565d-40ef-889b-9c1fd027b59b admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:13.882444 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44daefa5-565d-40ef-889b-9c1fd027b59b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:13.894273 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 771/1537] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:05:13 2021] POST /identity/v3/projects => generated 405 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:13.894273 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18236e-cb72-4b2b-990d-7731f7e82b81 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:13.909588 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44daefa5-565d-40ef-889b-9c1fd027b59b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:13.933737 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 767/1538] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:05:13 2021] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:13.935010 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b04293-a88f-49ac-8cf4-7161eb972b58 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:13.935300 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b04293-a88f-49ac-8cf4-7161eb972b58 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:13.935826 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b04293-a88f-49ac-8cf4-7161eb972b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:13.973664 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-56b04293-a88f-49ac-8cf4-7161eb972b58 None None] MFA Rules not processed for user `5eca6611d0c74d55a07c52cf5f42d0d7`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:13.974830 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-56b04293-a88f-49ac-8cf4-7161eb972b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:13.980428 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f18236e-cb72-4b2b-990d-7731f7e82b81 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:13.985027 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6925e-ce83-49de-92b6-a9f41a20e7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:13.985627 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6925e-ce83-49de-92b6-a9f41a20e7cb admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:13.985917 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6925e-ce83-49de-92b6-a9f41a20e7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:13.986203 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6925e-ce83-49de-92b6-a9f41a20e7cb admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:13.986842 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa6925e-ce83-49de-92b6-a9f41a20e7cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:14.012724 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa6925e-ce83-49de-92b6-a9f41a20e7cb admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:14.041924 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 772/1539] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:05:13 2021] POST /identity/v3/projects => generated 363 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:14.046605 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6925e-ce83-49de-92b6-a9f41a20e7cb admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:14.054138 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 768/1540] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:13 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:14.055234 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b04293-a88f-49ac-8cf4-7161eb972b58 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:14.064861 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b04293-a88f-49ac-8cf4-7161eb972b58 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:14.126976 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6925e-ce83-49de-92b6-a9f41a20e7cb admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:14.132237 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcbcb1b-9ecf-40c7-836e-6d19ffcf1c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:14.133118 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcbcb1b-9ecf-40c7-836e-6d19ffcf1c11 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:14.133519 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcbcb1b-9ecf-40c7-836e-6d19ffcf1c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:14.133722 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcbcb1b-9ecf-40c7-836e-6d19ffcf1c11 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:14.134362 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcbcb1b-9ecf-40c7-836e-6d19ffcf1c11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:14.137262 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373051c-7ab9-464d-a6f7-b9092347fd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:14.137879 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373051c-7ab9-464d-a6f7-b9092347fd85 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:14.138167 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373051c-7ab9-464d-a6f7-b9092347fd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:14.138478 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373051c-7ab9-464d-a6f7-b9092347fd85 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:14.139139 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373051c-7ab9-464d-a6f7-b9092347fd85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:14.160921 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcbcb1b-9ecf-40c7-836e-6d19ffcf1c11 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:14.167509 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373051c-7ab9-464d-a6f7-b9092347fd85 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:14.182099 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 773/1541] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:05:14 2021] POST /identity/v3/users => generated 290 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:14.183047 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 769/1542] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:14 2021] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:14.186426 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcbcb1b-9ecf-40c7-836e-6d19ffcf1c11 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:14.187322 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373051c-7ab9-464d-a6f7-b9092347fd85 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:14.196636 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcbcb1b-9ecf-40c7-836e-6d19ffcf1c11 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:14.198322 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373051c-7ab9-464d-a6f7-b9092347fd85 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:14.201700 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ebdb9-ed6b-4516-889d-70f833b4bfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:14.202309 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ebdb9-ed6b-4516-889d-70f833b4bfb4 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:14.202595 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ebdb9-ed6b-4516-889d-70f833b4bfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:14.202883 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ebdb9-ed6b-4516-889d-70f833b4bfb4 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:14.203384 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fd981-9181-4681-8179-54244f6108be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:14.203577 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ebdb9-ed6b-4516-889d-70f833b4bfb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:14.204051 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fd981-9181-4681-8179-54244f6108be admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:14.204340 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fd981-9181-4681-8179-54244f6108be admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:14.204620 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fd981-9181-4681-8179-54244f6108be admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:14.205250 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fd981-9181-4681-8179-54244f6108be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:14.231724 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8ebdb9-ed6b-4516-889d-70f833b4bfb4 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:14.248105 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fd981-9181-4681-8179-54244f6108be admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:14.253196 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 774/1543] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:05:14 2021] POST /identity/v3/users => generated 295 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:14.254014 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ebdb9-ed6b-4516-889d-70f833b4bfb4 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:14.268037 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ebdb9-ed6b-4516-889d-70f833b4bfb4 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:14.272873 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d37317-c4ab-4af7-867e-ad1e313a4eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:14.273547 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d37317-c4ab-4af7-867e-ad1e313a4eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:14.273867 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d37317-c4ab-4af7-867e-ad1e313a4eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:14.274178 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d37317-c4ab-4af7-867e-ad1e313a4eb5 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:14.274865 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d37317-c4ab-4af7-867e-ad1e313a4eb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:14.275624 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 770/1544] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:05:14 2021] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:14.276719 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fd981-9181-4681-8179-54244f6108be admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:14.290159 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fd981-9181-4681-8179-54244f6108be admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:14.294639 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0096b-0add-444d-8f3b-e50f58ce0f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:14.295287 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0096b-0add-444d-8f3b-e50f58ce0f44 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:14.295601 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0096b-0add-444d-8f3b-e50f58ce0f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:14.295884 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0096b-0add-444d-8f3b-e50f58ce0f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:14.296697 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0096b-0add-444d-8f3b-e50f58ce0f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:14.304543 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d37317-c4ab-4af7-867e-ad1e313a4eb5 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:14.321477 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0096b-0add-444d-8f3b-e50f58ce0f44 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:14.324140 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 775/1545] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:05:14 2021] POST /identity/v3/users => generated 303 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:14.325555 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d37317-c4ab-4af7-867e-ad1e313a4eb5 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:14.337718 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 771/1546] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:14 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:14.337718 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0096b-0add-444d-8f3b-e50f58ce0f44 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:14.338888 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d37317-c4ab-4af7-867e-ad1e313a4eb5 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:14.344047 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4ca7d-3f49-4e18-b263-d4e829c57869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:14.344692 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4ca7d-3f49-4e18-b263-d4e829c57869 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:14.345001 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4ca7d-3f49-4e18-b263-d4e829c57869 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:14.345281 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee4ca7d-3f49-4e18-b263-d4e829c57869 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:14.345398 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0096b-0add-444d-8f3b-e50f58ce0f44 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:14.345981 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4ca7d-3f49-4e18-b263-d4e829c57869 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:14.350550 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f38755-df2c-4cce-9fb6-f27b6ce10741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:14.351147 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f38755-df2c-4cce-9fb6-f27b6ce10741 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:14.351666 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f38755-df2c-4cce-9fb6-f27b6ce10741 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:14.351959 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f38755-df2c-4cce-9fb6-f27b6ce10741 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:14.352807 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f38755-df2c-4cce-9fb6-f27b6ce10741 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:14.374733 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee4ca7d-3f49-4e18-b263-d4e829c57869 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:14.381125 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f38755-df2c-4cce-9fb6-f27b6ce10741 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:14.399169 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 776/1547] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:05:14 2021] POST /identity/v3/users => generated 282 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:14.400296 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4ca7d-3f49-4e18-b263-d4e829c57869 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:14.414820 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee4ca7d-3f49-4e18-b263-d4e829c57869 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:14.416795 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 772/1548] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:05:14 2021] POST /identity/v3/projects => generated 387 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:14.421768 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f38755-df2c-4cce-9fb6-f27b6ce10741 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:14.492725 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043ca6f-8ae3-4983-aad7-680243d67ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:14.493417 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043ca6f-8ae3-4983-aad7-680243d67ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:14.493740 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043ca6f-8ae3-4983-aad7-680243d67ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:14.494132 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043ca6f-8ae3-4983-aad7-680243d67ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:14.494785 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3043ca6f-8ae3-4983-aad7-680243d67ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:14.508495 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f38755-df2c-4cce-9fb6-f27b6ce10741 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:14.513744 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48561317-f06e-47e4-8d38-a6c8f08b5e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:14.514576 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48561317-f06e-47e4-8d38-a6c8f08b5e54 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:14.514978 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48561317-f06e-47e4-8d38-a6c8f08b5e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:14.515267 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48561317-f06e-47e4-8d38-a6c8f08b5e54 admin admin] PATH_INFO: `/v3/projects/332078f71e764c8193f602ddaa78dc81/users/78e8b977173d4eb4b0a32973c8388971/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:14.523566 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3043ca6f-8ae3-4983-aad7-680243d67ad5 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:14.539250 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 777/1549] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:14 2021] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:14.539250 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043ca6f-8ae3-4983-aad7-680243d67ad5 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:14.539705 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48561317-f06e-47e4-8d38-a6c8f08b5e54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=332078f71e764c8193f602ddaa78dc81, user_id=78e8b977173d4eb4b0a32973c8388971, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:14.546734 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043ca6f-8ae3-4983-aad7-680243d67ad5 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:14.551110 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240930c-51f2-49a0-9aa2-754162452dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:14.551737 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240930c-51f2-49a0-9aa2-754162452dfc admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:14.552029 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240930c-51f2-49a0-9aa2-754162452dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:14.552309 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240930c-51f2-49a0-9aa2-754162452dfc admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:14.553062 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240930c-51f2-49a0-9aa2-754162452dfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:14.565907 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48561317-f06e-47e4-8d38-a6c8f08b5e54 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:14.580820 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240930c-51f2-49a0-9aa2-754162452dfc admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:14.581372 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 773/1550] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:14 2021] PUT /identity/v3/projects/332078f71e764c8193f602ddaa78dc81/users/78e8b977173d4eb4b0a32973c8388971/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:14.585743 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48561317-f06e-47e4-8d38-a6c8f08b5e54 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:14.593208 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 778/1551] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:14 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:14.594129 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240930c-51f2-49a0-9aa2-754162452dfc admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:14.603898 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240930c-51f2-49a0-9aa2-754162452dfc admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:14.682118 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48561317-f06e-47e4-8d38-a6c8f08b5e54 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:14.682764 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342a173-9fe2-4a95-a056-6dd28906acd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:14.683376 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342a173-9fe2-4a95-a056-6dd28906acd8 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:14.686131 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342a173-9fe2-4a95-a056-6dd28906acd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:14.686131 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0342a173-9fe2-4a95-a056-6dd28906acd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:14.686131 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342a173-9fe2-4a95-a056-6dd28906acd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:14.688281 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cc512-8d06-446c-b890-94c99625b118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:14.689045 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cc512-8d06-446c-b890-94c99625b118 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:14.689502 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cc512-8d06-446c-b890-94c99625b118 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:14.689924 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cc512-8d06-446c-b890-94c99625b118 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:14.690872 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53cc512-8d06-446c-b890-94c99625b118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:14.710819 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0342a173-9fe2-4a95-a056-6dd28906acd8 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:14.718392 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53cc512-8d06-446c-b890-94c99625b118 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:14.722307 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 779/1552] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:14 2021] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:14.723109 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342a173-9fe2-4a95-a056-6dd28906acd8 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:14.733085 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0342a173-9fe2-4a95-a056-6dd28906acd8 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:14.742779 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 774/1553] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:14 2021] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:14.743095 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32909da-d48e-4f8d-911e-ea57b13897cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:14.743299 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cc512-8d06-446c-b890-94c99625b118 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:14.743505 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32909da-d48e-4f8d-911e-ea57b13897cf admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:14.743505 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32909da-d48e-4f8d-911e-ea57b13897cf admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:14.743505 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32909da-d48e-4f8d-911e-ea57b13897cf admin admin] PATH_INFO: `/v3/projects/1db44cbda2874a4e9cd4706662ba77b9/users/7a86cdc90706440c8fa6bf9e101573b9/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:14.755269 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cc512-8d06-446c-b890-94c99625b118 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:14.760691 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f07ad-f0c1-4d56-952e-63cb938f5c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:14.761518 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f07ad-f0c1-4d56-952e-63cb938f5c0b admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:14.762009 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f07ad-f0c1-4d56-952e-63cb938f5c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:14.762461 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f07ad-f0c1-4d56-952e-63cb938f5c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:14.763275 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f07ad-f0c1-4d56-952e-63cb938f5c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:14.765250 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32909da-d48e-4f8d-911e-ea57b13897cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1db44cbda2874a4e9cd4706662ba77b9, user_id=7a86cdc90706440c8fa6bf9e101573b9, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:14.790898 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f07ad-f0c1-4d56-952e-63cb938f5c0b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:14.794051 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32909da-d48e-4f8d-911e-ea57b13897cf admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:14.809959 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 775/1554] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:14 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:14.809959 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f07ad-f0c1-4d56-952e-63cb938f5c0b admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:14.813248 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 780/1555] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:14 2021] PUT /identity/v3/projects/1db44cbda2874a4e9cd4706662ba77b9/users/7a86cdc90706440c8fa6bf9e101573b9/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:14.814445 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32909da-d48e-4f8d-911e-ea57b13897cf admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:14.821636 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f07ad-f0c1-4d56-952e-63cb938f5c0b admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:14.893556 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77b61f-f6b0-4099-9b9e-4fe5455bfb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:14.894121 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77b61f-f6b0-4099-9b9e-4fe5455bfb4b admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:14.894410 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77b61f-f6b0-4099-9b9e-4fe5455bfb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:14.894691 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77b61f-f6b0-4099-9b9e-4fe5455bfb4b admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:14.895345 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77b61f-f6b0-4099-9b9e-4fe5455bfb4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:14.899945 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32909da-d48e-4f8d-911e-ea57b13897cf admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:14.908670 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0f30f-9172-48b2-b5c8-db53222ee912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:14.909488 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0f30f-9172-48b2-b5c8-db53222ee912 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:14.909770 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0f30f-9172-48b2-b5c8-db53222ee912 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:14.910045 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0f30f-9172-48b2-b5c8-db53222ee912 admin admin] PATH_INFO: `/v3/projects/69b9e8ac7b5a4c9493a116af78daf977/users/ab3f55859b1145fea22fe89a83c366e5/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:14.921692 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77b61f-f6b0-4099-9b9e-4fe5455bfb4b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:14.932980 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0f30f-9172-48b2-b5c8-db53222ee912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b9e8ac7b5a4c9493a116af78daf977, user_id=ab3f55859b1145fea22fe89a83c366e5, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:14.944996 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 776/1556] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:05:14 2021] POST /identity/v3/users => generated 300 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:14.946421 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736ec4e-2a15-4a0d-af69-a920a105d719 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:14.946764 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736ec4e-2a15-4a0d-af69-a920a105d719 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:14.947238 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736ec4e-2a15-4a0d-af69-a920a105d719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:14.960436 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0f30f-9172-48b2-b5c8-db53222ee912 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:14.972382 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-3736ec4e-2a15-4a0d-af69-a920a105d719 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:14.973567 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-3736ec4e-2a15-4a0d-af69-a920a105d719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:14.974708 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 781/1557] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:14 2021] PUT /identity/v3/projects/69b9e8ac7b5a4c9493a116af78daf977/users/ab3f55859b1145fea22fe89a83c366e5/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:14.975830 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0f30f-9172-48b2-b5c8-db53222ee912 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:15.052345 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0f30f-9172-48b2-b5c8-db53222ee912 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:15.053167 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 777/1558] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:14 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:15.053796 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736ec4e-2a15-4a0d-af69-a920a105d719 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:15.062492 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d9cf6-0e1c-452d-b1c1-0204d64aafd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:15.063451 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736ec4e-2a15-4a0d-af69-a920a105d719 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:15.063846 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d9cf6-0e1c-452d-b1c1-0204d64aafd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:15.064508 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d9cf6-0e1c-452d-b1c1-0204d64aafd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:15.064879 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03d9cf6-0e1c-452d-b1c1-0204d64aafd9 admin admin] PATH_INFO: `/v3/projects/ef93e3d769ba40e79c626d3bc351a81c/users/3a3324c92a85423e9ab73178f876d531/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:15.067690 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b96ec-3965-4c0b-a905-c22b610798e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:15.068500 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b96ec-3965-4c0b-a905-c22b610798e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:15.068807 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b96ec-3965-4c0b-a905-c22b610798e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:15.069127 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b96ec-3965-4c0b-a905-c22b610798e3 admin admin] PATH_INFO: `/v3/projects/46e674c8afdd4e4f9189067168fa14d1/users/84f52e9dd7974ae09a2b2f2b0071c8b8/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:15.087026 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d9cf6-0e1c-452d-b1c1-0204d64aafd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef93e3d769ba40e79c626d3bc351a81c, user_id=3a3324c92a85423e9ab73178f876d531, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:15.095583 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b96ec-3965-4c0b-a905-c22b610798e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46e674c8afdd4e4f9189067168fa14d1, user_id=84f52e9dd7974ae09a2b2f2b0071c8b8, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:15.114155 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03d9cf6-0e1c-452d-b1c1-0204d64aafd9 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:15.124236 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b96ec-3965-4c0b-a905-c22b610798e3 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:15.128654 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 782/1559] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:14 2021] PUT /identity/v3/projects/ef93e3d769ba40e79c626d3bc351a81c/users/3a3324c92a85423e9ab73178f876d531/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:15.129788 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d9cf6-0e1c-452d-b1c1-0204d64aafd9 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:15.147710 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 778/1560] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:15 2021] PUT /identity/v3/projects/46e674c8afdd4e4f9189067168fa14d1/users/84f52e9dd7974ae09a2b2f2b0071c8b8/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:15.147710 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b96ec-3965-4c0b-a905-c22b610798e3 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:15.205934 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03d9cf6-0e1c-452d-b1c1-0204d64aafd9 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:15.224298 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b96ec-3965-4c0b-a905-c22b610798e3 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:15.229004 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4772fe2-7523-44d1-83a6-df6dc292b57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:15.229831 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4772fe2-7523-44d1-83a6-df6dc292b57a admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:15.230156 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4772fe2-7523-44d1-83a6-df6dc292b57a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:15.230485 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4772fe2-7523-44d1-83a6-df6dc292b57a admin admin] PATH_INFO: `/v3/projects/903002b404154f72a6acdd922d9b4890/users/18a56f64e9c842d8929defb7c6a18889/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:15.260024 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4772fe2-7523-44d1-83a6-df6dc292b57a admin admin] RBAC: Authorizing `identity:create_grant(project_id=903002b404154f72a6acdd922d9b4890, user_id=18a56f64e9c842d8929defb7c6a18889, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:15.304083 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe913b0-1178-43a0-8899-369e55750eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:15.305441 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe913b0-1178-43a0-8899-369e55750eaa admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:15.305899 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe913b0-1178-43a0-8899-369e55750eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:15.306353 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe913b0-1178-43a0-8899-369e55750eaa admin admin] PATH_INFO: `/v3/projects/0b19569eccd4401bb5e17740db56df53/users/d3b6433982164e739834be8e56e7b76c/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:15.314129 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4772fe2-7523-44d1-83a6-df6dc292b57a admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:15.332346 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 779/1561] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:15 2021] PUT /identity/v3/projects/903002b404154f72a6acdd922d9b4890/users/18a56f64e9c842d8929defb7c6a18889/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:15.343060 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb90f1-4e59-4ec7-94c0-8fd805bd64d7 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:15.343060 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb90f1-4e59-4ec7-94c0-8fd805bd64d7 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:15.343060 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb90f1-4e59-4ec7-94c0-8fd805bd64d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:15.343367 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe913b0-1178-43a0-8899-369e55750eaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b19569eccd4401bb5e17740db56df53, user_id=d3b6433982164e739834be8e56e7b76c, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:15.358363 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-69cb90f1-4e59-4ec7-94c0-8fd805bd64d7 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:15.359627 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-69cb90f1-4e59-4ec7-94c0-8fd805bd64d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:15.364719 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe913b0-1178-43a0-8899-369e55750eaa admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:15.379616 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 783/1562] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:15 2021] PUT /identity/v3/projects/0b19569eccd4401bb5e17740db56df53/users/d3b6433982164e739834be8e56e7b76c/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:15.380716 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe913b0-1178-43a0-8899-369e55750eaa admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:15.432077 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 780/1563] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:15.433832 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514206d4-d6a2-4640-898f-5b3e4cd7a577 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:15.434392 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514206d4-d6a2-4640-898f-5b3e4cd7a577 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:15.434682 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514206d4-d6a2-4640-898f-5b3e4cd7a577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:15.457111 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-514206d4-d6a2-4640-898f-5b3e4cd7a577 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:15.458538 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-514206d4-d6a2-4640-898f-5b3e4cd7a577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:15.462219 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe913b0-1178-43a0-8899-369e55750eaa admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:15.465995 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 781/1564] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:15.466792 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514206d4-d6a2-4640-898f-5b3e4cd7a577 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:15.473554 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc035795-39cc-421d-9d8e-e5abebc7948f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:15.474812 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc035795-39cc-421d-9d8e-e5abebc7948f admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:15.474812 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc035795-39cc-421d-9d8e-e5abebc7948f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:15.474812 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc035795-39cc-421d-9d8e-e5abebc7948f admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:15.476197 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc035795-39cc-421d-9d8e-e5abebc7948f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:15.502026 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc035795-39cc-421d-9d8e-e5abebc7948f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:15.517266 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 784/1565] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:15 2021] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:15.518346 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89fec4-4200-48b6-86a4-417090c775e7 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:15.518643 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89fec4-4200-48b6-86a4-417090c775e7 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:15.518925 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f89fec4-4200-48b6-86a4-417090c775e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:15.540623 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514206d4-d6a2-4640-898f-5b3e4cd7a577 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:15.543737 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-1f89fec4-4200-48b6-86a4-417090c775e7 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:15.544346 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f94fb3-05f7-4dec-a651-cc356f3f19de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:15.544942 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f94fb3-05f7-4dec-a651-cc356f3f19de service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:15.545044 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-1f89fec4-4200-48b6-86a4-417090c775e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:15.545232 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f94fb3-05f7-4dec-a651-cc356f3f19de service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:15.545570 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f94fb3-05f7-4dec-a651-cc356f3f19de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:15.553064 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 785/1566] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:15.554355 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0368ad-c007-464f-8eb8-dc6a00e2d260 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:15.554652 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0368ad-c007-464f-8eb8-dc6a00e2d260 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:15.554932 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0368ad-c007-464f-8eb8-dc6a00e2d260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:15.556805 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f94fb3-05f7-4dec-a651-cc356f3f19de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:15.582299 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f94fb3-05f7-4dec-a651-cc356f3f19de service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:15.593139 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 782/1567] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:15 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:15.594595 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787fb97-5e9f-47ec-900b-37b394ab04c4 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:15.594897 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787fb97-5e9f-47ec-900b-37b394ab04c4 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:15.595186 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787fb97-5e9f-47ec-900b-37b394ab04c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:15.597680 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-2b0368ad-c007-464f-8eb8-dc6a00e2d260 None None] MFA Rules not processed for user `84f52e9dd7974ae09a2b2f2b0071c8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:15.599133 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-2b0368ad-c007-464f-8eb8-dc6a00e2d260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:15.638454 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-5787fb97-5e9f-47ec-900b-37b394ab04c4 None None] MFA Rules not processed for user `18a56f64e9c842d8929defb7c6a18889`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:15.639790 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-5787fb97-5e9f-47ec-900b-37b394ab04c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:15.694376 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 786/1568] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:15 2021] POST /identity/v3/auth/tokens => generated 3712 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:15.696191 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32db84-1678-4f9b-acd5-bb29c79decf3 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:15.696497 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32db84-1678-4f9b-acd5-bb29c79decf3 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:15.696780 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32db84-1678-4f9b-acd5-bb29c79decf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:15.723654 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 783/1569] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:15 2021] POST /identity/v3/auth/tokens => generated 3670 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:15.724667 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787fb97-5e9f-47ec-900b-37b394ab04c4 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:15.735934 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787fb97-5e9f-47ec-900b-37b394ab04c4 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:15.741005 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-ef32db84-1678-4f9b-acd5-bb29c79decf3 None None] MFA Rules not processed for user `d3b6433982164e739834be8e56e7b76c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:15.742352 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-ef32db84-1678-4f9b-acd5-bb29c79decf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:15.744552 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4926b5-8812-4543-b56f-d1cea5c0ca13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:15.745130 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4926b5-8812-4543-b56f-d1cea5c0ca13 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:15.745493 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4926b5-8812-4543-b56f-d1cea5c0ca13 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:15.745742 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4926b5-8812-4543-b56f-d1cea5c0ca13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:15.759082 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4926b5-8812-4543-b56f-d1cea5c0ca13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:15.787328 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4926b5-8812-4543-b56f-d1cea5c0ca13 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:15.797577 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 784/1570] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:15 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:15.798246 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4926b5-8812-4543-b56f-d1cea5c0ca13 service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:15.806943 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4926b5-8812-4543-b56f-d1cea5c0ca13 service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:15.811867 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bbe89-7ddb-43f6-bd5d-8a9d0a9ed91e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:15.812606 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bbe89-7ddb-43f6-bd5d-8a9d0a9ed91e service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:15.812920 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bbe89-7ddb-43f6-bd5d-8a9d0a9ed91e service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:15.813241 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bbe89-7ddb-43f6-bd5d-8a9d0a9ed91e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:15.826828 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bbe89-7ddb-43f6-bd5d-8a9d0a9ed91e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:15.845430 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 787/1571] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:15 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:15.846201 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32db84-1678-4f9b-acd5-bb29c79decf3 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:15.862209 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32db84-1678-4f9b-acd5-bb29c79decf3 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:15.869488 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f72d1-9bf8-4c20-9ac3-103e8e8a22c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:15.870292 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f72d1-9bf8-4c20-9ac3-103e8e8a22c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:15.870459 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bbe89-7ddb-43f6-bd5d-8a9d0a9ed91e service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:15.870605 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f72d1-9bf8-4c20-9ac3-103e8e8a22c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:15.870902 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f72d1-9bf8-4c20-9ac3-103e8e8a22c5 admin admin] PATH_INFO: `/v3/projects/9cda7fcb2df44f57b41324ac138cd11c/users/398c859a59124c4187a7d6dad1ba1fec/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:15.882309 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 785/1572] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:15 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:15.883227 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bbe89-7ddb-43f6-bd5d-8a9d0a9ed91e service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:15.893415 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bbe89-7ddb-43f6-bd5d-8a9d0a9ed91e service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:15.896466 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f72d1-9bf8-4c20-9ac3-103e8e8a22c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cda7fcb2df44f57b41324ac138cd11c, user_id=398c859a59124c4187a7d6dad1ba1fec, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:15.898782 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc793c7-b9e6-4286-a267-9499d8bc088c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:15.899483 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc793c7-b9e6-4286-a267-9499d8bc088c service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:15.899842 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc793c7-b9e6-4286-a267-9499d8bc088c service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:15.900196 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc793c7-b9e6-4286-a267-9499d8bc088c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:15.912430 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc793c7-b9e6-4286-a267-9499d8bc088c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:15.924819 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903f72d1-9bf8-4c20-9ac3-103e8e8a22c5 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:15.944107 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 788/1573] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:15 2021] PUT /identity/v3/projects/9cda7fcb2df44f57b41324ac138cd11c/users/398c859a59124c4187a7d6dad1ba1fec/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:15.944674 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc793c7-b9e6-4286-a267-9499d8bc088c service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:15.944951 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f72d1-9bf8-4c20-9ac3-103e8e8a22c5 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:15.956302 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 786/1574] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:15 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:15.957123 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc793c7-b9e6-4286-a267-9499d8bc088c service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:15.966809 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc793c7-b9e6-4286-a267-9499d8bc088c service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:16.050330 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903f72d1-9bf8-4c20-9ac3-103e8e8a22c5 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:16.055737 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ccf6b-0907-4c78-87f5-da5a73ca8801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:16.056361 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8f3b5-8aa8-4ba3-a780-9dae94d054e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:16.056486 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ccf6b-0907-4c78-87f5-da5a73ca8801 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:16.056759 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ccf6b-0907-4c78-87f5-da5a73ca8801 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:16.056965 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8f3b5-8aa8-4ba3-a780-9dae94d054e8 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:16.057074 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ccf6b-0907-4c78-87f5-da5a73ca8801 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:16.057166 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8f3b5-8aa8-4ba3-a780-9dae94d054e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:16.057421 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8f3b5-8aa8-4ba3-a780-9dae94d054e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:16.057535 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ccf6b-0907-4c78-87f5-da5a73ca8801 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:16.059305 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8f3b5-8aa8-4ba3-a780-9dae94d054e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:16.084229 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ccf6b-0907-4c78-87f5-da5a73ca8801 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:16.087709 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8f3b5-8aa8-4ba3-a780-9dae94d054e8 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:16.120035 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 789/1575] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:05:15 2021] POST /identity/v3/projects => generated 403 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:16.122496 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad84541-376a-493a-88e3-0c2eda4e7a60 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:16.123238 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad84541-376a-493a-88e3-0c2eda4e7a60 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:16.124195 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad84541-376a-493a-88e3-0c2eda4e7a60 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:16.126180 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 790/1576] 10.222.0.89 () {54 vars in 954 bytes} [Wed Oct 27 15:05:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:05:16.131471 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 787/1577] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:05:15 2021] POST /identity/v3/projects => generated 365 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:16.132459 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad84541-376a-493a-88e3-0c2eda4e7a60 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:16.134145 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8f3b5-8aa8-4ba3-a780-9dae94d054e8 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:16.210844 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8f3b5-8aa8-4ba3-a780-9dae94d054e8 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:16.217111 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cd7e8-25b8-43ab-86f5-08f30b871dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:16.217111 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cd7e8-25b8-43ab-86f5-08f30b871dfe admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:16.217421 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cd7e8-25b8-43ab-86f5-08f30b871dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:16.217646 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cd7e8-25b8-43ab-86f5-08f30b871dfe admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:16.218322 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cd7e8-25b8-43ab-86f5-08f30b871dfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:16.225939 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad84541-376a-493a-88e3-0c2eda4e7a60 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:16.232516 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dad9a0-01da-4f17-b2bd-fb18fd17755a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:16.233527 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dad9a0-01da-4f17-b2bd-fb18fd17755a admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:16.234324 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dad9a0-01da-4f17-b2bd-fb18fd17755a admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:16.234898 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dad9a0-01da-4f17-b2bd-fb18fd17755a admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:16.236552 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dad9a0-01da-4f17-b2bd-fb18fd17755a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:16.249480 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cd7e8-25b8-43ab-86f5-08f30b871dfe admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:16.272540 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dad9a0-01da-4f17-b2bd-fb18fd17755a admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:16.279780 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 788/1578] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:05:16 2021] POST /identity/v3/users => generated 308 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:16.279780 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37e5ed-af85-4178-b648-ecea16ecab72 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:16.279780 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37e5ed-af85-4178-b648-ecea16ecab72 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:16.280148 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37e5ed-af85-4178-b648-ecea16ecab72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:16.292249 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 791/1579] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:16 2021] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:16.294748 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dad9a0-01da-4f17-b2bd-fb18fd17755a admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:16.305149 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dad9a0-01da-4f17-b2bd-fb18fd17755a admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:16.306809 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-3f37e5ed-af85-4178-b648-ecea16ecab72 None None] MFA Rules not processed for user `01acdb65e66441418d4abe1f0ed804bc`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:16.308143 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-3f37e5ed-af85-4178-b648-ecea16ecab72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:16.311613 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f43e84-1d52-4c4a-8354-09125496a559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:16.312731 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f43e84-1d52-4c4a-8354-09125496a559 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:16.313254 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f43e84-1d52-4c4a-8354-09125496a559 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:16.313700 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f43e84-1d52-4c4a-8354-09125496a559 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:16.314349 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f43e84-1d52-4c4a-8354-09125496a559 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:16.344980 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f43e84-1d52-4c4a-8354-09125496a559 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:16.396748 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 792/1580] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:05:16 2021] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:16.397636 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f43e84-1d52-4c4a-8354-09125496a559 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:16.403176 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 789/1581] 10.222.0.89 () {58 vars in 1051 bytes} [Wed Oct 27 15:05:16 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:16.412747 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f43e84-1d52-4c4a-8354-09125496a559 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:16.415127 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37e5ed-af85-4178-b648-ecea16ecab72 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:16.419513 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec345051-5cbb-4e25-bcd3-4a7843632ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:16.420379 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec345051-5cbb-4e25-bcd3-4a7843632ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:16.420763 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec345051-5cbb-4e25-bcd3-4a7843632ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:16.421155 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec345051-5cbb-4e25-bcd3-4a7843632ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:16.422808 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec345051-5cbb-4e25-bcd3-4a7843632ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:16.430424 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37e5ed-af85-4178-b648-ecea16ecab72 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:16.436972 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4794775-8533-44c6-97fc-5c982eeb1d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:16.438150 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4794775-8533-44c6-97fc-5c982eeb1d26 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:16.438669 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4794775-8533-44c6-97fc-5c982eeb1d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:16.439191 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4794775-8533-44c6-97fc-5c982eeb1d26 admin admin] PATH_INFO: `/v3/projects/9cda7fcb2df44f57b41324ac138cd11c/users/398c859a59124c4187a7d6dad1ba1fec/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:16.442953 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4794775-8533-44c6-97fc-5c982eeb1d26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cda7fcb2df44f57b41324ac138cd11c, user_id=398c859a59124c4187a7d6dad1ba1fec, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:16.469550 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec345051-5cbb-4e25-bcd3-4a7843632ae0 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:16.481314 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4794775-8533-44c6-97fc-5c982eeb1d26 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:16.483768 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 793/1582] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:16 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:16.484658 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec345051-5cbb-4e25-bcd3-4a7843632ae0 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:16.495072 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 790/1583] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:16 2021] PUT /identity/v3/projects/9cda7fcb2df44f57b41324ac138cd11c/users/398c859a59124c4187a7d6dad1ba1fec/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:16.496912 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4794775-8533-44c6-97fc-5c982eeb1d26 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:16.502880 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec345051-5cbb-4e25-bcd3-4a7843632ae0 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:16.611500 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfd772-25d4-44c4-bd4e-17db81a756f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:16.612133 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfd772-25d4-44c4-bd4e-17db81a756f6 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:16.612418 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfd772-25d4-44c4-bd4e-17db81a756f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:16.612695 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcfd772-25d4-44c4-bd4e-17db81a756f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:16.613424 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfd772-25d4-44c4-bd4e-17db81a756f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:16.653372 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcfd772-25d4-44c4-bd4e-17db81a756f6 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:16.670903 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 794/1584] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:16 2021] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:16.670903 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfd772-25d4-44c4-bd4e-17db81a756f6 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:16.681340 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcfd772-25d4-44c4-bd4e-17db81a756f6 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:16.688215 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3a4d2-4d21-42cf-b9cb-3a9d0c39bd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:16.689142 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3a4d2-4d21-42cf-b9cb-3a9d0c39bd9c admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:16.689428 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3a4d2-4d21-42cf-b9cb-3a9d0c39bd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:16.689705 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a3a4d2-4d21-42cf-b9cb-3a9d0c39bd9c admin admin] PATH_INFO: `/v3/projects/11acfaf80222413297ff606b534d98f7/users/901ee194badd466b928068f8efb48719/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:16.719312 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3a4d2-4d21-42cf-b9cb-3a9d0c39bd9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=11acfaf80222413297ff606b534d98f7, user_id=901ee194badd466b928068f8efb48719, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:16.761144 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a3a4d2-4d21-42cf-b9cb-3a9d0c39bd9c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:16.771968 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4794775-8533-44c6-97fc-5c982eeb1d26 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:16.782812 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f825636-9eb0-4c25-ba1c-734aad99dc4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:16.785182 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f825636-9eb0-4c25-ba1c-734aad99dc4b service nova] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:16.785956 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f825636-9eb0-4c25-ba1c-734aad99dc4b service nova] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:16.786101 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 795/1585] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:16 2021] PUT /identity/v3/projects/11acfaf80222413297ff606b534d98f7/users/901ee194badd466b928068f8efb48719/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:16.786800 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f825636-9eb0-4c25-ba1c-734aad99dc4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:16.787038 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3a4d2-4d21-42cf-b9cb-3a9d0c39bd9c admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:16.897656 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f825636-9eb0-4c25-ba1c-734aad99dc4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:16.932248 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a3a4d2-4d21-42cf-b9cb-3a9d0c39bd9c admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:16.938694 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132816d-55d8-466b-8080-0b072b0e6d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:16.940075 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132816d-55d8-466b-8080-0b072b0e6d1f admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:16.940075 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132816d-55d8-466b-8080-0b072b0e6d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:16.940075 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132816d-55d8-466b-8080-0b072b0e6d1f admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:16.947586 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f825636-9eb0-4c25-ba1c-734aad99dc4b service nova] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:16.948819 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132816d-55d8-466b-8080-0b072b0e6d1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:16.976012 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 791/1586] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:16 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:16.979641 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f825636-9eb0-4c25-ba1c-734aad99dc4b service nova] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:17.011697 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f825636-9eb0-4c25-ba1c-734aad99dc4b service nova] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:17.024557 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4150b-39ef-492b-98d7-8093cbfdbebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:17.025369 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132816d-55d8-466b-8080-0b072b0e6d1f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:17.026628 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4150b-39ef-492b-98d7-8093cbfdbebf admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:17.026928 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4150b-39ef-492b-98d7-8093cbfdbebf admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:17.027209 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f4150b-39ef-492b-98d7-8093cbfdbebf admin admin] PATH_INFO: `/v3/projects/5f8168a77ec6404c928e7bb36650cb9f/users/2ecbf584500043d3ae4de8617e323543/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:17.047796 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 796/1587] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:16 2021] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:17.049301 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132816d-55d8-466b-8080-0b072b0e6d1f admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:17.068300 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132816d-55d8-466b-8080-0b072b0e6d1f admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:17.074815 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8c9eb-5374-4682-b68e-c7e8e8768233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:17.076006 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8c9eb-5374-4682-b68e-c7e8e8768233 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:17.076359 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8c9eb-5374-4682-b68e-c7e8e8768233 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:17.076645 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8c9eb-5374-4682-b68e-c7e8e8768233 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:17.077448 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a8c9eb-5374-4682-b68e-c7e8e8768233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:17.099027 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4150b-39ef-492b-98d7-8093cbfdbebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f8168a77ec6404c928e7bb36650cb9f, user_id=2ecbf584500043d3ae4de8617e323543, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:17.113859 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a8c9eb-5374-4682-b68e-c7e8e8768233 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:17.126764 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 797/1588] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:17 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:17.127730 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8c9eb-5374-4682-b68e-c7e8e8768233 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:17.140109 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8c9eb-5374-4682-b68e-c7e8e8768233 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:17.145805 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991258e-713e-41f2-902d-20895a46c6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:17.146719 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991258e-713e-41f2-902d-20895a46c6f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:17.147058 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991258e-713e-41f2-902d-20895a46c6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:17.147345 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991258e-713e-41f2-902d-20895a46c6f5 admin admin] PATH_INFO: `/v3/projects/9cda7fcb2df44f57b41324ac138cd11c/users/398c859a59124c4187a7d6dad1ba1fec/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:17.149739 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991258e-713e-41f2-902d-20895a46c6f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cda7fcb2df44f57b41324ac138cd11c, user_id=398c859a59124c4187a7d6dad1ba1fec, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:17.177266 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f4150b-39ef-492b-98d7-8093cbfdbebf admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:17.200558 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0991258e-713e-41f2-902d-20895a46c6f5 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:17.211810 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 792/1589] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:16 2021] PUT /identity/v3/projects/5f8168a77ec6404c928e7bb36650cb9f/users/2ecbf584500043d3ae4de8617e323543/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:17.211810 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4150b-39ef-492b-98d7-8093cbfdbebf admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:17.232412 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 798/1590] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:17 2021] PUT /identity/v3/projects/9cda7fcb2df44f57b41324ac138cd11c/users/398c859a59124c4187a7d6dad1ba1fec/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:17.244043 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991258e-713e-41f2-902d-20895a46c6f5 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:17.401805 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f4150b-39ef-492b-98d7-8093cbfdbebf admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:17.404192 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991258e-713e-41f2-902d-20895a46c6f5 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:17.411284 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c487dc8-8542-4c9a-8bb7-37fffbeaa2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:17.411651 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478956bf-d9ff-4aaa-945d-9b1d06e34d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:17.412461 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478956bf-d9ff-4aaa-945d-9b1d06e34d37 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:17.412749 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478956bf-d9ff-4aaa-945d-9b1d06e34d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:17.413030 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478956bf-d9ff-4aaa-945d-9b1d06e34d37 admin admin] PATH_INFO: `/v3/projects/11acfaf80222413297ff606b534d98f7/users/901ee194badd466b928068f8efb48719/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:17.413156 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c487dc8-8542-4c9a-8bb7-37fffbeaa2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:17.413711 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c487dc8-8542-4c9a-8bb7-37fffbeaa2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:17.415392 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c487dc8-8542-4c9a-8bb7-37fffbeaa2e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:17.415392 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c487dc8-8542-4c9a-8bb7-37fffbeaa2e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:17.420127 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478956bf-d9ff-4aaa-945d-9b1d06e34d37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11acfaf80222413297ff606b534d98f7, user_id=901ee194badd466b928068f8efb48719, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:17.446271 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c487dc8-8542-4c9a-8bb7-37fffbeaa2e7 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:17.473834 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 799/1591] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:17 2021] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:17.477642 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa56b76-fc2d-4343-a92e-54f8e2afa4bd None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:17.477832 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa56b76-fc2d-4343-a92e-54f8e2afa4bd None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:17.479314 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa56b76-fc2d-4343-a92e-54f8e2afa4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:17.483389 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478956bf-d9ff-4aaa-945d-9b1d06e34d37 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:17.511401 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 793/1592] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:17 2021] PUT /identity/v3/projects/11acfaf80222413297ff606b534d98f7/users/901ee194badd466b928068f8efb48719/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:17.511401 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478956bf-d9ff-4aaa-945d-9b1d06e34d37 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:17.584473 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-3fa56b76-fc2d-4343-a92e-54f8e2afa4bd None None] MFA Rules not processed for user `398c859a59124c4187a7d6dad1ba1fec`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:17.588752 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-3fa56b76-fc2d-4343-a92e-54f8e2afa4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:17.716217 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478956bf-d9ff-4aaa-945d-9b1d06e34d37 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:17.733424 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54bbe8-36a8-4f78-94a5-d176acb350db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:17.735222 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54bbe8-36a8-4f78-94a5-d176acb350db admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:17.736026 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54bbe8-36a8-4f78-94a5-d176acb350db admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:17.737447 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54bbe8-36a8-4f78-94a5-d176acb350db admin admin] PATH_INFO: `/v3/projects/5f8168a77ec6404c928e7bb36650cb9f/users/2ecbf584500043d3ae4de8617e323543/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:17.745087 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54bbe8-36a8-4f78-94a5-d176acb350db admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f8168a77ec6404c928e7bb36650cb9f, user_id=2ecbf584500043d3ae4de8617e323543, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:17.747220 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 800/1593] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:17 2021] POST /identity/v3/auth/tokens => generated 3761 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:17.755984 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa56b76-fc2d-4343-a92e-54f8e2afa4bd None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:17.776869 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa56b76-fc2d-4343-a92e-54f8e2afa4bd None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:17.786072 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0be7a9-376f-4aa3-b1ec-4f165a19ac0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:17.786920 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0be7a9-376f-4aa3-b1ec-4f165a19ac0a admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:17.787213 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0be7a9-376f-4aa3-b1ec-4f165a19ac0a admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:17.787576 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0be7a9-376f-4aa3-b1ec-4f165a19ac0a admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:17.788584 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0be7a9-376f-4aa3-b1ec-4f165a19ac0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:17.815977 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54bbe8-36a8-4f78-94a5-d176acb350db admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:17.828419 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0be7a9-376f-4aa3-b1ec-4f165a19ac0a admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:17.835627 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 794/1594] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:17 2021] PUT /identity/v3/projects/5f8168a77ec6404c928e7bb36650cb9f/users/2ecbf584500043d3ae4de8617e323543/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:17.838084 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54bbe8-36a8-4f78-94a5-d176acb350db admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:17.851082 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 801/1595] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:17 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:17.851082 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0be7a9-376f-4aa3-b1ec-4f165a19ac0a admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:17.864968 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0be7a9-376f-4aa3-b1ec-4f165a19ac0a admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:17.950894 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5835fbe-00dd-41a8-bf74-4a58b659db2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:17.951555 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5835fbe-00dd-41a8-bf74-4a58b659db2b admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:17.951843 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5835fbe-00dd-41a8-bf74-4a58b659db2b admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:17.952120 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5835fbe-00dd-41a8-bf74-4a58b659db2b admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:17.952832 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5835fbe-00dd-41a8-bf74-4a58b659db2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:17.972272 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54bbe8-36a8-4f78-94a5-d176acb350db admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:17.976423 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6076ab-f7aa-4c11-8844-8eefcb37d271 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:17.977799 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6076ab-f7aa-4c11-8844-8eefcb37d271 service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:17.978285 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6076ab-f7aa-4c11-8844-8eefcb37d271 service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:17.978756 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6076ab-f7aa-4c11-8844-8eefcb37d271 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:17.996954 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5835fbe-00dd-41a8-bf74-4a58b659db2b admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:18.009395 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 802/1596] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:17 2021] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:18.010252 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5835fbe-00dd-41a8-bf74-4a58b659db2b admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:18.020850 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5835fbe-00dd-41a8-bf74-4a58b659db2b admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:18.027061 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13ab66-a149-4b15-bb55-eaa2b6514808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:18.028857 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13ab66-a149-4b15-bb55-eaa2b6514808 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:18.029146 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13ab66-a149-4b15-bb55-eaa2b6514808 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:18.029426 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13ab66-a149-4b15-bb55-eaa2b6514808 admin admin] PATH_INFO: `/v3/projects/11acfaf80222413297ff606b534d98f7/users/901ee194badd466b928068f8efb48719/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:18.031578 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13ab66-a149-4b15-bb55-eaa2b6514808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11acfaf80222413297ff606b534d98f7, user_id=901ee194badd466b928068f8efb48719, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:18.068793 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13ab66-a149-4b15-bb55-eaa2b6514808 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:18.087678 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 803/1597] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:18 2021] PUT /identity/v3/projects/11acfaf80222413297ff606b534d98f7/users/901ee194badd466b928068f8efb48719/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:18.087678 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13ab66-a149-4b15-bb55-eaa2b6514808 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:18.092132 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6076ab-f7aa-4c11-8844-8eefcb37d271 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:18.126280 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6076ab-f7aa-4c11-8844-8eefcb37d271 service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:18.153311 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 795/1598] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:17 2021] GET /identity/v3/auth/tokens => generated 3761 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:18.154680 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6076ab-f7aa-4c11-8844-8eefcb37d271 service cinder] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:18.178648 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6076ab-f7aa-4c11-8844-8eefcb37d271 service cinder] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:18.240871 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13ab66-a149-4b15-bb55-eaa2b6514808 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:18.248611 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a71ee-a1fa-4ffa-b0cd-a9ee88205e85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:18.249565 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a71ee-a1fa-4ffa-b0cd-a9ee88205e85 service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:18.250067 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a71ee-a1fa-4ffa-b0cd-a9ee88205e85 service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:18.250509 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a71ee-a1fa-4ffa-b0cd-a9ee88205e85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:18.355975 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57674b4-4b28-475a-9105-63191a7cfb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:18.356822 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57674b4-4b28-475a-9105-63191a7cfb44 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:18.360814 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57674b4-4b28-475a-9105-63191a7cfb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:18.362467 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57674b4-4b28-475a-9105-63191a7cfb44 admin admin] PATH_INFO: `/v3/projects/5f8168a77ec6404c928e7bb36650cb9f/users/2ecbf584500043d3ae4de8617e323543/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:18.377072 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57674b4-4b28-475a-9105-63191a7cfb44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f8168a77ec6404c928e7bb36650cb9f, user_id=2ecbf584500043d3ae4de8617e323543, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:18.437670 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57674b4-4b28-475a-9105-63191a7cfb44 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:18.441163 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a71ee-a1fa-4ffa-b0cd-a9ee88205e85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:18.469492 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a71ee-a1fa-4ffa-b0cd-a9ee88205e85 service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:18.470869 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 796/1599] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:18 2021] PUT /identity/v3/projects/5f8168a77ec6404c928e7bb36650cb9f/users/2ecbf584500043d3ae4de8617e323543/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:18.475178 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff992f5-14c3-4411-863c-4b65f99dd6a7 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:18.475876 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff992f5-14c3-4411-863c-4b65f99dd6a7 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:18.476266 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff992f5-14c3-4411-863c-4b65f99dd6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:18.495578 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 804/1600] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:18 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:18.496983 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a71ee-a1fa-4ffa-b0cd-a9ee88205e85 service cinder] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:18.507908 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a71ee-a1fa-4ffa-b0cd-a9ee88205e85 service cinder] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:18.574654 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-3ff992f5-14c3-4411-863c-4b65f99dd6a7 None None] MFA Rules not processed for user `901ee194badd466b928068f8efb48719`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:18.575719 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-3ff992f5-14c3-4411-863c-4b65f99dd6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:18.644901 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0636943-8ef2-44ee-8d48-d659a154fe82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:18.649957 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0636943-8ef2-44ee-8d48-d659a154fe82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:18.650314 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0636943-8ef2-44ee-8d48-d659a154fe82 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:18.650633 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0636943-8ef2-44ee-8d48-d659a154fe82 admin admin] PATH_INFO: `/v3/users/5eca6611d0c74d55a07c52cf5f42d0d7` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:18.653361 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0636943-8ef2-44ee-8d48-d659a154fe82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eca6611d0c74d55a07c52cf5f42d0d7)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:18.700782 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: WARNING py.warnings [None req-f0636943-8ef2-44ee-8d48-d659a154fe82 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:05:18.700782 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: warnings.warn(msg) Oct 27 15:05:18.700782 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: Oct 27 15:05:18.702034 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0636943-8ef2-44ee-8d48-d659a154fe82 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:18.820204 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 797/1601] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:18 2021] POST /identity/v3/auth/tokens => generated 3777 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:18.825926 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7646c5-df23-4c50-9058-f1c59dca7205 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:18.826381 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7646c5-df23-4c50-9058-f1c59dca7205 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:18.826526 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7646c5-df23-4c50-9058-f1c59dca7205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:18.866241 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-f0636943-8ef2-44ee-8d48-d659a154fe82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eca6611d0c74d55a07c52cf5f42d0d7'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:18.866990 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-f0636943-8ef2-44ee-8d48-d659a154fe82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eca6611d0c74d55a07c52cf5f42d0d7'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:18.911489 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-f0636943-8ef2-44ee-8d48-d659a154fe82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eca6611d0c74d55a07c52cf5f42d0d7'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:18.928606 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-f0636943-8ef2-44ee-8d48-d659a154fe82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eca6611d0c74d55a07c52cf5f42d0d7'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:18.936307 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-4f7646c5-df23-4c50-9058-f1c59dca7205 None None] MFA Rules not processed for user `2ecbf584500043d3ae4de8617e323543`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:18.938262 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-4f7646c5-df23-4c50-9058-f1c59dca7205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:18.951155 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-f0636943-8ef2-44ee-8d48-d659a154fe82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eca6611d0c74d55a07c52cf5f42d0d7'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:18.964150 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 805/1602] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:05:18 2021] DELETE /identity/v3/users/5eca6611d0c74d55a07c52cf5f42d0d7 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:18.967734 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0636943-8ef2-44ee-8d48-d659a154fe82 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:18.972127 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-f0636943-8ef2-44ee-8d48-d659a154fe82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:19.123530 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 798/1603] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:18 2021] POST /identity/v3/auth/tokens => generated 3739 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:19.124893 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c4b1f-0774-4a64-93a8-179c24145557 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:19.125527 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c4b1f-0774-4a64-93a8-179c24145557 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:19.125527 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c4b1f-0774-4a64-93a8-179c24145557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:19.145747 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0636943-8ef2-44ee-8d48-d659a154fe82 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:19.151490 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9a2f45-f8b9-4fbb-a17d-32a39ce1cb50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:19.152405 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a2f45-f8b9-4fbb-a17d-32a39ce1cb50 service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:19.153181 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a2f45-f8b9-4fbb-a17d-32a39ce1cb50 service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:19.153848 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9a2f45-f8b9-4fbb-a17d-32a39ce1cb50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:19.158087 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-5e9a2f45-f8b9-4fbb-a17d-32a39ce1cb50 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:19.179266 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-9a4c4b1f-0774-4a64-93a8-179c24145557 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:19.185141 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-9a4c4b1f-0774-4a64-93a8-179c24145557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:19.362730 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 799/1604] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:19.362730 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ffefc-e12e-4887-b041-1fd958b07a49 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:19.362730 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ffefc-e12e-4887-b041-1fd958b07a49 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:19.362730 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ffefc-e12e-4887-b041-1fd958b07a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:19.459831 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-026ffefc-e12e-4887-b041-1fd958b07a49 None None] MFA Rules not processed for user `ab3f55859b1145fea22fe89a83c366e5`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:19.461845 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-026ffefc-e12e-4887-b041-1fd958b07a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:19.544812 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9a2f45-f8b9-4fbb-a17d-32a39ce1cb50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:19.580654 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9a2f45-f8b9-4fbb-a17d-32a39ce1cb50 service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:19.593704 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 806/1605] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:18 2021] GET /identity/v3/auth/tokens => generated 3777 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:19.595249 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa173b2-89e2-49f7-8487-622d0b71db3e None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:19.595753 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa173b2-89e2-49f7-8487-622d0b71db3e None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:19.596216 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa173b2-89e2-49f7-8487-622d0b71db3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:19.625702 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 800/1606] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:19 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:19.626478 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ffefc-e12e-4887-b041-1fd958b07a49 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:19.627780 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-026ffefc-e12e-4887-b041-1fd958b07a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:19.647957 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-5aa173b2-89e2-49f7-8487-622d0b71db3e None None] MFA Rules not processed for user `7a86cdc90706440c8fa6bf9e101573b9`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:19.649445 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-5aa173b2-89e2-49f7-8487-622d0b71db3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:19.655863 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ffefc-e12e-4887-b041-1fd958b07a49 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:19.670540 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619a3e6-3854-4d63-b4a5-a0e1f49f4370 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:19.671184 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619a3e6-3854-4d63-b4a5-a0e1f49f4370 service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:19.671562 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619a3e6-3854-4d63-b4a5-a0e1f49f4370 service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:19.671846 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619a3e6-3854-4d63-b4a5-a0e1f49f4370 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:19.806122 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 807/1607] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:19 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:19.807238 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa173b2-89e2-49f7-8487-622d0b71db3e None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:19.809598 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-5aa173b2-89e2-49f7-8487-622d0b71db3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:19.836524 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619a3e6-3854-4d63-b4a5-a0e1f49f4370 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:19.888630 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619a3e6-3854-4d63-b4a5-a0e1f49f4370 service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:19.914736 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 801/1608] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:19 2021] GET /identity/v3/auth/tokens => generated 3739 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:19.916636 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72313b5f-3bfa-42f1-b84c-ec68cbee4916 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:19.917058 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72313b5f-3bfa-42f1-b84c-ec68cbee4916 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:19.917526 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72313b5f-3bfa-42f1-b84c-ec68cbee4916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:19.958748 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa173b2-89e2-49f7-8487-622d0b71db3e None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:19.970939 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d310bf-299c-4c45-a86c-340a35d9b326 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:19.971781 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d310bf-299c-4c45-a86c-340a35d9b326 service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:19.972190 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d310bf-299c-4c45-a86c-340a35d9b326 service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:19.972477 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d310bf-299c-4c45-a86c-340a35d9b326 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:19.986191 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-72313b5f-3bfa-42f1-b84c-ec68cbee4916 None None] MFA Rules not processed for user `ab3f55859b1145fea22fe89a83c366e5`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:19.987668 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-72313b5f-3bfa-42f1-b84c-ec68cbee4916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:20.005345 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 802/1609] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:19 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:20.006699 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fbd63-7379-42c5-8055-3e10a0fe2400 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:20.006994 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fbd63-7379-42c5-8055-3e10a0fe2400 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:20.007273 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fbd63-7379-42c5-8055-3e10a0fe2400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:20.008246 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d310bf-299c-4c45-a86c-340a35d9b326 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:20.060581 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-f41fbd63-7379-42c5-8055-3e10a0fe2400 None None] MFA Rules not processed for user `7a86cdc90706440c8fa6bf9e101573b9`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:20.062066 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-f41fbd63-7379-42c5-8055-3e10a0fe2400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:20.074584 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d310bf-299c-4c45-a86c-340a35d9b326 service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:20.079399 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 803/1610] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:20 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:20.079399 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaca6c9-bd87-4a21-832a-fe9b6dee63ee None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:20.079399 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaca6c9-bd87-4a21-832a-fe9b6dee63ee None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:20.079399 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaca6c9-bd87-4a21-832a-fe9b6dee63ee None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:20.085746 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 804/1611] 10.222.0.89 () {54 vars in 954 bytes} [Wed Oct 27 15:05:20 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:05:20.087093 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e25a9-8205-489a-a1dd-3804bc66344d None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:20.087490 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e25a9-8205-489a-a1dd-3804bc66344d None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:20.087749 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e25a9-8205-489a-a1dd-3804bc66344d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:20.114500 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 808/1612] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:19 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:20.115536 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d310bf-299c-4c45-a86c-340a35d9b326 service neutron] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:20.116945 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-37d310bf-299c-4c45-a86c-340a35d9b326 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:20.162254 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-317e25a9-8205-489a-a1dd-3804bc66344d None None] MFA Rules not processed for user `01acdb65e66441418d4abe1f0ed804bc`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:20.163534 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-317e25a9-8205-489a-a1dd-3804bc66344d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:20.243732 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d310bf-299c-4c45-a86c-340a35d9b326 service neutron] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:20.252427 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a1797-e725-4b85-9db4-0870a0e05136 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:20.253948 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a1797-e725-4b85-9db4-0870a0e05136 service nova] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:20.254639 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a1797-e725-4b85-9db4-0870a0e05136 service nova] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:20.255135 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a1797-e725-4b85-9db4-0870a0e05136 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:20.270613 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a1797-e725-4b85-9db4-0870a0e05136 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:20.333670 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a1797-e725-4b85-9db4-0870a0e05136 service nova] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:20.386770 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 805/1614] 10.222.0.89 () {58 vars in 1051 bytes} [Wed Oct 27 15:05:20 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:20.387354 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 809/1614] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:20 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:20.388367 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a1797-e725-4b85-9db4-0870a0e05136 service nova] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:20.394493 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e25a9-8205-489a-a1dd-3804bc66344d None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:20.397931 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-780a1797-e725-4b85-9db4-0870a0e05136 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:20.409467 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e25a9-8205-489a-a1dd-3804bc66344d None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:20.428332 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6109c-2662-4d58-b990-0d1b2e39de90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:20.429405 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6109c-2662-4d58-b990-0d1b2e39de90 service nova] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:20.432431 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6109c-2662-4d58-b990-0d1b2e39de90 service nova] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:20.433651 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6109c-2662-4d58-b990-0d1b2e39de90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:20.437866 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a1797-e725-4b85-9db4-0870a0e05136 service nova] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:20.451341 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4c108-e521-44f8-8319-bd77db0fb1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:20.454098 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4c108-e521-44f8-8319-bd77db0fb1d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:20.456002 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4c108-e521-44f8-8319-bd77db0fb1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:20.456514 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4c108-e521-44f8-8319-bd77db0fb1d3 admin admin] PATH_INFO: `/v3/users/84f52e9dd7974ae09a2b2f2b0071c8b8` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:20.461898 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6109c-2662-4d58-b990-0d1b2e39de90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:20.463196 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f4c108-e521-44f8-8319-bd77db0fb1d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84f52e9dd7974ae09a2b2f2b0071c8b8)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:20.528040 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6109c-2662-4d58-b990-0d1b2e39de90 service nova] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:20.550339 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 806/1615] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:20 2021] GET /identity/v3/auth/tokens => generated 3686 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:05:20.552371 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6109c-2662-4d58-b990-0d1b2e39de90 service nova] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:20.556366 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-75a6109c-2662-4d58-b990-0d1b2e39de90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:20.568054 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f4c108-e521-44f8-8319-bd77db0fb1d3 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:20.605999 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6109c-2662-4d58-b990-0d1b2e39de90 service nova] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:20.616527 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d75d5-857f-4e1d-b448-ea0551dab371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:20.617945 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d75d5-857f-4e1d-b448-ea0551dab371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:20.618108 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d75d5-857f-4e1d-b448-ea0551dab371 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:20.618511 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d75d5-857f-4e1d-b448-ea0551dab371 admin admin] PATH_INFO: `/v3/users/18a56f64e9c842d8929defb7c6a18889` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:20.620087 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d75d5-857f-4e1d-b448-ea0551dab371 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18a56f64e9c842d8929defb7c6a18889)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:20.680903 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-94f4c108-e521-44f8-8319-bd77db0fb1d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84f52e9dd7974ae09a2b2f2b0071c8b8'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:20.681767 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-94f4c108-e521-44f8-8319-bd77db0fb1d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84f52e9dd7974ae09a2b2f2b0071c8b8'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:20.693576 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d75d5-857f-4e1d-b448-ea0551dab371 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:20.701051 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-94f4c108-e521-44f8-8319-bd77db0fb1d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84f52e9dd7974ae09a2b2f2b0071c8b8'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:20.710794 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-94f4c108-e521-44f8-8319-bd77db0fb1d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84f52e9dd7974ae09a2b2f2b0071c8b8'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:20.725233 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-94f4c108-e521-44f8-8319-bd77db0fb1d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84f52e9dd7974ae09a2b2f2b0071c8b8'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:20.736679 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 810/1616] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:05:20 2021] DELETE /identity/v3/users/84f52e9dd7974ae09a2b2f2b0071c8b8 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:20.741624 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea29de-7af7-4954-80cf-a21a1b23a5fb None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:20.742043 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea29de-7af7-4954-80cf-a21a1b23a5fb None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:20.742604 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea29de-7af7-4954-80cf-a21a1b23a5fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:20.778452 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-41ea29de-7af7-4954-80cf-a21a1b23a5fb None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:20.780487 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-41ea29de-7af7-4954-80cf-a21a1b23a5fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:20.851429 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-7d2d75d5-857f-4e1d-b448-ea0551dab371 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18a56f64e9c842d8929defb7c6a18889'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:20.888322 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-7d2d75d5-857f-4e1d-b448-ea0551dab371 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18a56f64e9c842d8929defb7c6a18889'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:20.889113 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-7d2d75d5-857f-4e1d-b448-ea0551dab371 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18a56f64e9c842d8929defb7c6a18889'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:20.901551 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-7d2d75d5-857f-4e1d-b448-ea0551dab371 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18a56f64e9c842d8929defb7c6a18889'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:20.922658 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-7d2d75d5-857f-4e1d-b448-ea0551dab371 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18a56f64e9c842d8929defb7c6a18889'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:20.931369 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 811/1617] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:20.943760 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 807/1618] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:05:20 2021] DELETE /identity/v3/users/18a56f64e9c842d8929defb7c6a18889 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:20.949522 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0a308-6b66-45b9-a1bd-52b674becffb None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:20.953079 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0a308-6b66-45b9-a1bd-52b674becffb None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:20.953614 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0a308-6b66-45b9-a1bd-52b674becffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:21.016484 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-6ea0a308-6b66-45b9-a1bd-52b674becffb None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:21.018126 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-6ea0a308-6b66-45b9-a1bd-52b674becffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:21.042398 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d75d5-857f-4e1d-b448-ea0551dab371 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:21.044411 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-7d2d75d5-857f-4e1d-b448-ea0551dab371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:21.174008 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 812/1619] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:21.217224 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d75d5-857f-4e1d-b448-ea0551dab371 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:21.221961 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8f9fb1-9f19-4aee-82ef-7b0ce329b2f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:21.222817 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f9fb1-9f19-4aee-82ef-7b0ce329b2f1 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:21.223290 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f9fb1-9f19-4aee-82ef-7b0ce329b2f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:21.223610 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f9fb1-9f19-4aee-82ef-7b0ce329b2f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:21.244510 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f9fb1-9f19-4aee-82ef-7b0ce329b2f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:21.303206 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8f9fb1-9f19-4aee-82ef-7b0ce329b2f1 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:21.305165 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0a308-6b66-45b9-a1bd-52b674becffb None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:21.306832 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-6ea0a308-6b66-45b9-a1bd-52b674becffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:21.323564 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0a308-6b66-45b9-a1bd-52b674becffb None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:21.331041 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 808/1620] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:21 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:21.332977 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a08b8f5-bd00-4362-85fa-841e241de85c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:21.333588 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08b8f5-bd00-4362-85fa-841e241de85c service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:21.333867 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08b8f5-bd00-4362-85fa-841e241de85c service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:21.334146 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a08b8f5-bd00-4362-85fa-841e241de85c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:21.358746 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08b8f5-bd00-4362-85fa-841e241de85c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:21.397132 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a08b8f5-bd00-4362-85fa-841e241de85c service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:21.409967 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 813/1621] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:21 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:05:21.434250 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21447632-7956-497a-926a-32b404b1edea None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:21.434820 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21447632-7956-497a-926a-32b404b1edea None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:21.435490 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21447632-7956-497a-926a-32b404b1edea None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:21.438423 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 809/1622] 10.222.0.89 () {54 vars in 956 bytes} [Wed Oct 27 15:05:21 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:05:21.446033 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495dab6-c299-484b-899d-7b25ccf60e35 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:21.446413 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495dab6-c299-484b-899d-7b25ccf60e35 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:21.446761 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495dab6-c299-484b-899d-7b25ccf60e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:21.487138 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-1495dab6-c299-484b-899d-7b25ccf60e35 None None] MFA Rules not processed for user `17c345fc642242469346303afbeda2f6`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:21.488880 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-1495dab6-c299-484b-899d-7b25ccf60e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:21.608670 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 814/1623] 10.222.0.89 () {58 vars in 1053 bytes} [Wed Oct 27 15:05:21 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:21.618927 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21447632-7956-497a-926a-32b404b1edea None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:21.643741 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21447632-7956-497a-926a-32b404b1edea None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:21.653958 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831dc3f1-eed4-4065-9d17-45f0aa787c7f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c345fc642242469346303afbeda2f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:21.654688 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dc3f1-eed4-4065-9d17-45f0aa787c7f service glance] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:21.655046 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dc3f1-eed4-4065-9d17-45f0aa787c7f service glance] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:21.655511 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dc3f1-eed4-4065-9d17-45f0aa787c7f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:21.659211 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-831dc3f1-eed4-4065-9d17-45f0aa787c7f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:21.847332 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831dc3f1-eed4-4065-9d17-45f0aa787c7f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:21.904178 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831dc3f1-eed4-4065-9d17-45f0aa787c7f service glance] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:21.926141 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 810/1624] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:21 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:21.956900 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bc40d-a70e-4fc5-a6fa-ef80bd1f4203 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:21.957482 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bc40d-a70e-4fc5-a6fa-ef80bd1f4203 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:21.958514 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565bc40d-a70e-4fc5-a6fa-ef80bd1f4203 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:21.960461 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 815/1625] 10.222.0.89 () {54 vars in 912 bytes} [Wed Oct 27 15:05:21 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:05:21.968583 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a3d88-0b78-442a-9741-3a0a2147f112 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:21.970123 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a3d88-0b78-442a-9741-3a0a2147f112 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:21.970640 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a3d88-0b78-442a-9741-3a0a2147f112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:22.082598 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-e16a3d88-0b78-442a-9741-3a0a2147f112 None None] MFA Rules not processed for user `ab1b41f8980348fc878e492e26078e33`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:22.086664 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-e16a3d88-0b78-442a-9741-3a0a2147f112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:22.112502 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 811/1626] 10.222.0.89 () {58 vars in 1009 bytes} [Wed Oct 27 15:05:21 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:05:22.146522 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bc40d-a70e-4fc5-a6fa-ef80bd1f4203 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:22.168415 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565bc40d-a70e-4fc5-a6fa-ef80bd1f4203 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:22.186901 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87dfb9-f82c-45e0-a247-cf61498d01c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:22.187680 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87dfb9-f82c-45e0-a247-cf61498d01c0 service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:22.188221 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87dfb9-f82c-45e0-a247-cf61498d01c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:22.188600 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87dfb9-f82c-45e0-a247-cf61498d01c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:22.201851 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87dfb9-f82c-45e0-a247-cf61498d01c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:22.289650 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87dfb9-f82c-45e0-a247-cf61498d01c0 service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:22.309412 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 816/1627] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:22 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:22.644146 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1f0c9-b707-432c-9a3c-0f4b0e678f90 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:22.645091 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1f0c9-b707-432c-9a3c-0f4b0e678f90 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:22.645532 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df1f0c9-b707-432c-9a3c-0f4b0e678f90 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:22.650785 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 812/1628] 10.222.0.89 () {54 vars in 912 bytes} [Wed Oct 27 15:05:22 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:05:22.657902 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfc519-dc45-4789-87e2-2c4de94306a2 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:22.658617 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfc519-dc45-4789-87e2-2c4de94306a2 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:22.659111 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adfc519-dc45-4789-87e2-2c4de94306a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:22.723193 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-9adfc519-dc45-4789-87e2-2c4de94306a2 None None] MFA Rules not processed for user `ab1b41f8980348fc878e492e26078e33`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:22.724563 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-9adfc519-dc45-4789-87e2-2c4de94306a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:22.735304 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 817/1629] 10.222.0.89 () {58 vars in 1009 bytes} [Wed Oct 27 15:05:22 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:22.778741 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1f0c9-b707-432c-9a3c-0f4b0e678f90 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:22.809702 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df1f0c9-b707-432c-9a3c-0f4b0e678f90 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:22.817292 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1aa06c-83c8-4583-a3fd-4b6cadbd94d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:22.818118 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1aa06c-83c8-4583-a3fd-4b6cadbd94d2 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:22.820322 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1aa06c-83c8-4583-a3fd-4b6cadbd94d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:22.823884 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1aa06c-83c8-4583-a3fd-4b6cadbd94d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:22.838468 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1aa06c-83c8-4583-a3fd-4b6cadbd94d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:22.896558 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1aa06c-83c8-4583-a3fd-4b6cadbd94d2 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:22.929632 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 813/1630] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:22 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:23.197039 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adfc519-dc45-4789-87e2-2c4de94306a2 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:23.199363 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-9adfc519-dc45-4789-87e2-2c4de94306a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:23.220430 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adfc519-dc45-4789-87e2-2c4de94306a2 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:23.233116 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0bb02-8a97-46f2-a3e2-bbd0afbfb14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:23.234093 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0bb02-8a97-46f2-a3e2-bbd0afbfb14e admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:23.234382 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0bb02-8a97-46f2-a3e2-bbd0afbfb14e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:23.234658 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0bb02-8a97-46f2-a3e2-bbd0afbfb14e admin admin] PATH_INFO: `/v3/projects/de1d8ecb9cee4384aa3b3542ed76ee99` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:23.236858 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0bb02-8a97-46f2-a3e2-bbd0afbfb14e admin admin] RBAC: Authorizing `identity:delete_project(project_id=de1d8ecb9cee4384aa3b3542ed76ee99)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:23.300788 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0bb02-8a97-46f2-a3e2-bbd0afbfb14e admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:23.373359 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-a5d0bb02-8a97-46f2-a3e2-bbd0afbfb14e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de1d8ecb9cee4384aa3b3542ed76ee99', 'request_id': 'req-a5d0bb02-8a97-46f2-a3e2-bbd0afbfb14e'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:23.381399 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-a5d0bb02-8a97-46f2-a3e2-bbd0afbfb14e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de1d8ecb9cee4384aa3b3542ed76ee99', 'request_id': 'req-a5d0bb02-8a97-46f2-a3e2-bbd0afbfb14e'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:23.396921 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-a5d0bb02-8a97-46f2-a3e2-bbd0afbfb14e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de1d8ecb9cee4384aa3b3542ed76ee99', 'request_id': 'req-a5d0bb02-8a97-46f2-a3e2-bbd0afbfb14e'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:23.422009 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-a5d0bb02-8a97-46f2-a3e2-bbd0afbfb14e admin admin] The token cache is being invalidate because project de1d8ecb9cee4384aa3b3542ed76ee99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:05:23.422336 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-a5d0bb02-8a97-46f2-a3e2-bbd0afbfb14e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:23.423549 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-a5d0bb02-8a97-46f2-a3e2-bbd0afbfb14e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:23.425276 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 818/1631] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:05:23 2021] DELETE /identity/v3/projects/de1d8ecb9cee4384aa3b3542ed76ee99 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:23.429069 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1aa06c-83c8-4583-a3fd-4b6cadbd94d2 service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:23.443524 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1aa06c-83c8-4583-a3fd-4b6cadbd94d2 service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:23.485869 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0bb02-8a97-46f2-a3e2-bbd0afbfb14e admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:23.487916 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-a5d0bb02-8a97-46f2-a3e2-bbd0afbfb14e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:23.566781 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae80651-6d9b-45e1-a7dd-5d664bec5ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:23.569294 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae80651-6d9b-45e1-a7dd-5d664bec5ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:23.569593 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae80651-6d9b-45e1-a7dd-5d664bec5ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:23.572519 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae80651-6d9b-45e1-a7dd-5d664bec5ed3 admin admin] PATH_INFO: `/v3/users/398c859a59124c4187a7d6dad1ba1fec` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:23.574496 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae80651-6d9b-45e1-a7dd-5d664bec5ed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=398c859a59124c4187a7d6dad1ba1fec)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:23.640722 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae80651-6d9b-45e1-a7dd-5d664bec5ed3 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:23.673838 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0bb02-8a97-46f2-a3e2-bbd0afbfb14e admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:23.687706 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731409e-adaf-40de-9a98-e0037439e535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:23.707898 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731409e-adaf-40de-9a98-e0037439e535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:23.709491 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731409e-adaf-40de-9a98-e0037439e535 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:23.709816 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731409e-adaf-40de-9a98-e0037439e535 admin admin] PATH_INFO: `/v3/projects/46e674c8afdd4e4f9189067168fa14d1` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:23.712240 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f731409e-adaf-40de-9a98-e0037439e535 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46e674c8afdd4e4f9189067168fa14d1)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:23.802009 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-3ae80651-6d9b-45e1-a7dd-5d664bec5ed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '398c859a59124c4187a7d6dad1ba1fec'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:23.814911 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f731409e-adaf-40de-9a98-e0037439e535 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:23.846529 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-3ae80651-6d9b-45e1-a7dd-5d664bec5ed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '398c859a59124c4187a7d6dad1ba1fec'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:23.848551 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-3ae80651-6d9b-45e1-a7dd-5d664bec5ed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '398c859a59124c4187a7d6dad1ba1fec'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:23.864020 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-3ae80651-6d9b-45e1-a7dd-5d664bec5ed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '398c859a59124c4187a7d6dad1ba1fec'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:23.876216 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-3ae80651-6d9b-45e1-a7dd-5d664bec5ed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '398c859a59124c4187a7d6dad1ba1fec'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:23.887566 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 814/1632] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:05:23 2021] DELETE /identity/v3/users/398c859a59124c4187a7d6dad1ba1fec => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:23.890249 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae80651-6d9b-45e1-a7dd-5d664bec5ed3 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:23.892066 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-3ae80651-6d9b-45e1-a7dd-5d664bec5ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:23.987867 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae80651-6d9b-45e1-a7dd-5d664bec5ed3 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:24.000972 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-f731409e-adaf-40de-9a98-e0037439e535 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46e674c8afdd4e4f9189067168fa14d1', 'request_id': 'req-f731409e-adaf-40de-9a98-e0037439e535'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:24.018214 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-f731409e-adaf-40de-9a98-e0037439e535 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46e674c8afdd4e4f9189067168fa14d1', 'request_id': 'req-f731409e-adaf-40de-9a98-e0037439e535'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:24.057693 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-f731409e-adaf-40de-9a98-e0037439e535 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46e674c8afdd4e4f9189067168fa14d1', 'request_id': 'req-f731409e-adaf-40de-9a98-e0037439e535'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:24.085611 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-f731409e-adaf-40de-9a98-e0037439e535 admin admin] The token cache is being invalidate because project 46e674c8afdd4e4f9189067168fa14d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:05:24.085913 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-f731409e-adaf-40de-9a98-e0037439e535 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:24.088005 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-f731409e-adaf-40de-9a98-e0037439e535 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:24.095092 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 819/1633] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:05:23 2021] DELETE /identity/v3/projects/46e674c8afdd4e4f9189067168fa14d1 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:24.095092 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08891e-ba52-4431-8216-25a28438b29d None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:24.095092 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08891e-ba52-4431-8216-25a28438b29d None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:24.095092 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08891e-ba52-4431-8216-25a28438b29d None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:24.115736 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 820/1634] 10.222.0.89 () {54 vars in 960 bytes} [Wed Oct 27 15:05:24 2021] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:05:24.118776 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08891e-ba52-4431-8216-25a28438b29d None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:24.126492 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-0e08891e-ba52-4431-8216-25a28438b29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:24.231293 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbdea0-1ab7-444b-a41b-e02f438968d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:24.232143 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbdea0-1ab7-444b-a41b-e02f438968d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:24.232427 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbdea0-1ab7-444b-a41b-e02f438968d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:24.232703 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbdea0-1ab7-444b-a41b-e02f438968d1 admin admin] PATH_INFO: `/v3/projects/903002b404154f72a6acdd922d9b4890` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:24.234997 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dbdea0-1ab7-444b-a41b-e02f438968d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=903002b404154f72a6acdd922d9b4890)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:24.334993 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: WARNING py.warnings [None req-a4dbdea0-1ab7-444b-a41b-e02f438968d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1022: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 15:05:24.334993 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: warnings.warn(msg) Oct 27 15:05:24.334993 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: Oct 27 15:05:24.340194 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dbdea0-1ab7-444b-a41b-e02f438968d1 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:24.432831 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08891e-ba52-4431-8216-25a28438b29d None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:24.448429 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48c01c-5747-4853-bc2c-a513d9fea33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:24.453418 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48c01c-5747-4853-bc2c-a513d9fea33b admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:24.453831 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48c01c-5747-4853-bc2c-a513d9fea33b admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:24.454175 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48c01c-5747-4853-bc2c-a513d9fea33b admin admin] PATH_INFO: `/v3/users/901ee194badd466b928068f8efb48719` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:24.460775 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d48c01c-5747-4853-bc2c-a513d9fea33b admin admin] RBAC: Authorizing `identity:delete_user(user_id=901ee194badd466b928068f8efb48719)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:24.488151 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-a4dbdea0-1ab7-444b-a41b-e02f438968d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '903002b404154f72a6acdd922d9b4890', 'request_id': 'req-a4dbdea0-1ab7-444b-a41b-e02f438968d1'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:24.499709 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-a4dbdea0-1ab7-444b-a41b-e02f438968d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '903002b404154f72a6acdd922d9b4890', 'request_id': 'req-a4dbdea0-1ab7-444b-a41b-e02f438968d1'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:24.531658 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-a4dbdea0-1ab7-444b-a41b-e02f438968d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '903002b404154f72a6acdd922d9b4890', 'request_id': 'req-a4dbdea0-1ab7-444b-a41b-e02f438968d1'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:24.553603 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-a4dbdea0-1ab7-444b-a41b-e02f438968d1 admin admin] The token cache is being invalidate because project 903002b404154f72a6acdd922d9b4890 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:05:24.553984 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-a4dbdea0-1ab7-444b-a41b-e02f438968d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:24.555419 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-a4dbdea0-1ab7-444b-a41b-e02f438968d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:24.557262 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 815/1635] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:05:23 2021] DELETE /identity/v3/projects/903002b404154f72a6acdd922d9b4890 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:24.566613 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8217e-584e-4602-8a9a-75422aaf97e8 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:24.566907 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8217e-584e-4602-8a9a-75422aaf97e8 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:24.567190 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa8217e-584e-4602-8a9a-75422aaf97e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:24.567835 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d48c01c-5747-4853-bc2c-a513d9fea33b admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:24.616941 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-3fa8217e-584e-4602-8a9a-75422aaf97e8 None None] MFA Rules not processed for user `fcbab075fd5b4a889c2002639ca9d60a`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:24.618132 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-3fa8217e-584e-4602-8a9a-75422aaf97e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:24.748475 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-1d48c01c-5747-4853-bc2c-a513d9fea33b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '901ee194badd466b928068f8efb48719'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:24.749152 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-1d48c01c-5747-4853-bc2c-a513d9fea33b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '901ee194badd466b928068f8efb48719'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:24.787314 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-1d48c01c-5747-4853-bc2c-a513d9fea33b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '901ee194badd466b928068f8efb48719'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:24.827092 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-1d48c01c-5747-4853-bc2c-a513d9fea33b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '901ee194badd466b928068f8efb48719'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:24.849392 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-1d48c01c-5747-4853-bc2c-a513d9fea33b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '901ee194badd466b928068f8efb48719'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:24.857475 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 816/1636] 10.222.0.89 () {58 vars in 1057 bytes} [Wed Oct 27 15:05:24 2021] POST /identity/v3/auth/tokens => generated 3738 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:24.859144 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8217e-584e-4602-8a9a-75422aaf97e8 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:24.859389 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 821/1637] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:05:24 2021] DELETE /identity/v3/users/901ee194badd466b928068f8efb48719 => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:24.860609 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48c01c-5747-4853-bc2c-a513d9fea33b admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:24.862180 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-1d48c01c-5747-4853-bc2c-a513d9fea33b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:24.863130 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-3fa8217e-584e-4602-8a9a-75422aaf97e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:25.068040 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa8217e-584e-4602-8a9a-75422aaf97e8 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:25.078622 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48c01c-5747-4853-bc2c-a513d9fea33b admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:25.096212 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6441d-2900-44ae-8258-11f992913c14 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcbab075fd5b4a889c2002639ca9d60a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:25.096828 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6441d-2900-44ae-8258-11f992913c14 service placement] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:25.097115 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6441d-2900-44ae-8258-11f992913c14 service placement] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:25.097394 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a6441d-2900-44ae-8258-11f992913c14 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:25.099812 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-d1a6441d-2900-44ae-8258-11f992913c14 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:25.133913 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6441d-2900-44ae-8258-11f992913c14 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:25.211619 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a6441d-2900-44ae-8258-11f992913c14 service placement] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:25.263257 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bffa3-7afc-4cf4-b39e-7f21ada8f1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:25.264416 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bffa3-7afc-4cf4-b39e-7f21ada8f1a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:25.265527 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bffa3-7afc-4cf4-b39e-7f21ada8f1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:25.265527 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bffa3-7afc-4cf4-b39e-7f21ada8f1a7 admin admin] PATH_INFO: `/v3/users/2ecbf584500043d3ae4de8617e323543` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:25.266551 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30bffa3-7afc-4cf4-b39e-7f21ada8f1a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ecbf584500043d3ae4de8617e323543)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:25.274958 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 822/1638] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:24 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:25.275877 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6441d-2900-44ae-8258-11f992913c14 service placement] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:25.329076 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a6441d-2900-44ae-8258-11f992913c14 service placement] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:25.339173 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffecd8d0-5fd1-46f6-800f-e1a955c6344c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcbab075fd5b4a889c2002639ca9d60a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:25.340102 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecd8d0-5fd1-46f6-800f-e1a955c6344c service placement] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:25.340591 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecd8d0-5fd1-46f6-800f-e1a955c6344c service placement] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:25.341030 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffecd8d0-5fd1-46f6-800f-e1a955c6344c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:25.355822 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30bffa3-7afc-4cf4-b39e-7f21ada8f1a7 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:25.380796 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffecd8d0-5fd1-46f6-800f-e1a955c6344c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:25.502465 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-d30bffa3-7afc-4cf4-b39e-7f21ada8f1a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ecbf584500043d3ae4de8617e323543'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:25.531960 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-d30bffa3-7afc-4cf4-b39e-7f21ada8f1a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ecbf584500043d3ae4de8617e323543'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:25.533303 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-d30bffa3-7afc-4cf4-b39e-7f21ada8f1a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ecbf584500043d3ae4de8617e323543'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:25.534795 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffecd8d0-5fd1-46f6-800f-e1a955c6344c service placement] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:25.545356 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-d30bffa3-7afc-4cf4-b39e-7f21ada8f1a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ecbf584500043d3ae4de8617e323543'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:25.556179 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-d30bffa3-7afc-4cf4-b39e-7f21ada8f1a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ecbf584500043d3ae4de8617e323543'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:25.562589 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 823/1639] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:25 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:25.588444 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 817/1640] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:05:24 2021] DELETE /identity/v3/users/2ecbf584500043d3ae4de8617e323543 => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:25.703320 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffecd8d0-5fd1-46f6-800f-e1a955c6344c service placement] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:25.718580 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffecd8d0-5fd1-46f6-800f-e1a955c6344c service placement] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:25.911405 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bffa3-7afc-4cf4-b39e-7f21ada8f1a7 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:25.913164 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-d30bffa3-7afc-4cf4-b39e-7f21ada8f1a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:25.922627 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29815025-0b32-4ad4-a1ba-1c26f7ccc975 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcbab075fd5b4a889c2002639ca9d60a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:25.923864 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29815025-0b32-4ad4-a1ba-1c26f7ccc975 service placement] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:25.924326 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29815025-0b32-4ad4-a1ba-1c26f7ccc975 service placement] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:25.924799 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29815025-0b32-4ad4-a1ba-1c26f7ccc975 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:25.927194 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-29815025-0b32-4ad4-a1ba-1c26f7ccc975 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:25.940293 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29815025-0b32-4ad4-a1ba-1c26f7ccc975 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:25.973860 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29815025-0b32-4ad4-a1ba-1c26f7ccc975 service placement] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:25.998810 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 824/1641] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:25 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:26.064686 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29815025-0b32-4ad4-a1ba-1c26f7ccc975 service placement] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:26.066226 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-29815025-0b32-4ad4-a1ba-1c26f7ccc975 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:26.118461 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bffa3-7afc-4cf4-b39e-7f21ada8f1a7 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:26.132356 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cee0e11-29ca-4a22-98be-3e37232e8435 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcbab075fd5b4a889c2002639ca9d60a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:26.133560 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee0e11-29ca-4a22-98be-3e37232e8435 service placement] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:26.134401 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee0e11-29ca-4a22-98be-3e37232e8435 service placement] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:26.136027 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee0e11-29ca-4a22-98be-3e37232e8435 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:26.162549 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee0e11-29ca-4a22-98be-3e37232e8435 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:26.215382 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cee0e11-29ca-4a22-98be-3e37232e8435 service placement] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:26.229728 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 818/1642] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:25 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:26.230038 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29815025-0b32-4ad4-a1ba-1c26f7ccc975 service placement] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:26.254141 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc03647-4ee4-4e8c-84e8-d2aa4a89d947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:26.255179 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc03647-4ee4-4e8c-84e8-d2aa4a89d947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:26.255801 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc03647-4ee4-4e8c-84e8-d2aa4a89d947 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:26.256256 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc03647-4ee4-4e8c-84e8-d2aa4a89d947 admin admin] PATH_INFO: `/v3/projects/9cda7fcb2df44f57b41324ac138cd11c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:26.257662 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc03647-4ee4-4e8c-84e8-d2aa4a89d947 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cda7fcb2df44f57b41324ac138cd11c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:26.301605 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc03647-4ee4-4e8c-84e8-d2aa4a89d947 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:26.472346 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-ffc03647-4ee4-4e8c-84e8-d2aa4a89d947 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cda7fcb2df44f57b41324ac138cd11c', 'request_id': 'req-ffc03647-4ee4-4e8c-84e8-d2aa4a89d947'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:26.487725 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-ffc03647-4ee4-4e8c-84e8-d2aa4a89d947 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cda7fcb2df44f57b41324ac138cd11c', 'request_id': 'req-ffc03647-4ee4-4e8c-84e8-d2aa4a89d947'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:26.508758 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-ffc03647-4ee4-4e8c-84e8-d2aa4a89d947 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cda7fcb2df44f57b41324ac138cd11c', 'request_id': 'req-ffc03647-4ee4-4e8c-84e8-d2aa4a89d947'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:26.550915 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-ffc03647-4ee4-4e8c-84e8-d2aa4a89d947 admin admin] The token cache is being invalidate because project 9cda7fcb2df44f57b41324ac138cd11c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:05:26.551712 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-ffc03647-4ee4-4e8c-84e8-d2aa4a89d947 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:26.551918 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-ffc03647-4ee4-4e8c-84e8-d2aa4a89d947 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:26.553801 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 825/1643] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:05:26 2021] DELETE /identity/v3/projects/9cda7fcb2df44f57b41324ac138cd11c => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:26.560383 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02139297-c3ea-439c-a3cc-21526106dcd5 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:26.560904 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02139297-c3ea-439c-a3cc-21526106dcd5 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:26.561036 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02139297-c3ea-439c-a3cc-21526106dcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:26.624809 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-02139297-c3ea-439c-a3cc-21526106dcd5 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:26.626410 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-02139297-c3ea-439c-a3cc-21526106dcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:26.831166 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc03647-4ee4-4e8c-84e8-d2aa4a89d947 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:26.833365 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-ffc03647-4ee4-4e8c-84e8-d2aa4a89d947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:26.894437 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 819/1644] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:26.902779 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a11717-9795-4144-b6d1-77e2716147f5 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:26.903753 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a11717-9795-4144-b6d1-77e2716147f5 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:26.904391 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a11717-9795-4144-b6d1-77e2716147f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:26.962920 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-62a11717-9795-4144-b6d1-77e2716147f5 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:26.966432 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-62a11717-9795-4144-b6d1-77e2716147f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:26.985157 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 820/1645] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:05:26.992240 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a11717-9795-4144-b6d1-77e2716147f5 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:27.012176 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a11717-9795-4144-b6d1-77e2716147f5 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:27.029064 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e273153-c551-45ea-9d89-169a60433b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:27.029926 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e273153-c551-45ea-9d89-169a60433b08 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:27.030432 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e273153-c551-45ea-9d89-169a60433b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:27.031065 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e273153-c551-45ea-9d89-169a60433b08 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:27.032078 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e273153-c551-45ea-9d89-169a60433b08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:05:27.033094 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e273153-c551-45ea-9d89-169a60433b08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:27.050114 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc03647-4ee4-4e8c-84e8-d2aa4a89d947 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:27.056218 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b27a5-18b8-438c-8b24-87390794c8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:27.057649 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b27a5-18b8-438c-8b24-87390794c8a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:27.057975 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b27a5-18b8-438c-8b24-87390794c8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:27.058530 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b27a5-18b8-438c-8b24-87390794c8a5 admin admin] PATH_INFO: `/v3/projects/5f8168a77ec6404c928e7bb36650cb9f` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:27.060512 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b27a5-18b8-438c-8b24-87390794c8a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f8168a77ec6404c928e7bb36650cb9f)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:27.098423 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e273153-c551-45ea-9d89-169a60433b08 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:27.131333 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b27a5-18b8-438c-8b24-87390794c8a5 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:27.134802 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 821/1646] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:05:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:05:27.139495 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e273153-c551-45ea-9d89-169a60433b08 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:27.157083 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e273153-c551-45ea-9d89-169a60433b08 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:27.176187 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682b6f0-003b-4e68-9489-fea9d97662ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:27.179606 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682b6f0-003b-4e68-9489-fea9d97662ef admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:27.179902 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682b6f0-003b-4e68-9489-fea9d97662ef admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:27.180202 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682b6f0-003b-4e68-9489-fea9d97662ef admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:27.182946 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682b6f0-003b-4e68-9489-fea9d97662ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:27.245747 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-280b27a5-18b8-438c-8b24-87390794c8a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f8168a77ec6404c928e7bb36650cb9f', 'request_id': 'req-280b27a5-18b8-438c-8b24-87390794c8a5'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:27.248027 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682b6f0-003b-4e68-9489-fea9d97662ef admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:27.254088 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-280b27a5-18b8-438c-8b24-87390794c8a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f8168a77ec6404c928e7bb36650cb9f', 'request_id': 'req-280b27a5-18b8-438c-8b24-87390794c8a5'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:27.287413 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-280b27a5-18b8-438c-8b24-87390794c8a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f8168a77ec6404c928e7bb36650cb9f', 'request_id': 'req-280b27a5-18b8-438c-8b24-87390794c8a5'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:27.311424 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 822/1647] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:05:27 2021] POST /identity/v3/projects => generated 409 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:05:27.313150 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682b6f0-003b-4e68-9489-fea9d97662ef admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:27.318781 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-280b27a5-18b8-438c-8b24-87390794c8a5 admin admin] The token cache is being invalidate because project 5f8168a77ec6404c928e7bb36650cb9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:05:27.319674 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-0682b6f0-003b-4e68-9489-fea9d97662ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:27.321481 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-280b27a5-18b8-438c-8b24-87390794c8a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:27.335697 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-280b27a5-18b8-438c-8b24-87390794c8a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:27.345342 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 826/1648] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:05:26 2021] DELETE /identity/v3/projects/5f8168a77ec6404c928e7bb36650cb9f => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:27.349411 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b27a5-18b8-438c-8b24-87390794c8a5 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:27.350878 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-280b27a5-18b8-438c-8b24-87390794c8a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:27.464919 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b27a5-18b8-438c-8b24-87390794c8a5 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:27.471867 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754d252-aada-4de7-aa8d-e97780aa2b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:27.472593 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754d252-aada-4de7-aa8d-e97780aa2b48 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:27.472956 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754d252-aada-4de7-aa8d-e97780aa2b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:27.473307 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754d252-aada-4de7-aa8d-e97780aa2b48 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:27.474028 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754d252-aada-4de7-aa8d-e97780aa2b48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:27.474744 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682b6f0-003b-4e68-9489-fea9d97662ef admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:27.484577 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1917d7-4922-469b-9afe-da790b6ceca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:27.486378 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1917d7-4922-469b-9afe-da790b6ceca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:27.487360 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1917d7-4922-469b-9afe-da790b6ceca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:27.488890 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1917d7-4922-469b-9afe-da790b6ceca0 admin admin] PATH_INFO: `/v3/projects/11acfaf80222413297ff606b534d98f7` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:27.491726 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1917d7-4922-469b-9afe-da790b6ceca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11acfaf80222413297ff606b534d98f7)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:27.503191 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754d252-aada-4de7-aa8d-e97780aa2b48 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:27.533640 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 827/1649] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:05:27 2021] POST /identity/v3/users => generated 305 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:27.541045 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdb527-297a-45b5-b0d0-ba3af6d4f626 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:27.541326 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdb527-297a-45b5-b0d0-ba3af6d4f626 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:27.541591 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdb527-297a-45b5-b0d0-ba3af6d4f626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:27.571687 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1917d7-4922-469b-9afe-da790b6ceca0 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:27.615798 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-fcbdb527-297a-45b5-b0d0-ba3af6d4f626 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:27.615798 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-fcbdb527-297a-45b5-b0d0-ba3af6d4f626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:27.617710 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 828/1650] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:27 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:27.623461 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdb527-297a-45b5-b0d0-ba3af6d4f626 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:27.646714 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdb527-297a-45b5-b0d0-ba3af6d4f626 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:27.661494 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688f622-4ccc-479f-9793-f351a0a4c0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:27.662315 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688f622-4ccc-479f-9793-f351a0a4c0f9 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:27.662825 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688f622-4ccc-479f-9793-f351a0a4c0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:27.664137 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688f622-4ccc-479f-9793-f351a0a4c0f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:27.665002 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688f622-4ccc-479f-9793-f351a0a4c0f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:27.677196 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-2a1917d7-4922-469b-9afe-da790b6ceca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11acfaf80222413297ff606b534d98f7', 'request_id': 'req-2a1917d7-4922-469b-9afe-da790b6ceca0'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:27.684352 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-2a1917d7-4922-469b-9afe-da790b6ceca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11acfaf80222413297ff606b534d98f7', 'request_id': 'req-2a1917d7-4922-469b-9afe-da790b6ceca0'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:27.694760 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688f622-4ccc-479f-9793-f351a0a4c0f9 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:27.703853 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-2a1917d7-4922-469b-9afe-da790b6ceca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11acfaf80222413297ff606b534d98f7', 'request_id': 'req-2a1917d7-4922-469b-9afe-da790b6ceca0'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:27.712276 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 829/1651] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:27 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:27.713931 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71b810-7546-4f6b-adb6-4562b9ac4f02 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:27.715205 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71b810-7546-4f6b-adb6-4562b9ac4f02 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:27.715728 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71b810-7546-4f6b-adb6-4562b9ac4f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:27.736379 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-2a1917d7-4922-469b-9afe-da790b6ceca0 admin admin] The token cache is being invalidate because project 11acfaf80222413297ff606b534d98f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:05:27.736679 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-2a1917d7-4922-469b-9afe-da790b6ceca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:27.737421 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-2a1917d7-4922-469b-9afe-da790b6ceca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:27.744191 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 823/1652] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:05:27 2021] DELETE /identity/v3/projects/11acfaf80222413297ff606b534d98f7 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:27.744191 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1917d7-4922-469b-9afe-da790b6ceca0 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:27.744479 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-2a1917d7-4922-469b-9afe-da790b6ceca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:27.748308 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-4d71b810-7546-4f6b-adb6-4562b9ac4f02 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:27.750144 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-4d71b810-7546-4f6b-adb6-4562b9ac4f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:27.843600 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1917d7-4922-469b-9afe-da790b6ceca0 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:27.848404 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a4277-8c6c-453f-aa18-bf434fbf05e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:27.849307 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a4277-8c6c-453f-aa18-bf434fbf05e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:27.849751 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a4277-8c6c-453f-aa18-bf434fbf05e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:27.850040 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a4277-8c6c-453f-aa18-bf434fbf05e7 admin admin] PATH_INFO: `/v3/projects/742715a41e7146eda020d4773281249d/users/327902bba66747d98f0b27015396225b/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:27.879731 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a4277-8c6c-453f-aa18-bf434fbf05e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=742715a41e7146eda020d4773281249d, user_id=327902bba66747d98f0b27015396225b, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:27.908217 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 830/1653] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:27 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:27.908217 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97de49-f708-4aab-955f-69332a082df8 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:27.908217 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97de49-f708-4aab-955f-69332a082df8 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:27.908217 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a97de49-f708-4aab-955f-69332a082df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:27.910275 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a4277-8c6c-453f-aa18-bf434fbf05e7 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:27.935913 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 824/1654] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:27 2021] PUT /identity/v3/projects/742715a41e7146eda020d4773281249d/users/327902bba66747d98f0b27015396225b/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:27.938059 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a4277-8c6c-453f-aa18-bf434fbf05e7 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:27.942405 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-1a97de49-f708-4aab-955f-69332a082df8 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:27.945075 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-1a97de49-f708-4aab-955f-69332a082df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:28.062191 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a4277-8c6c-453f-aa18-bf434fbf05e7 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:28.080655 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a1c615-9dda-4989-8278-10762c565628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:28.081506 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1c615-9dda-4989-8278-10762c565628 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:28.081991 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1c615-9dda-4989-8278-10762c565628 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:28.082437 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a1c615-9dda-4989-8278-10762c565628 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:28.083298 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1c615-9dda-4989-8278-10762c565628 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:05:28.085286 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1c615-9dda-4989-8278-10762c565628 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:28.121148 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 831/1655] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:27 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:28.123756 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5d665-243e-4b35-ab58-0b9c7d69fe25 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:28.124319 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5d665-243e-4b35-ab58-0b9c7d69fe25 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:28.124850 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5d665-243e-4b35-ab58-0b9c7d69fe25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:28.155376 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a1c615-9dda-4989-8278-10762c565628 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:28.176206 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 825/1656] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:05:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:05:28.177611 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4e66d-d73f-48d7-b368-e1275a7f3414 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:28.177915 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4e66d-d73f-48d7-b368-e1275a7f3414 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:28.178191 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4e66d-d73f-48d7-b368-e1275a7f3414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:28.202883 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-3aa5d665-243e-4b35-ab58-0b9c7d69fe25 None None] MFA Rules not processed for user `327902bba66747d98f0b27015396225b`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:28.204710 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-3aa5d665-243e-4b35-ab58-0b9c7d69fe25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:28.266227 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-19c4e66d-d73f-48d7-b368-e1275a7f3414 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:28.269728 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-19c4e66d-d73f-48d7-b368-e1275a7f3414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:28.289051 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 826/1657] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:28.290773 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4e66d-d73f-48d7-b368-e1275a7f3414 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:28.312988 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4e66d-d73f-48d7-b368-e1275a7f3414 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:28.334601 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0acfd-c9f2-4899-8e33-1132ae87baa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:28.335662 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0acfd-c9f2-4899-8e33-1132ae87baa9 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:28.336429 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0acfd-c9f2-4899-8e33-1132ae87baa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:28.341329 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be0acfd-c9f2-4899-8e33-1132ae87baa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:28.342878 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0acfd-c9f2-4899-8e33-1132ae87baa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:28.364385 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 832/1658] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:28 2021] POST /identity/v3/auth/tokens => generated 3716 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:28.366858 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5d665-243e-4b35-ab58-0b9c7d69fe25 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:28.382818 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5d665-243e-4b35-ab58-0b9c7d69fe25 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:28.393430 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f88e1-aa2f-497c-a203-9882c6dd9b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:28.394098 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f88e1-aa2f-497c-a203-9882c6dd9b11 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:28.394386 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f88e1-aa2f-497c-a203-9882c6dd9b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:28.394664 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f88e1-aa2f-497c-a203-9882c6dd9b11 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:28.395649 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f88e1-aa2f-497c-a203-9882c6dd9b11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:05:28.395950 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f88e1-aa2f-497c-a203-9882c6dd9b11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:28.402988 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be0acfd-c9f2-4899-8e33-1132ae87baa9 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:28.436773 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f88e1-aa2f-497c-a203-9882c6dd9b11 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:28.451695 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 827/1659] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:05:28 2021] POST /identity/v3/projects => generated 363 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:28.452991 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0acfd-c9f2-4899-8e33-1132ae87baa9 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:28.459066 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 833/1660] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:05:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:05:28.460113 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f88e1-aa2f-497c-a203-9882c6dd9b11 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:28.470331 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f88e1-aa2f-497c-a203-9882c6dd9b11 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:28.565718 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be0acfd-c9f2-4899-8e33-1132ae87baa9 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:28.572223 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc74fb-3839-427e-b214-3d32a7ecf2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:28.573334 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc74fb-3839-427e-b214-3d32a7ecf2ea admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:28.573815 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc74fb-3839-427e-b214-3d32a7ecf2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:28.574254 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc74fb-3839-427e-b214-3d32a7ecf2ea admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:28.575193 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc74fb-3839-427e-b214-3d32a7ecf2ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:28.612865 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc74fb-3839-427e-b214-3d32a7ecf2ea admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:28.664725 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 828/1661] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:05:28 2021] POST /identity/v3/projects => generated 409 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:28.665737 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc74fb-3839-427e-b214-3d32a7ecf2ea admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:28.670008 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46008dc5-354d-4f7a-a132-bebe7affa1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:28.670823 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46008dc5-354d-4f7a-a132-bebe7affa1e3 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:28.671134 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46008dc5-354d-4f7a-a132-bebe7affa1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:28.671473 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46008dc5-354d-4f7a-a132-bebe7affa1e3 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:28.676488 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46008dc5-354d-4f7a-a132-bebe7affa1e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:28.746501 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46008dc5-354d-4f7a-a132-bebe7affa1e3 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:28.809702 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc74fb-3839-427e-b214-3d32a7ecf2ea admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:28.816475 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 834/1662] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:05:28 2021] POST /identity/v3/users => generated 282 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:28.816688 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa595a-297a-4db6-b956-bad7a7723a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:28.816688 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa595a-297a-4db6-b956-bad7a7723a00 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:28.816688 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa595a-297a-4db6-b956-bad7a7723a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:28.816688 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa595a-297a-4db6-b956-bad7a7723a00 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:28.817218 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aa595a-297a-4db6-b956-bad7a7723a00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:28.817306 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46008dc5-354d-4f7a-a132-bebe7affa1e3 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:28.838811 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46008dc5-354d-4f7a-a132-bebe7affa1e3 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:28.856067 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088caab7-4f70-400b-8825-720ae062e33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:28.857103 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088caab7-4f70-400b-8825-720ae062e33d admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:28.857621 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088caab7-4f70-400b-8825-720ae062e33d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:28.863170 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088caab7-4f70-400b-8825-720ae062e33d admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:28.864375 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088caab7-4f70-400b-8825-720ae062e33d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:28.887705 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aa595a-297a-4db6-b956-bad7a7723a00 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:28.931531 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088caab7-4f70-400b-8825-720ae062e33d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:28.952908 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 829/1663] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:05:28 2021] POST /identity/v3/projects => generated 373 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:28.953962 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa595a-297a-4db6-b956-bad7a7723a00 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:29.006839 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 835/1664] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:05:28 2021] POST /identity/v3/users => generated 311 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:29.013055 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088caab7-4f70-400b-8825-720ae062e33d admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:29.046327 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088caab7-4f70-400b-8825-720ae062e33d admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:29.129723 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa595a-297a-4db6-b956-bad7a7723a00 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:29.156682 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0a8fe-2212-406b-a04e-59e2deb755f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:29.158117 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0a8fe-2212-406b-a04e-59e2deb755f6 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:29.158633 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0a8fe-2212-406b-a04e-59e2deb755f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:29.159144 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0a8fe-2212-406b-a04e-59e2deb755f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:29.160256 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0a8fe-2212-406b-a04e-59e2deb755f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:29.195308 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0a8fe-2212-406b-a04e-59e2deb755f6 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:29.213311 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 830/1665] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:28 2021] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:29.223312 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0a8fe-2212-406b-a04e-59e2deb755f6 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:29.246013 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19109d-1242-4f5e-ac7c-28c761013c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:29.246628 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19109d-1242-4f5e-ac7c-28c761013c55 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:29.246936 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19109d-1242-4f5e-ac7c-28c761013c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:29.247253 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19109d-1242-4f5e-ac7c-28c761013c55 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:29.248389 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19109d-1242-4f5e-ac7c-28c761013c55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:29.249171 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0a8fe-2212-406b-a04e-59e2deb755f6 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:29.263311 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158c369-904b-4bb3-8a6b-89cf82da143b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:29.265463 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158c369-904b-4bb3-8a6b-89cf82da143b admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:29.266154 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158c369-904b-4bb3-8a6b-89cf82da143b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:29.266659 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158c369-904b-4bb3-8a6b-89cf82da143b admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:29.267737 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158c369-904b-4bb3-8a6b-89cf82da143b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:29.284912 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19109d-1242-4f5e-ac7c-28c761013c55 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:29.321538 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158c369-904b-4bb3-8a6b-89cf82da143b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:29.323195 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 836/1666] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:05:29 2021] POST /identity/v3/users => generated 287 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:29.324690 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19109d-1242-4f5e-ac7c-28c761013c55 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:29.345667 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 831/1667] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:29 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:29.347251 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19109d-1242-4f5e-ac7c-28c761013c55 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:29.350892 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158c369-904b-4bb3-8a6b-89cf82da143b admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:29.365417 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1be87-7def-4fb8-a7e2-8127100754b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:29.366612 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1be87-7def-4fb8-a7e2-8127100754b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:29.366983 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1be87-7def-4fb8-a7e2-8127100754b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:29.367364 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1be87-7def-4fb8-a7e2-8127100754b5 admin admin] PATH_INFO: `/v3/projects/8f6a68b253804daf9abf15e101ef3f9b/users/a5245703d05a4efa9714da594f235668/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:29.390318 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158c369-904b-4bb3-8a6b-89cf82da143b admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:29.397488 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919e655-4a10-4225-b484-62c1412ae7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:29.398493 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919e655-4a10-4225-b484-62c1412ae7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:29.398979 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919e655-4a10-4225-b484-62c1412ae7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:29.399483 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919e655-4a10-4225-b484-62c1412ae7e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:29.400640 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919e655-4a10-4225-b484-62c1412ae7e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:29.412169 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1be87-7def-4fb8-a7e2-8127100754b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f6a68b253804daf9abf15e101ef3f9b, user_id=a5245703d05a4efa9714da594f235668, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:29.471189 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1be87-7def-4fb8-a7e2-8127100754b5 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:29.473356 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919e655-4a10-4225-b484-62c1412ae7e4 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:29.495167 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 832/1668] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:29 2021] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:29.495167 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919e655-4a10-4225-b484-62c1412ae7e4 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:29.523552 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 837/1669] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:29 2021] PUT /identity/v3/projects/8f6a68b253804daf9abf15e101ef3f9b/users/a5245703d05a4efa9714da594f235668/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:29.527356 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1be87-7def-4fb8-a7e2-8127100754b5 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:29.530519 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919e655-4a10-4225-b484-62c1412ae7e4 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:29.674752 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb9519-5960-48f4-be50-5d84d376bd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:29.677431 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb9519-5960-48f4-be50-5d84d376bd8e admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:29.677778 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb9519-5960-48f4-be50-5d84d376bd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:29.679487 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb9519-5960-48f4-be50-5d84d376bd8e admin admin] PATH_INFO: `/v3/projects/1fef6cc608224e13aedffe867d77187b/users/ed95b6eff4e44d9dbb561ff002018ecb/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:29.684243 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1be87-7def-4fb8-a7e2-8127100754b5 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:29.690340 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d90f11-15c4-45f2-be10-1f6528432c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:29.691774 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d90f11-15c4-45f2-be10-1f6528432c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:29.692135 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d90f11-15c4-45f2-be10-1f6528432c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:29.693473 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d90f11-15c4-45f2-be10-1f6528432c74 admin admin] PATH_INFO: `/v3/projects/a574067a4cd54ca9bb1cd1d07290421a/users/b83c2a58f1234a02a81c6ab6700f9339/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:29.726457 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d90f11-15c4-45f2-be10-1f6528432c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a574067a4cd54ca9bb1cd1d07290421a, user_id=b83c2a58f1234a02a81c6ab6700f9339, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:29.768804 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb9519-5960-48f4-be50-5d84d376bd8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fef6cc608224e13aedffe867d77187b, user_id=ed95b6eff4e44d9dbb561ff002018ecb, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:29.798025 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d90f11-15c4-45f2-be10-1f6528432c74 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:29.823557 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 838/1670] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:29 2021] PUT /identity/v3/projects/a574067a4cd54ca9bb1cd1d07290421a/users/b83c2a58f1234a02a81c6ab6700f9339/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:29.829835 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a8fb9-a335-4f42-b4d9-46239973b1fb None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:29.830661 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a8fb9-a335-4f42-b4d9-46239973b1fb None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:29.830661 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a8fb9-a335-4f42-b4d9-46239973b1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:29.849718 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb9519-5960-48f4-be50-5d84d376bd8e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:29.888510 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 833/1671] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:29 2021] PUT /identity/v3/projects/1fef6cc608224e13aedffe867d77187b/users/ed95b6eff4e44d9dbb561ff002018ecb/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:29.893462 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfa3d9-6058-496a-9634-f45503c961ea None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:29.895285 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfa3d9-6058-496a-9634-f45503c961ea None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:29.896214 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfa3d9-6058-496a-9634-f45503c961ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:30.046220 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-cf8a8fb9-a335-4f42-b4d9-46239973b1fb None None] MFA Rules not processed for user `a5245703d05a4efa9714da594f235668`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:30.058065 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-cf8a8fb9-a335-4f42-b4d9-46239973b1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:30.102126 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-1acfa3d9-6058-496a-9634-f45503c961ea None None] MFA Rules not processed for user `b83c2a58f1234a02a81c6ab6700f9339`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:30.104697 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-1acfa3d9-6058-496a-9634-f45503c961ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:30.351333 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 839/1672] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:29 2021] POST /identity/v3/auth/tokens => generated 3670 bytes in 527 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:30.351333 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a8fb9-a335-4f42-b4d9-46239973b1fb None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:30.410760 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 834/1673] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:29 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 520 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:30.412352 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfa3d9-6058-496a-9634-f45503c961ea None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:30.607855 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfa3d9-6058-496a-9634-f45503c961ea None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:30.613645 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c666a0b-7e39-452d-9f97-a127304bc9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:30.614418 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c666a0b-7e39-452d-9f97-a127304bc9ae admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:30.615522 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c666a0b-7e39-452d-9f97-a127304bc9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:30.617023 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c666a0b-7e39-452d-9f97-a127304bc9ae admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:30.617811 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c666a0b-7e39-452d-9f97-a127304bc9ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:30.655479 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a8fb9-a335-4f42-b4d9-46239973b1fb None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:30.662538 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9bde7-f9af-408e-b270-c7a15d1aa4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:30.663357 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9bde7-f9af-408e-b270-c7a15d1aa4f8 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:30.663770 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9bde7-f9af-408e-b270-c7a15d1aa4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:30.664150 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d9bde7-f9af-408e-b270-c7a15d1aa4f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:30.665201 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d9bde7-f9af-408e-b270-c7a15d1aa4f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:30.684455 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c666a0b-7e39-452d-9f97-a127304bc9ae admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:30.744868 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d9bde7-f9af-408e-b270-c7a15d1aa4f8 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:30.758064 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 835/1674] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:05:30 2021] POST /identity/v3/projects => generated 363 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:30.759332 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c666a0b-7e39-452d-9f97-a127304bc9ae admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:30.793941 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 840/1675] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:30 2021] GET /identity/v3/roles => generated 1420 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:30.795584 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9bde7-f9af-408e-b270-c7a15d1aa4f8 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:30.835246 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d9bde7-f9af-408e-b270-c7a15d1aa4f8 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:30.894287 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c666a0b-7e39-452d-9f97-a127304bc9ae admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:30.899698 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592fd5a-a130-4b4a-917d-79db566415f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:30.900515 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592fd5a-a130-4b4a-917d-79db566415f0 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:30.901047 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592fd5a-a130-4b4a-917d-79db566415f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:30.901273 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592fd5a-a130-4b4a-917d-79db566415f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:30.902802 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592fd5a-a130-4b4a-917d-79db566415f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:30.956972 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592fd5a-a130-4b4a-917d-79db566415f0 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:31.043643 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 836/1676] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:05:30 2021] POST /identity/v3/projects => generated 373 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:31.044662 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592fd5a-a130-4b4a-917d-79db566415f0 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:31.118682 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5de9eb-a80f-437e-a1bb-1c4dd7c5840a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:31.119378 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5de9eb-a80f-437e-a1bb-1c4dd7c5840a admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:31.119693 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5de9eb-a80f-437e-a1bb-1c4dd7c5840a admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:31.120016 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5de9eb-a80f-437e-a1bb-1c4dd7c5840a admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:31.120815 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5de9eb-a80f-437e-a1bb-1c4dd7c5840a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:31.265581 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5de9eb-a80f-437e-a1bb-1c4dd7c5840a admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:31.342641 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 841/1677] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:05:30 2021] POST /identity/v3/users => generated 288 bytes in 548 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:31.343840 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5de9eb-a80f-437e-a1bb-1c4dd7c5840a admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:31.369806 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5de9eb-a80f-437e-a1bb-1c4dd7c5840a admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:31.380536 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86978b-4464-4e31-a636-595da864b85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:31.382955 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86978b-4464-4e31-a636-595da864b85c admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:31.383419 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86978b-4464-4e31-a636-595da864b85c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:31.383902 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86978b-4464-4e31-a636-595da864b85c admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:31.385069 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592fd5a-a130-4b4a-917d-79db566415f0 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:31.385931 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86978b-4464-4e31-a636-595da864b85c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:31.413790 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef374a2-5e5b-48ce-9c27-024f2d5935d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:31.414834 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef374a2-5e5b-48ce-9c27-024f2d5935d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:31.415523 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef374a2-5e5b-48ce-9c27-024f2d5935d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:31.415523 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef374a2-5e5b-48ce-9c27-024f2d5935d2 admin admin] PATH_INFO: `/v3/projects/1fef6cc608224e13aedffe867d77187b/users/ed95b6eff4e44d9dbb561ff002018ecb/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:31.426619 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef374a2-5e5b-48ce-9c27-024f2d5935d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fef6cc608224e13aedffe867d77187b, user_id=ed95b6eff4e44d9dbb561ff002018ecb, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:31.436708 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86978b-4464-4e31-a636-595da864b85c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:31.470597 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 842/1678] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:05:31 2021] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:31.476349 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fe6e8-c5c0-4883-bdd5-a8187dd62eda None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:31.476938 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fe6e8-c5c0-4883-bdd5-a8187dd62eda None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:31.476938 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fe6e8-c5c0-4883-bdd5-a8187dd62eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:31.517403 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef374a2-5e5b-48ce-9c27-024f2d5935d2 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:31.561423 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 837/1679] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:31 2021] PUT /identity/v3/projects/1fef6cc608224e13aedffe867d77187b/users/ed95b6eff4e44d9dbb561ff002018ecb/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:31.563016 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017e282-72d0-4db8-9108-94b1b5a3edb9 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:31.563412 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017e282-72d0-4db8-9108-94b1b5a3edb9 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:31.563834 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017e282-72d0-4db8-9108-94b1b5a3edb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:31.615670 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-989fe6e8-c5c0-4883-bdd5-a8187dd62eda None None] MFA Rules not processed for user `78e8b977173d4eb4b0a32973c8388971`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:31.617014 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-989fe6e8-c5c0-4883-bdd5-a8187dd62eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:31.642152 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-4017e282-72d0-4db8-9108-94b1b5a3edb9 None None] MFA Rules not processed for user `ed972e6b35be47a8af2e86651ccc6911`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:31.643534 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-4017e282-72d0-4db8-9108-94b1b5a3edb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:31.788278 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 843/1680] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:31 2021] POST /identity/v3/auth/tokens => generated 3700 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:31.788278 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fe6e8-c5c0-4883-bdd5-a8187dd62eda None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:31.934079 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 838/1681] 10.222.0.89 () {58 vars in 1014 bytes} [Wed Oct 27 15:05:31 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:31.935681 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017e282-72d0-4db8-9108-94b1b5a3edb9 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:31.966617 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fe6e8-c5c0-4883-bdd5-a8187dd62eda None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:31.972999 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188c4f9-bf0d-49a9-aa35-56c7eae5476f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:31.974012 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188c4f9-bf0d-49a9-aa35-56c7eae5476f admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:31.974334 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188c4f9-bf0d-49a9-aa35-56c7eae5476f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:31.974651 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188c4f9-bf0d-49a9-aa35-56c7eae5476f admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:31.981098 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188c4f9-bf0d-49a9-aa35-56c7eae5476f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:32.007941 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4017e282-72d0-4db8-9108-94b1b5a3edb9 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:32.029153 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27b3de-81a7-436a-8b90-3b0cb4c32e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:32.030128 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27b3de-81a7-436a-8b90-3b0cb4c32e17 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:32.030453 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27b3de-81a7-436a-8b90-3b0cb4c32e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:32.039757 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27b3de-81a7-436a-8b90-3b0cb4c32e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:32.040500 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27b3de-81a7-436a-8b90-3b0cb4c32e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:32.077178 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188c4f9-bf0d-49a9-aa35-56c7eae5476f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:32.134234 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 844/1682] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:31 2021] GET /identity/v3/roles => generated 1420 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:32.135359 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188c4f9-bf0d-49a9-aa35-56c7eae5476f admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:32.139828 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27b3de-81a7-436a-8b90-3b0cb4c32e17 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:32.168112 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188c4f9-bf0d-49a9-aa35-56c7eae5476f admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:32.185631 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 839/1683] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:31 2021] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:32.194110 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b897dbd-3a02-4697-b3ce-2c68ddf0d48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:32.194551 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b897dbd-3a02-4697-b3ce-2c68ddf0d48d admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:32.194751 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b897dbd-3a02-4697-b3ce-2c68ddf0d48d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:32.195014 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b897dbd-3a02-4697-b3ce-2c68ddf0d48d admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:32.196304 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b897dbd-3a02-4697-b3ce-2c68ddf0d48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:32.197897 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e5e7c-016d-4167-b80a-40d6ecafbd32 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:32.200745 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e5e7c-016d-4167-b80a-40d6ecafbd32 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:32.201058 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e5e7c-016d-4167-b80a-40d6ecafbd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:32.295620 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-336e5e7c-016d-4167-b80a-40d6ecafbd32 None None] MFA Rules not processed for user `78e8b977173d4eb4b0a32973c8388971`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:32.296898 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-336e5e7c-016d-4167-b80a-40d6ecafbd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:32.301787 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b897dbd-3a02-4697-b3ce-2c68ddf0d48d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:32.322208 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 840/1684] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:32 2021] POST /identity/v3/auth/tokens => generated 3700 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:32.323055 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e5e7c-016d-4167-b80a-40d6ecafbd32 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:32.341228 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 845/1685] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:32 2021] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:32.356971 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b897dbd-3a02-4697-b3ce-2c68ddf0d48d admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:32.369377 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e5e7c-016d-4167-b80a-40d6ecafbd32 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:32.389227 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b897dbd-3a02-4697-b3ce-2c68ddf0d48d admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:32.390541 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b9ba1-1ec0-4bb9-aeef-ee87c0c516f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:32.391392 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b9ba1-1ec0-4bb9-aeef-ee87c0c516f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:32.391709 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b9ba1-1ec0-4bb9-aeef-ee87c0c516f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:32.391990 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b9ba1-1ec0-4bb9-aeef-ee87c0c516f1 admin admin] PATH_INFO: `/v3/projects/f8b6a563cf02494393c354d7082c9d45/users/37eba2186add4d0db9685a5a30176757/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:32.412174 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7781065-5ca6-412e-b66d-71023576bdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:32.413442 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7781065-5ca6-412e-b66d-71023576bdbe admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:32.413874 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7781065-5ca6-412e-b66d-71023576bdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:32.414305 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7781065-5ca6-412e-b66d-71023576bdbe admin admin] PATH_INFO: `/v3/projects/451273cfad184b9cb12fa12d85f35297/users/56825915feb445b1bac23fe60d2a28c9/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:32.466816 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b9ba1-1ec0-4bb9-aeef-ee87c0c516f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8b6a563cf02494393c354d7082c9d45, user_id=37eba2186add4d0db9685a5a30176757, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:32.486131 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7781065-5ca6-412e-b66d-71023576bdbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=451273cfad184b9cb12fa12d85f35297, user_id=56825915feb445b1bac23fe60d2a28c9, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:32.579038 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b9ba1-1ec0-4bb9-aeef-ee87c0c516f1 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:32.601797 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7781065-5ca6-412e-b66d-71023576bdbe admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:32.638991 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 846/1686] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:32 2021] PUT /identity/v3/projects/451273cfad184b9cb12fa12d85f35297/users/56825915feb445b1bac23fe60d2a28c9/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:32.644081 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7781065-5ca6-412e-b66d-71023576bdbe admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:32.645741 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 841/1687] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:32 2021] PUT /identity/v3/projects/f8b6a563cf02494393c354d7082c9d45/users/37eba2186add4d0db9685a5a30176757/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:32.647014 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b9ba1-1ec0-4bb9-aeef-ee87c0c516f1 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:32.652121 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-b7781065-5ca6-412e-b66d-71023576bdbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:32.783172 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7781065-5ca6-412e-b66d-71023576bdbe admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:32.830998 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b9ba1-1ec0-4bb9-aeef-ee87c0c516f1 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:32.844391 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ae154-1fc7-4572-aac7-f6de1dfd9f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:32.845406 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ae154-1fc7-4572-aac7-f6de1dfd9f4f admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:32.845810 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ae154-1fc7-4572-aac7-f6de1dfd9f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:32.846212 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ae154-1fc7-4572-aac7-f6de1dfd9f4f admin admin] PATH_INFO: `/v3/projects/1fef6cc608224e13aedffe867d77187b/users/ed95b6eff4e44d9dbb561ff002018ecb/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:32.849661 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ae154-1fc7-4572-aac7-f6de1dfd9f4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fef6cc608224e13aedffe867d77187b, user_id=ed95b6eff4e44d9dbb561ff002018ecb, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:32.927019 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ae154-1fc7-4572-aac7-f6de1dfd9f4f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:32.950403 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8561a-50ae-4503-bbc0-607c5a02f7b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffba82bc9ddf42069a813b932bd310ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:32.951794 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8561a-50ae-4503-bbc0-607c5a02f7b2 service swift] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:32.956777 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8561a-50ae-4503-bbc0-607c5a02f7b2 service swift] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:32.957738 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8561a-50ae-4503-bbc0-607c5a02f7b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:32.962201 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 842/1688] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:32 2021] PUT /identity/v3/projects/1fef6cc608224e13aedffe867d77187b/users/ed95b6eff4e44d9dbb561ff002018ecb/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:32.964901 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ae154-1fc7-4572-aac7-f6de1dfd9f4f admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:32.968487 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-d09ae154-1fc7-4572-aac7-f6de1dfd9f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:33.146412 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8561a-50ae-4503-bbc0-607c5a02f7b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:33.232109 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ae154-1fc7-4572-aac7-f6de1dfd9f4f admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:33.243909 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035cee9-baa9-48b0-bb66-fff5b890963f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:33.244912 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035cee9-baa9-48b0-bb66-fff5b890963f admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:33.245346 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035cee9-baa9-48b0-bb66-fff5b890963f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:33.245809 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5035cee9-baa9-48b0-bb66-fff5b890963f admin admin] PATH_INFO: `/v3/users/d3b6433982164e739834be8e56e7b76c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:33.248658 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5035cee9-baa9-48b0-bb66-fff5b890963f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3b6433982164e739834be8e56e7b76c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:33.270179 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8561a-50ae-4503-bbc0-607c5a02f7b2 service swift] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:33.319593 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 847/1689] 10.222.0.89 () {60 vars in 1384 bytes} [Wed Oct 27 15:05:32 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 15:05:33.323138 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8561a-50ae-4503-bbc0-607c5a02f7b2 service swift] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:33.332030 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-81e8561a-50ae-4503-bbc0-607c5a02f7b2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:33.400140 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5035cee9-baa9-48b0-bb66-fff5b890963f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:33.477536 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8561a-50ae-4503-bbc0-607c5a02f7b2 service swift] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:33.662497 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-5035cee9-baa9-48b0-bb66-fff5b890963f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3b6433982164e739834be8e56e7b76c'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:33.725399 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-5035cee9-baa9-48b0-bb66-fff5b890963f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3b6433982164e739834be8e56e7b76c'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:33.728776 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-5035cee9-baa9-48b0-bb66-fff5b890963f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3b6433982164e739834be8e56e7b76c'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:33.758094 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-5035cee9-baa9-48b0-bb66-fff5b890963f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3b6433982164e739834be8e56e7b76c'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:33.768235 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352b79c-56d8-4787-b53e-18aab0417467 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:33.768848 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352b79c-56d8-4787-b53e-18aab0417467 service nova] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:33.769248 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352b79c-56d8-4787-b53e-18aab0417467 service nova] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:33.769573 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352b79c-56d8-4787-b53e-18aab0417467 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:33.771477 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-f352b79c-56d8-4787-b53e-18aab0417467 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:33.801924 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-5035cee9-baa9-48b0-bb66-fff5b890963f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3b6433982164e739834be8e56e7b76c'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:33.839944 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 843/1690] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:05:32 2021] DELETE /identity/v3/users/d3b6433982164e739834be8e56e7b76c => generated 0 bytes in 874 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:33.846161 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035cee9-baa9-48b0-bb66-fff5b890963f admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:33.853545 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-5035cee9-baa9-48b0-bb66-fff5b890963f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:34.138337 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352b79c-56d8-4787-b53e-18aab0417467 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:34.225930 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5035cee9-baa9-48b0-bb66-fff5b890963f admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:34.233083 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352b79c-56d8-4787-b53e-18aab0417467 service nova] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:34.267653 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628516a-028d-4944-966f-bfb5b503b155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:34.269556 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628516a-028d-4944-966f-bfb5b503b155 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:34.270451 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628516a-028d-4944-966f-bfb5b503b155 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:34.271287 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628516a-028d-4944-966f-bfb5b503b155 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:34.275836 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628516a-028d-4944-966f-bfb5b503b155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:34.297637 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 848/1691] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:33 2021] GET /identity/v3/auth/tokens => generated 3700 bytes in 977 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:34.299043 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352b79c-56d8-4787-b53e-18aab0417467 service nova] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:34.306088 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-f352b79c-56d8-4787-b53e-18aab0417467 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:34.348615 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352b79c-56d8-4787-b53e-18aab0417467 service nova] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:34.361789 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628516a-028d-4944-966f-bfb5b503b155 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:34.363629 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cf5cb2-7803-43b6-9044-16ca88b80ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:34.368726 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf5cb2-7803-43b6-9044-16ca88b80ccb admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:34.369340 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf5cb2-7803-43b6-9044-16ca88b80ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:34.371312 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cf5cb2-7803-43b6-9044-16ca88b80ccb admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:34.373095 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf5cb2-7803-43b6-9044-16ca88b80ccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:34.414387 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 844/1692] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:33 2021] GET /identity/v3/roles => generated 1420 bytes in 574 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:34.418861 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c11760-4b63-46d7-9a1b-bb27c71f1a24 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:34.419373 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c11760-4b63-46d7-9a1b-bb27c71f1a24 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:34.419816 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c11760-4b63-46d7-9a1b-bb27c71f1a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:34.456555 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cf5cb2-7803-43b6-9044-16ca88b80ccb admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:34.494707 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 849/1693] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:34 2021] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:34.497118 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4e5f5-b139-4099-b175-8b58dd0ce084 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:34.499954 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4e5f5-b139-4099-b175-8b58dd0ce084 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:34.501574 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4e5f5-b139-4099-b175-8b58dd0ce084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:34.518799 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-e7c11760-4b63-46d7-9a1b-bb27c71f1a24 None None] MFA Rules not processed for user `ed95b6eff4e44d9dbb561ff002018ecb`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:34.520996 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-e7c11760-4b63-46d7-9a1b-bb27c71f1a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:34.585817 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-0bd4e5f5-b139-4099-b175-8b58dd0ce084 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:34.591032 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-0bd4e5f5-b139-4099-b175-8b58dd0ce084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:34.606630 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 850/1694] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:34 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:34.607912 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4e5f5-b139-4099-b175-8b58dd0ce084 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:34.618745 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4e5f5-b139-4099-b175-8b58dd0ce084 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:34.625622 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9043f-4165-4e5e-8a0f-bb939bed9c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:34.626765 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9043f-4165-4e5e-8a0f-bb939bed9c8b admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:34.627391 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9043f-4165-4e5e-8a0f-bb939bed9c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:34.628093 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b9043f-4165-4e5e-8a0f-bb939bed9c8b admin admin] PATH_INFO: `/v3/projects/451273cfad184b9cb12fa12d85f35297/users/56825915feb445b1bac23fe60d2a28c9/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:34.630422 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9043f-4165-4e5e-8a0f-bb939bed9c8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=451273cfad184b9cb12fa12d85f35297, user_id=56825915feb445b1bac23fe60d2a28c9, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:34.685580 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b9043f-4165-4e5e-8a0f-bb939bed9c8b admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:34.697832 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 851/1695] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:34 2021] PUT /identity/v3/projects/451273cfad184b9cb12fa12d85f35297/users/56825915feb445b1bac23fe60d2a28c9/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:34.701214 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9043f-4165-4e5e-8a0f-bb939bed9c8b admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:34.757046 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 845/1696] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:34 2021] POST /identity/v3/auth/tokens => generated 3783 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:34.757714 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c11760-4b63-46d7-9a1b-bb27c71f1a24 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:34.792867 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c11760-4b63-46d7-9a1b-bb27c71f1a24 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:34.889549 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6eeca-10bb-4b6c-ab39-6f4a8e3878f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:34.890275 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6eeca-10bb-4b6c-ab39-6f4a8e3878f4 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:34.890626 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6eeca-10bb-4b6c-ab39-6f4a8e3878f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:34.891004 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6eeca-10bb-4b6c-ab39-6f4a8e3878f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:34.891870 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6eeca-10bb-4b6c-ab39-6f4a8e3878f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:34.913199 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b9043f-4165-4e5e-8a0f-bb939bed9c8b admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:34.921364 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4626e377-1651-4fc8-98c8-8fff147e4bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:34.926493 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6eeca-10bb-4b6c-ab39-6f4a8e3878f4 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:34.931250 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626e377-1651-4fc8-98c8-8fff147e4bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:34.931662 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626e377-1651-4fc8-98c8-8fff147e4bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:34.931983 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4626e377-1651-4fc8-98c8-8fff147e4bd6 admin admin] PATH_INFO: `/v3/projects/f8b6a563cf02494393c354d7082c9d45/users/37eba2186add4d0db9685a5a30176757/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:34.934676 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626e377-1651-4fc8-98c8-8fff147e4bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8b6a563cf02494393c354d7082c9d45, user_id=37eba2186add4d0db9685a5a30176757, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:34.944716 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 846/1697] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:34 2021] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:34.946241 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6eeca-10bb-4b6c-ab39-6f4a8e3878f4 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:34.950507 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-e9f6eeca-10bb-4b6c-ab39-6f4a8e3878f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:35.056326 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4626e377-1651-4fc8-98c8-8fff147e4bd6 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:35.081091 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6eeca-10bb-4b6c-ab39-6f4a8e3878f4 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:35.090498 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 852/1698] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:34 2021] PUT /identity/v3/projects/f8b6a563cf02494393c354d7082c9d45/users/37eba2186add4d0db9685a5a30176757/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:35.094475 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fce4cd-0db6-4969-8048-d61d5f3adf61 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:35.094777 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fce4cd-0db6-4969-8048-d61d5f3adf61 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:35.095115 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fce4cd-0db6-4969-8048-d61d5f3adf61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:35.236539 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-d2fce4cd-0db6-4969-8048-d61d5f3adf61 None None] MFA Rules not processed for user `3a3324c92a85423e9ab73178f876d531`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:35.238093 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-d2fce4cd-0db6-4969-8048-d61d5f3adf61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:35.285750 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f7138-416b-4dfd-a034-34aa96949113 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:35.287313 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f7138-416b-4dfd-a034-34aa96949113 service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:35.288252 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f7138-416b-4dfd-a034-34aa96949113 service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:35.290633 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f7138-416b-4dfd-a034-34aa96949113 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:35.414461 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f7138-416b-4dfd-a034-34aa96949113 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:35.431668 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 853/1699] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:35 2021] POST /identity/v3/auth/tokens => generated 3696 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:35.435771 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fce4cd-0db6-4969-8048-d61d5f3adf61 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:35.462366 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f7138-416b-4dfd-a034-34aa96949113 service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:35.500026 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 847/1700] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:34 2021] GET /identity/v3/auth/tokens => generated 3783 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:35.501105 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f7138-416b-4dfd-a034-34aa96949113 service cinder] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:35.502638 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-615f7138-416b-4dfd-a034-34aa96949113 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:35.644672 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fce4cd-0db6-4969-8048-d61d5f3adf61 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:35.651293 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b0105-be7b-4bd3-a128-8c7537104122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:35.652566 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b0105-be7b-4bd3-a128-8c7537104122 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:35.653072 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b0105-be7b-4bd3-a128-8c7537104122 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:35.653730 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53b0105-be7b-4bd3-a128-8c7537104122 admin admin] PATH_INFO: `/v3/projects/451273cfad184b9cb12fa12d85f35297/users/56825915feb445b1bac23fe60d2a28c9/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:35.656930 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b0105-be7b-4bd3-a128-8c7537104122 admin admin] RBAC: Authorizing `identity:create_grant(project_id=451273cfad184b9cb12fa12d85f35297, user_id=56825915feb445b1bac23fe60d2a28c9, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:35.692631 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53b0105-be7b-4bd3-a128-8c7537104122 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:35.724646 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 854/1701] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:35 2021] PUT /identity/v3/projects/451273cfad184b9cb12fa12d85f35297/users/56825915feb445b1bac23fe60d2a28c9/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:35.725896 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b0105-be7b-4bd3-a128-8c7537104122 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:35.760848 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f7138-416b-4dfd-a034-34aa96949113 service cinder] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:35.952997 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e347c1-787a-4870-9aee-3e08f6cb6244 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:35.953536 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e347c1-787a-4870-9aee-3e08f6cb6244 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:35.953920 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e347c1-787a-4870-9aee-3e08f6cb6244 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:35.954091 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e347c1-787a-4870-9aee-3e08f6cb6244 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:35.972342 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53b0105-be7b-4bd3-a128-8c7537104122 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:35.975847 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e347c1-787a-4870-9aee-3e08f6cb6244 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:35.988395 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6083adcb-8174-42fe-a70d-1d922694590c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:35.990049 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083adcb-8174-42fe-a70d-1d922694590c admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:35.990863 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083adcb-8174-42fe-a70d-1d922694590c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:35.992003 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6083adcb-8174-42fe-a70d-1d922694590c admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:36.001924 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6083adcb-8174-42fe-a70d-1d922694590c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:36.044990 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e347c1-787a-4870-9aee-3e08f6cb6244 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:36.081810 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 848/1702] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:35 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:36.082822 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58b13d-8827-49b2-8a23-3a996df7be2f None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:36.083479 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58b13d-8827-49b2-8a23-3a996df7be2f None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:36.083479 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58b13d-8827-49b2-8a23-3a996df7be2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:36.101689 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6083adcb-8174-42fe-a70d-1d922694590c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:36.124843 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 855/1703] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:35 2021] GET /identity/v3/roles => generated 1420 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:36.125236 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2faa7-435d-43be-b106-f397a4cf21e8 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:36.125570 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2faa7-435d-43be-b106-f397a4cf21e8 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:36.126039 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a2faa7-435d-43be-b106-f397a4cf21e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:36.137862 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-cc58b13d-8827-49b2-8a23-3a996df7be2f None None] MFA Rules not processed for user `ab1b41f8980348fc878e492e26078e33`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:36.139162 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-cc58b13d-8827-49b2-8a23-3a996df7be2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:36.156690 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 849/1704] 10.222.0.91 () {58 vars in 1015 bytes} [Wed Oct 27 15:05:36 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:36.159156 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58b13d-8827-49b2-8a23-3a996df7be2f None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:36.241412 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-a7a2faa7-435d-43be-b106-f397a4cf21e8 None None] MFA Rules not processed for user `56825915feb445b1bac23fe60d2a28c9`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:36.243914 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-a7a2faa7-435d-43be-b106-f397a4cf21e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:36.310711 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58b13d-8827-49b2-8a23-3a996df7be2f None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:36.323009 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627db8d0-44be-4b9a-93f9-ff645555a4bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:36.324203 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627db8d0-44be-4b9a-93f9-ff645555a4bd service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:36.324808 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627db8d0-44be-4b9a-93f9-ff645555a4bd service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:36.325403 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627db8d0-44be-4b9a-93f9-ff645555a4bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:36.330592 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-627db8d0-44be-4b9a-93f9-ff645555a4bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:36.420893 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 856/1705] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:36 2021] POST /identity/v3/auth/tokens => generated 3747 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:36.420893 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2faa7-435d-43be-b106-f397a4cf21e8 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:36.436150 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a2faa7-435d-43be-b106-f397a4cf21e8 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:36.445149 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb845d96-435c-450f-828e-af3b9015fd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:36.447354 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb845d96-435c-450f-828e-af3b9015fd3e admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:36.447885 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb845d96-435c-450f-828e-af3b9015fd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:36.448276 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb845d96-435c-450f-828e-af3b9015fd3e admin admin] PATH_INFO: `/v3/projects/f8b6a563cf02494393c354d7082c9d45/users/37eba2186add4d0db9685a5a30176757/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:36.452083 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb845d96-435c-450f-828e-af3b9015fd3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8b6a563cf02494393c354d7082c9d45, user_id=37eba2186add4d0db9685a5a30176757, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:36.502012 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb845d96-435c-450f-828e-af3b9015fd3e admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:36.508182 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627db8d0-44be-4b9a-93f9-ff645555a4bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:36.542109 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 857/1706] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:36 2021] PUT /identity/v3/projects/f8b6a563cf02494393c354d7082c9d45/users/37eba2186add4d0db9685a5a30176757/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:36.551764 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb845d96-435c-450f-828e-af3b9015fd3e admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:36.556977 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627db8d0-44be-4b9a-93f9-ff645555a4bd service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:36.571867 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 850/1707] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:36 2021] GET /identity/v3/auth/tokens => generated 3716 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:36.573319 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627db8d0-44be-4b9a-93f9-ff645555a4bd service cinder] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:36.603227 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627db8d0-44be-4b9a-93f9-ff645555a4bd service cinder] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:36.705694 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcfb342-92f1-445b-8f0e-48186bd190ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:36.706943 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfb342-92f1-445b-8f0e-48186bd190ab service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:36.707617 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfb342-92f1-445b-8f0e-48186bd190ab service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:36.708034 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcfb342-92f1-445b-8f0e-48186bd190ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:36.727411 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcfb342-92f1-445b-8f0e-48186bd190ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:36.771953 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb845d96-435c-450f-828e-af3b9015fd3e admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:36.778418 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2c93e-a961-4ac0-a294-d12b333067d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:36.779297 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2c93e-a961-4ac0-a294-d12b333067d2 service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:36.779791 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2c93e-a961-4ac0-a294-d12b333067d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:36.780250 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2c93e-a961-4ac0-a294-d12b333067d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:36.783353 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcfb342-92f1-445b-8f0e-48186bd190ab service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:36.800676 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2c93e-a961-4ac0-a294-d12b333067d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:36.805748 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 851/1708] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:36 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:36.806763 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcfb342-92f1-445b-8f0e-48186bd190ab service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:36.808542 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-5dcfb342-92f1-445b-8f0e-48186bd190ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:36.908834 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2c93e-a961-4ac0-a294-d12b333067d2 service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:36.955661 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 858/1709] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:36 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:36.956931 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2c93e-a961-4ac0-a294-d12b333067d2 service neutron] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:36.970487 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-edb2c93e-a961-4ac0-a294-d12b333067d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:37.044059 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcfb342-92f1-445b-8f0e-48186bd190ab service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:37.062123 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba9144-6ac5-44cc-bb2c-33e5990a5538 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:37.063120 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba9144-6ac5-44cc-bb2c-33e5990a5538 service nova] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:37.063774 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba9144-6ac5-44cc-bb2c-33e5990a5538 service nova] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:37.064277 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba9144-6ac5-44cc-bb2c-33e5990a5538 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:37.285687 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2c93e-a961-4ac0-a294-d12b333067d2 service neutron] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:37.304315 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f74b75-9b62-4e10-abc9-3fc7e262d324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:37.305339 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f74b75-9b62-4e10-abc9-3fc7e262d324 service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:37.305644 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f74b75-9b62-4e10-abc9-3fc7e262d324 service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:37.312040 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f74b75-9b62-4e10-abc9-3fc7e262d324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:37.375471 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba9144-6ac5-44cc-bb2c-33e5990a5538 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:37.465403 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba9144-6ac5-44cc-bb2c-33e5990a5538 service nova] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:37.491334 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 852/1710] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:36 2021] GET /identity/v3/auth/tokens => generated 3696 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:37.494699 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291ff80-5f0e-4428-9d20-2421641cc6e2 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:37.495853 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291ff80-5f0e-4428-9d20-2421641cc6e2 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:37.496266 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291ff80-5f0e-4428-9d20-2421641cc6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:37.544595 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f74b75-9b62-4e10-abc9-3fc7e262d324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:37.603798 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-9291ff80-5f0e-4428-9d20-2421641cc6e2 None None] MFA Rules not processed for user `37eba2186add4d0db9685a5a30176757`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:37.606510 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-9291ff80-5f0e-4428-9d20-2421641cc6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:37.622775 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f74b75-9b62-4e10-abc9-3fc7e262d324 service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:37.658529 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 859/1711] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:36 2021] GET /identity/v3/auth/tokens => generated 3747 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:37.665994 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f74b75-9b62-4e10-abc9-3fc7e262d324 service cinder] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:37.671353 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-75f74b75-9b62-4e10-abc9-3fc7e262d324 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:38.001438 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 853/1712] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:37 2021] POST /identity/v3/auth/tokens => generated 3737 bytes in 509 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:38.018137 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f74b75-9b62-4e10-abc9-3fc7e262d324 service cinder] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:38.033858 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291ff80-5f0e-4428-9d20-2421641cc6e2 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:38.043168 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e5fb0-e5d1-466a-b6e2-190d7d1cb674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:38.045280 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e5fb0-e5d1-466a-b6e2-190d7d1cb674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:38.046690 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291ff80-5f0e-4428-9d20-2421641cc6e2 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:38.052347 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e5fb0-e5d1-466a-b6e2-190d7d1cb674 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:38.053254 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e5fb0-e5d1-466a-b6e2-190d7d1cb674 admin admin] PATH_INFO: `/v3/projects/0b19569eccd4401bb5e17740db56df53` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:38.055318 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e5fb0-e5d1-466a-b6e2-190d7d1cb674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b19569eccd4401bb5e17740db56df53)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:38.063247 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf368b-7263-4c69-831e-391e6303ba45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:38.064069 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf368b-7263-4c69-831e-391e6303ba45 service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:38.064469 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf368b-7263-4c69-831e-391e6303ba45 service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:38.067771 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf368b-7263-4c69-831e-391e6303ba45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:38.098462 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf368b-7263-4c69-831e-391e6303ba45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:38.152862 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf368b-7263-4c69-831e-391e6303ba45 service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:38.155132 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833e5fb0-e5d1-466a-b6e2-190d7d1cb674 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:38.181197 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 854/1713] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:38 2021] GET /identity/v3/auth/tokens => generated 3737 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:05:38.354166 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-833e5fb0-e5d1-466a-b6e2-190d7d1cb674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b19569eccd4401bb5e17740db56df53', 'request_id': 'req-833e5fb0-e5d1-466a-b6e2-190d7d1cb674'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:38.383132 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-833e5fb0-e5d1-466a-b6e2-190d7d1cb674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b19569eccd4401bb5e17740db56df53', 'request_id': 'req-833e5fb0-e5d1-466a-b6e2-190d7d1cb674'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:38.399248 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf368b-7263-4c69-831e-391e6303ba45 service cinder] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:38.421053 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf368b-7263-4c69-831e-391e6303ba45 service cinder] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:38.430727 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-833e5fb0-e5d1-466a-b6e2-190d7d1cb674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b19569eccd4401bb5e17740db56df53', 'request_id': 'req-833e5fb0-e5d1-466a-b6e2-190d7d1cb674'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:38.469190 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-833e5fb0-e5d1-466a-b6e2-190d7d1cb674 admin admin] The token cache is being invalidate because project 0b19569eccd4401bb5e17740db56df53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:05:38.469493 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-833e5fb0-e5d1-466a-b6e2-190d7d1cb674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:38.479682 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-833e5fb0-e5d1-466a-b6e2-190d7d1cb674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:38.483701 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 860/1714] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:05:37 2021] DELETE /identity/v3/projects/0b19569eccd4401bb5e17740db56df53 => generated 0 bytes in 825 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:38.497532 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20f420-b774-46f9-8886-535881cc4f79 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:38.502465 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20f420-b774-46f9-8886-535881cc4f79 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:38.503767 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20f420-b774-46f9-8886-535881cc4f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:38.526881 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa9853-2dad-48ff-a83b-2fa5e4c838b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:38.526881 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa9853-2dad-48ff-a83b-2fa5e4c838b6 service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:38.526881 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa9853-2dad-48ff-a83b-2fa5e4c838b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:38.526881 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa9853-2dad-48ff-a83b-2fa5e4c838b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:38.529179 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-a5fa9853-2dad-48ff-a83b-2fa5e4c838b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:38.637502 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-9f20f420-b774-46f9-8886-535881cc4f79 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:38.639118 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-9f20f420-b774-46f9-8886-535881cc4f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:38.666372 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa9853-2dad-48ff-a83b-2fa5e4c838b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:38.729099 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa9853-2dad-48ff-a83b-2fa5e4c838b6 service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:38.780106 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 855/1715] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:38 2021] GET /identity/v3/auth/tokens => generated 3670 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:05:38.804734 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa9853-2dad-48ff-a83b-2fa5e4c838b6 service cinder] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:38.806880 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-a5fa9853-2dad-48ff-a83b-2fa5e4c838b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:38.935548 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 861/1716] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:38.950096 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec76e92-3217-4c3c-b8f5-4efbd9f2d222 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:38.950266 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec76e92-3217-4c3c-b8f5-4efbd9f2d222 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:38.950528 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec76e92-3217-4c3c-b8f5-4efbd9f2d222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:39.016033 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-9ec76e92-3217-4c3c-b8f5-4efbd9f2d222 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:39.017270 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-9ec76e92-3217-4c3c-b8f5-4efbd9f2d222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:39.048791 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 862/1717] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:39.058732 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec76e92-3217-4c3c-b8f5-4efbd9f2d222 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:39.073989 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec76e92-3217-4c3c-b8f5-4efbd9f2d222 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:39.099907 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5689aa1-f39a-4a24-a139-44378c2d1ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:39.100530 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5689aa1-f39a-4a24-a139-44378c2d1ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:39.100825 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5689aa1-f39a-4a24-a139-44378c2d1ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:39.101109 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5689aa1-f39a-4a24-a139-44378c2d1ed6 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:39.106114 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5689aa1-f39a-4a24-a139-44378c2d1ed6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:05:39.107341 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5689aa1-f39a-4a24-a139-44378c2d1ed6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:39.128018 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa9853-2dad-48ff-a83b-2fa5e4c838b6 service cinder] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:39.159776 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e9d6f-30c5-4958-b1f0-478839701339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:39.165165 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e9d6f-30c5-4958-b1f0-478839701339 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:39.165659 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e9d6f-30c5-4958-b1f0-478839701339 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:39.166150 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e9d6f-30c5-4958-b1f0-478839701339 admin admin] PATH_INFO: `/v3/users/b83c2a58f1234a02a81c6ab6700f9339` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:39.169722 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e9d6f-30c5-4958-b1f0-478839701339 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b83c2a58f1234a02a81c6ab6700f9339)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:39.275557 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5689aa1-f39a-4a24-a139-44378c2d1ed6 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:39.287598 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e9d6f-30c5-4958-b1f0-478839701339 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:39.325643 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 863/1718] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:05:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:05:39.326789 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5689aa1-f39a-4a24-a139-44378c2d1ed6 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:39.337001 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5689aa1-f39a-4a24-a139-44378c2d1ed6 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:39.352607 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac215f-e168-4678-b3d8-2e361f14e024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:39.353002 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac215f-e168-4678-b3d8-2e361f14e024 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:39.353295 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac215f-e168-4678-b3d8-2e361f14e024 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:39.353574 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac215f-e168-4678-b3d8-2e361f14e024 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:39.354222 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac215f-e168-4678-b3d8-2e361f14e024 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:39.449422 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac215f-e168-4678-b3d8-2e361f14e024 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:39.457864 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-0c8e9d6f-30c5-4958-b1f0-478839701339 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b83c2a58f1234a02a81c6ab6700f9339'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:39.482968 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-0c8e9d6f-30c5-4958-b1f0-478839701339 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b83c2a58f1234a02a81c6ab6700f9339'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:39.484223 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-0c8e9d6f-30c5-4958-b1f0-478839701339 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b83c2a58f1234a02a81c6ab6700f9339'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:39.497413 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-0c8e9d6f-30c5-4958-b1f0-478839701339 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b83c2a58f1234a02a81c6ab6700f9339'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:39.516858 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-0c8e9d6f-30c5-4958-b1f0-478839701339 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b83c2a58f1234a02a81c6ab6700f9339'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:39.541951 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 856/1719] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:05:38 2021] DELETE /identity/v3/users/b83c2a58f1234a02a81c6ab6700f9339 => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:39.547426 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e809b-3cfa-4c68-bcbd-bb7fdfca2cfc None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:39.547883 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e809b-3cfa-4c68-bcbd-bb7fdfca2cfc None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:39.548438 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e809b-3cfa-4c68-bcbd-bb7fdfca2cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:39.560176 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 864/1720] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:05:39 2021] POST /identity/v3/projects => generated 375 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:39.562026 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac215f-e168-4678-b3d8-2e361f14e024 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:39.565358 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-93ac215f-e168-4678-b3d8-2e361f14e024 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:39.605703 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-d43e809b-3cfa-4c68-bcbd-bb7fdfca2cfc None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:39.608649 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-d43e809b-3cfa-4c68-bcbd-bb7fdfca2cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:39.765760 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 857/1721] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:39.778377 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e809b-3cfa-4c68-bcbd-bb7fdfca2cfc None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:39.780391 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-d43e809b-3cfa-4c68-bcbd-bb7fdfca2cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:39.793102 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac215f-e168-4678-b3d8-2e361f14e024 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:39.799108 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046df29-8077-4ad3-9c48-6bbb40763e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:39.799872 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046df29-8077-4ad3-9c48-6bbb40763e78 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:39.800485 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046df29-8077-4ad3-9c48-6bbb40763e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:39.800802 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046df29-8077-4ad3-9c48-6bbb40763e78 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:39.801897 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046df29-8077-4ad3-9c48-6bbb40763e78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:39.862659 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046df29-8077-4ad3-9c48-6bbb40763e78 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:39.901285 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 865/1722] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:05:39 2021] POST /identity/v3/users => generated 288 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:05:39.908238 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e809b-3cfa-4c68-bcbd-bb7fdfca2cfc None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:39.908664 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046df29-8077-4ad3-9c48-6bbb40763e78 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:39.918938 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d57e16-4dac-41c7-942f-707f92be635a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:39.919645 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d57e16-4dac-41c7-942f-707f92be635a service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:39.919953 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d57e16-4dac-41c7-942f-707f92be635a service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:39.920216 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d57e16-4dac-41c7-942f-707f92be635a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:39.945264 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046df29-8077-4ad3-9c48-6bbb40763e78 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:39.960936 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed8e62-b6a4-457a-8d03-4769b0387886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:39.962820 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed8e62-b6a4-457a-8d03-4769b0387886 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:39.963425 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed8e62-b6a4-457a-8d03-4769b0387886 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:39.964994 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed8e62-b6a4-457a-8d03-4769b0387886 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:39.966623 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed8e62-b6a4-457a-8d03-4769b0387886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:39.977991 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d57e16-4dac-41c7-942f-707f92be635a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:40.039804 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d57e16-4dac-41c7-942f-707f92be635a service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:40.042033 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed8e62-b6a4-457a-8d03-4769b0387886 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:40.064120 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 858/1723] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:39 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:05:40.075544 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 866/1724] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:39 2021] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:40.080324 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d57e16-4dac-41c7-942f-707f92be635a service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:40.092172 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d57e16-4dac-41c7-942f-707f92be635a service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:40.097969 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b22f78-8f37-4cf9-b257-9e9257f5c7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:40.098986 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b22f78-8f37-4cf9-b257-9e9257f5c7c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:40.099339 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b22f78-8f37-4cf9-b257-9e9257f5c7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:40.099713 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b22f78-8f37-4cf9-b257-9e9257f5c7c4 admin admin] PATH_INFO: `/v3/projects/e8efe1044e564cda9cc3575dee988110/users/13b4892a074e48829c3342757be14eb6/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:40.130691 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b22f78-8f37-4cf9-b257-9e9257f5c7c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8efe1044e564cda9cc3575dee988110, user_id=13b4892a074e48829c3342757be14eb6, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:40.161220 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b22f78-8f37-4cf9-b257-9e9257f5c7c4 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:40.190281 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 859/1725] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:40 2021] PUT /identity/v3/projects/e8efe1044e564cda9cc3575dee988110/users/13b4892a074e48829c3342757be14eb6/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:40.191923 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae31f6-3ed3-4872-9f88-f65c5195a13d None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:40.192498 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae31f6-3ed3-4872-9f88-f65c5195a13d None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:40.192645 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae31f6-3ed3-4872-9f88-f65c5195a13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:40.302749 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-adae31f6-3ed3-4872-9f88-f65c5195a13d None None] MFA Rules not processed for user `13b4892a074e48829c3342757be14eb6`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:40.303991 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-adae31f6-3ed3-4872-9f88-f65c5195a13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:40.424334 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 867/1726] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:40 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:41.568133 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ba6ee-eec9-4332-8e3c-6a45fd04739f None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:41.569249 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ba6ee-eec9-4332-8e3c-6a45fd04739f None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:41.569737 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ba6ee-eec9-4332-8e3c-6a45fd04739f None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:41.576420 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 860/1727] 10.222.0.89 () {54 vars in 921 bytes} [Wed Oct 27 15:05:41 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:05:41.603011 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe7c60-2ca2-4b9c-ba66-d93f92efec3b None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:41.603975 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe7c60-2ca2-4b9c-ba66-d93f92efec3b None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:41.604319 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe7c60-2ca2-4b9c-ba66-d93f92efec3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:41.648720 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-f5fe7c60-2ca2-4b9c-ba66-d93f92efec3b None None] MFA Rules not processed for user `01acdb65e66441418d4abe1f0ed804bc`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:41.661261 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-f5fe7c60-2ca2-4b9c-ba66-d93f92efec3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:41.701656 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ba6ee-eec9-4332-8e3c-6a45fd04739f None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:41.713014 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-7b3ba6ee-eec9-4332-8e3c-6a45fd04739f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:41.847696 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 868/1728] 10.222.0.89 () {58 vars in 1018 bytes} [Wed Oct 27 15:05:41 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:05:41.849011 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe7c60-2ca2-4b9c-ba66-d93f92efec3b None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:41.850514 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-f5fe7c60-2ca2-4b9c-ba66-d93f92efec3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:41.867560 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ba6ee-eec9-4332-8e3c-6a45fd04739f None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:41.877864 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a433e66-d404-4954-94cc-a8264d6b4924 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:41.878818 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a433e66-d404-4954-94cc-a8264d6b4924 service nova] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:41.879262 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a433e66-d404-4954-94cc-a8264d6b4924 service nova] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:41.879743 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a433e66-d404-4954-94cc-a8264d6b4924 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:41.899771 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a433e66-d404-4954-94cc-a8264d6b4924 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:41.928314 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a433e66-d404-4954-94cc-a8264d6b4924 service nova] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:41.944811 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 861/1729] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:41 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:05:41.984690 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe7c60-2ca2-4b9c-ba66-d93f92efec3b None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:42.000395 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60da47-8d99-4095-a8b4-450f08c83392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:42.001427 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60da47-8d99-4095-a8b4-450f08c83392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:42.007833 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60da47-8d99-4095-a8b4-450f08c83392 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:42.008263 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60da47-8d99-4095-a8b4-450f08c83392 admin admin] PATH_INFO: `/v3/projects/a574067a4cd54ca9bb1cd1d07290421a` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:42.009660 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60da47-8d99-4095-a8b4-450f08c83392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a574067a4cd54ca9bb1cd1d07290421a)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:42.043630 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60da47-8d99-4095-a8b4-450f08c83392 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:42.099568 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-4c60da47-8d99-4095-a8b4-450f08c83392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a574067a4cd54ca9bb1cd1d07290421a', 'request_id': 'req-4c60da47-8d99-4095-a8b4-450f08c83392'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:42.106321 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-4c60da47-8d99-4095-a8b4-450f08c83392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a574067a4cd54ca9bb1cd1d07290421a', 'request_id': 'req-4c60da47-8d99-4095-a8b4-450f08c83392'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:42.119152 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-4c60da47-8d99-4095-a8b4-450f08c83392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a574067a4cd54ca9bb1cd1d07290421a', 'request_id': 'req-4c60da47-8d99-4095-a8b4-450f08c83392'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:42.135354 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-4c60da47-8d99-4095-a8b4-450f08c83392 admin admin] The token cache is being invalidate because project a574067a4cd54ca9bb1cd1d07290421a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:05:42.135668 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-4c60da47-8d99-4095-a8b4-450f08c83392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:42.136619 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-4c60da47-8d99-4095-a8b4-450f08c83392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:42.138480 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 869/1730] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:05:41 2021] DELETE /identity/v3/projects/a574067a4cd54ca9bb1cd1d07290421a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:42.142601 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a433e66-d404-4954-94cc-a8264d6b4924 service nova] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:42.157920 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a433e66-d404-4954-94cc-a8264d6b4924 service nova] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:42.281470 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90978e4d-3507-4941-a58c-496f1c541c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:42.282755 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90978e4d-3507-4941-a58c-496f1c541c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:42.283045 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90978e4d-3507-4941-a58c-496f1c541c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:42.283323 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90978e4d-3507-4941-a58c-496f1c541c1d admin admin] PATH_INFO: `/v3/users/56825915feb445b1bac23fe60d2a28c9` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:42.284555 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90978e4d-3507-4941-a58c-496f1c541c1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=56825915feb445b1bac23fe60d2a28c9)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:42.315328 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90978e4d-3507-4941-a58c-496f1c541c1d admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:42.375809 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60da47-8d99-4095-a8b4-450f08c83392 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:42.377280 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-4c60da47-8d99-4095-a8b4-450f08c83392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:42.415972 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-90978e4d-3507-4941-a58c-496f1c541c1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56825915feb445b1bac23fe60d2a28c9'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:42.440772 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-90978e4d-3507-4941-a58c-496f1c541c1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56825915feb445b1bac23fe60d2a28c9'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:42.444127 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-90978e4d-3507-4941-a58c-496f1c541c1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56825915feb445b1bac23fe60d2a28c9'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:42.470482 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-90978e4d-3507-4941-a58c-496f1c541c1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56825915feb445b1bac23fe60d2a28c9'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:42.471198 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60da47-8d99-4095-a8b4-450f08c83392 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:42.476828 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ae82c-08c9-45f6-a5b7-acef53fa8bcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:42.477484 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ae82c-08c9-45f6-a5b7-acef53fa8bcd service nova] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:42.477846 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ae82c-08c9-45f6-a5b7-acef53fa8bcd service nova] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:42.478033 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876ae82c-08c9-45f6-a5b7-acef53fa8bcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:42.480572 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-876ae82c-08c9-45f6-a5b7-acef53fa8bcd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:42.481777 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-90978e4d-3507-4941-a58c-496f1c541c1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56825915feb445b1bac23fe60d2a28c9'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:42.492622 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ae82c-08c9-45f6-a5b7-acef53fa8bcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:42.494074 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 862/1731] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:05:42 2021] DELETE /identity/v3/users/56825915feb445b1bac23fe60d2a28c9 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:42.522962 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876ae82c-08c9-45f6-a5b7-acef53fa8bcd service nova] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:42.538861 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 870/1732] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:42 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:42.954536 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f30a2e-5c4f-4321-8c92-fee1f5bd1c84 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:42.955422 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f30a2e-5c4f-4321-8c92-fee1f5bd1c84 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:42.955938 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f30a2e-5c4f-4321-8c92-fee1f5bd1c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:43.006550 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-b0f30a2e-5c4f-4321-8c92-fee1f5bd1c84 None None] MFA Rules not processed for user `78e8b977173d4eb4b0a32973c8388971`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:43.012212 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-b0f30a2e-5c4f-4321-8c92-fee1f5bd1c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:43.254252 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 863/1733] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:42 2021] POST /identity/v3/auth/tokens => generated 3700 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:05:43.471660 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ae82c-08c9-45f6-a5b7-acef53fa8bcd service nova] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:43.473080 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-876ae82c-08c9-45f6-a5b7-acef53fa8bcd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:43.499166 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876ae82c-08c9-45f6-a5b7-acef53fa8bcd service nova] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:43.679611 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872c5f5-607e-4e89-9fd1-e85f2efeb64e None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:43.680591 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872c5f5-607e-4e89-9fd1-e85f2efeb64e None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:43.681073 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872c5f5-607e-4e89-9fd1-e85f2efeb64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:43.713775 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaa18ea-32b8-40bd-a70e-f6e676198151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:43.715122 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa18ea-32b8-40bd-a70e-f6e676198151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:43.717612 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa18ea-32b8-40bd-a70e-f6e676198151 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:43.718792 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaa18ea-32b8-40bd-a70e-f6e676198151 admin admin] PATH_INFO: `/v3/projects/451273cfad184b9cb12fa12d85f35297` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:43.721819 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa18ea-32b8-40bd-a70e-f6e676198151 admin admin] RBAC: Authorizing `identity:delete_project(project_id=451273cfad184b9cb12fa12d85f35297)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:43.732772 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-e872c5f5-607e-4e89-9fd1-e85f2efeb64e None None] MFA Rules not processed for user `3a3324c92a85423e9ab73178f876d531`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:43.737300 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-e872c5f5-607e-4e89-9fd1-e85f2efeb64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:43.764029 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaa18ea-32b8-40bd-a70e-f6e676198151 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:43.867325 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-8aaa18ea-32b8-40bd-a70e-f6e676198151 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '451273cfad184b9cb12fa12d85f35297', 'request_id': 'req-8aaa18ea-32b8-40bd-a70e-f6e676198151'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:43.885681 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-8aaa18ea-32b8-40bd-a70e-f6e676198151 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '451273cfad184b9cb12fa12d85f35297', 'request_id': 'req-8aaa18ea-32b8-40bd-a70e-f6e676198151'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:43.904244 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-8aaa18ea-32b8-40bd-a70e-f6e676198151 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '451273cfad184b9cb12fa12d85f35297', 'request_id': 'req-8aaa18ea-32b8-40bd-a70e-f6e676198151'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:43.924790 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-8aaa18ea-32b8-40bd-a70e-f6e676198151 admin admin] The token cache is being invalidate because project 451273cfad184b9cb12fa12d85f35297 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:05:43.925309 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-8aaa18ea-32b8-40bd-a70e-f6e676198151 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:43.926292 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-8aaa18ea-32b8-40bd-a70e-f6e676198151 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:43.929077 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 871/1734] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:05:43 2021] DELETE /identity/v3/projects/451273cfad184b9cb12fa12d85f35297 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:43.937951 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56ec7b-7af2-4995-9ce1-b79603289eef None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:43.938494 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56ec7b-7af2-4995-9ce1-b79603289eef None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:43.939089 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56ec7b-7af2-4995-9ce1-b79603289eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:43.962955 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 864/1735] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:43 2021] POST /identity/v3/auth/tokens => generated 3696 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:43.972550 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-8c56ec7b-7af2-4995-9ce1-b79603289eef None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:43.974008 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-8c56ec7b-7af2-4995-9ce1-b79603289eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:44.052066 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872c5f5-607e-4e89-9fd1-e85f2efeb64e None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:44.053894 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-e872c5f5-607e-4e89-9fd1-e85f2efeb64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:44.070464 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872c5f5-607e-4e89-9fd1-e85f2efeb64e None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:44.161583 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 872/1736] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:05:44.161583 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69a85d-7e4c-40bc-92ba-36f1e4aef9ab None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:44.161583 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69a85d-7e4c-40bc-92ba-36f1e4aef9ab None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:44.161583 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69a85d-7e4c-40bc-92ba-36f1e4aef9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:44.257921 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-7d69a85d-7e4c-40bc-92ba-36f1e4aef9ab None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:44.261231 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-7d69a85d-7e4c-40bc-92ba-36f1e4aef9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:44.297540 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 873/1737] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:44.302757 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69a85d-7e4c-40bc-92ba-36f1e4aef9ab None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:44.317448 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69736f4b-2aa9-4d52-8d45-0a7387615248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:44.317934 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69a85d-7e4c-40bc-92ba-36f1e4aef9ab None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:44.319104 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69736f4b-2aa9-4d52-8d45-0a7387615248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:44.319726 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69736f4b-2aa9-4d52-8d45-0a7387615248 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:44.320014 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69736f4b-2aa9-4d52-8d45-0a7387615248 admin admin] PATH_INFO: `/v3/users/13b4892a074e48829c3342757be14eb6` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:44.322618 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69736f4b-2aa9-4d52-8d45-0a7387615248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13b4892a074e48829c3342757be14eb6)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:44.324562 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edff98c-d0f8-4535-a213-3dd024748c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:44.325882 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edff98c-d0f8-4535-a213-3dd024748c36 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:44.326405 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edff98c-d0f8-4535-a213-3dd024748c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:44.326897 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edff98c-d0f8-4535-a213-3dd024748c36 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:44.328074 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edff98c-d0f8-4535-a213-3dd024748c36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:05:44.328544 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edff98c-d0f8-4535-a213-3dd024748c36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:44.361252 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edff98c-d0f8-4535-a213-3dd024748c36 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:44.376039 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69736f4b-2aa9-4d52-8d45-0a7387615248 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:44.385975 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 874/1738] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:05:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:05:44.387932 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edff98c-d0f8-4535-a213-3dd024748c36 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:44.405645 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edff98c-d0f8-4535-a213-3dd024748c36 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:44.411922 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322803ec-2267-4a65-bf4c-c34b83416cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:44.413955 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322803ec-2267-4a65-bf4c-c34b83416cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:44.414579 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322803ec-2267-4a65-bf4c-c34b83416cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:44.415127 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322803ec-2267-4a65-bf4c-c34b83416cd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:44.416111 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322803ec-2267-4a65-bf4c-c34b83416cd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:44.456209 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322803ec-2267-4a65-bf4c-c34b83416cd4 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:44.507029 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 875/1739] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:05:44 2021] POST /identity/v3/projects => generated 355 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:44.512040 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-69736f4b-2aa9-4d52-8d45-0a7387615248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13b4892a074e48829c3342757be14eb6'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:44.516013 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322803ec-2267-4a65-bf4c-c34b83416cd4 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:44.534383 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-69736f4b-2aa9-4d52-8d45-0a7387615248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13b4892a074e48829c3342757be14eb6'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:44.535784 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-69736f4b-2aa9-4d52-8d45-0a7387615248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13b4892a074e48829c3342757be14eb6'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:44.558307 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-69736f4b-2aa9-4d52-8d45-0a7387615248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13b4892a074e48829c3342757be14eb6'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:44.567398 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-69736f4b-2aa9-4d52-8d45-0a7387615248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13b4892a074e48829c3342757be14eb6'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:44.583486 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 865/1740] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:05:44 2021] DELETE /identity/v3/users/13b4892a074e48829c3342757be14eb6 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:05:44.588324 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3354d-1d54-49c0-8e2e-9eedab453853 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:44.588683 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3354d-1d54-49c0-8e2e-9eedab453853 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:44.589637 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3354d-1d54-49c0-8e2e-9eedab453853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:44.640854 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-5dc3354d-1d54-49c0-8e2e-9eedab453853 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:44.642219 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-5dc3354d-1d54-49c0-8e2e-9eedab453853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:44.689384 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322803ec-2267-4a65-bf4c-c34b83416cd4 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:44.786623 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 866/1741] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:44.794201 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3354d-1d54-49c0-8e2e-9eedab453853 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:44.796021 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-5dc3354d-1d54-49c0-8e2e-9eedab453853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:44.954173 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292eda97-a51d-4851-b605-ccafb8f13de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:44.955592 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292eda97-a51d-4851-b605-ccafb8f13de7 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:44.956188 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292eda97-a51d-4851-b605-ccafb8f13de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:44.956788 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292eda97-a51d-4851-b605-ccafb8f13de7 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:44.958089 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292eda97-a51d-4851-b605-ccafb8f13de7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:45.009048 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3354d-1d54-49c0-8e2e-9eedab453853 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:45.024002 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647297e-b88d-44f6-8783-6d36e2829535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:45.024828 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647297e-b88d-44f6-8783-6d36e2829535 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:45.025201 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647297e-b88d-44f6-8783-6d36e2829535 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:45.025615 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647297e-b88d-44f6-8783-6d36e2829535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:45.052908 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647297e-b88d-44f6-8783-6d36e2829535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:45.072221 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292eda97-a51d-4851-b605-ccafb8f13de7 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:45.085434 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2647297e-b88d-44f6-8783-6d36e2829535 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:45.112016 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 867/1742] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:44 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:05:45.121018 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 876/1743] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:05:44 2021] POST /identity/v3/users => generated 278 bytes in 605 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:45.125630 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647297e-b88d-44f6-8783-6d36e2829535 service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:45.127695 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-2647297e-b88d-44f6-8783-6d36e2829535 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:45.150297 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647297e-b88d-44f6-8783-6d36e2829535 service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:45.162772 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a359b0-684e-4f2a-8080-3251399aa519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:45.163807 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a359b0-684e-4f2a-8080-3251399aa519 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:45.164269 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a359b0-684e-4f2a-8080-3251399aa519 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:45.164528 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a359b0-684e-4f2a-8080-3251399aa519 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:45.165310 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a359b0-684e-4f2a-8080-3251399aa519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:45.246498 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a359b0-684e-4f2a-8080-3251399aa519 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:45.288038 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292eda97-a51d-4851-b605-ccafb8f13de7 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:45.288365 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 868/1744] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:45 2021] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:45.335752 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292eda97-a51d-4851-b605-ccafb8f13de7 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:45.355078 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23736e2-94d1-4873-afd5-302c92909351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:45.356674 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23736e2-94d1-4873-afd5-302c92909351 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:45.357136 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23736e2-94d1-4873-afd5-302c92909351 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:45.359825 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23736e2-94d1-4873-afd5-302c92909351 admin admin] PATH_INFO: `/v3/projects/43ae0b5b9d22478ba661b0c31e118231/users/86a5c5a45e2c4eed86b014d8a7d4c25b/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:45.445404 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23736e2-94d1-4873-afd5-302c92909351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43ae0b5b9d22478ba661b0c31e118231, user_id=86a5c5a45e2c4eed86b014d8a7d4c25b, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:45.553108 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23736e2-94d1-4873-afd5-302c92909351 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:45.584610 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 877/1745] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:45 2021] PUT /identity/v3/projects/43ae0b5b9d22478ba661b0c31e118231/users/86a5c5a45e2c4eed86b014d8a7d4c25b/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:05:45.597636 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99280a5e-9f20-4230-9ac2-986cd8fb3c6b None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:45.598048 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99280a5e-9f20-4230-9ac2-986cd8fb3c6b None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:45.598429 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99280a5e-9f20-4230-9ac2-986cd8fb3c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:45.644252 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-99280a5e-9f20-4230-9ac2-986cd8fb3c6b None None] MFA Rules not processed for user `86a5c5a45e2c4eed86b014d8a7d4c25b`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:45.645595 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-99280a5e-9f20-4230-9ac2-986cd8fb3c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:45.747852 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 869/1746] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:45 2021] POST /identity/v3/auth/tokens => generated 3662 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:45.748737 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23736e2-94d1-4873-afd5-302c92909351 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:45.966276 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23736e2-94d1-4873-afd5-302c92909351 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:45.984033 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec4581-cd91-417b-a646-92b2b3895bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:45.984835 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec4581-cd91-417b-a646-92b2b3895bac admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:45.985275 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec4581-cd91-417b-a646-92b2b3895bac admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:45.985850 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ec4581-cd91-417b-a646-92b2b3895bac admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:45.987029 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec4581-cd91-417b-a646-92b2b3895bac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:46.058338 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ec4581-cd91-417b-a646-92b2b3895bac admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:46.114415 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 878/1747] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:05:45 2021] POST /identity/v3/projects => generated 355 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:05:46.115920 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99280a5e-9f20-4230-9ac2-986cd8fb3c6b None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:46.129637 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99280a5e-9f20-4230-9ac2-986cd8fb3c6b None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:46.284650 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02178337-158b-4cac-a8b8-762a8c6d203d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:46.285945 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02178337-158b-4cac-a8b8-762a8c6d203d admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:46.286441 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02178337-158b-4cac-a8b8-762a8c6d203d admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:46.286921 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02178337-158b-4cac-a8b8-762a8c6d203d admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:46.287807 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02178337-158b-4cac-a8b8-762a8c6d203d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:46.334034 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02178337-158b-4cac-a8b8-762a8c6d203d admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:46.398794 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 870/1748] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:05:46 2021] POST /identity/v3/users => generated 284 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:46.408433 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec4581-cd91-417b-a646-92b2b3895bac admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:46.438529 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ec4581-cd91-417b-a646-92b2b3895bac admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:46.459261 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee0511-6f36-4e9c-b56b-5d28911e28d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:46.460578 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee0511-6f36-4e9c-b56b-5d28911e28d8 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:46.460979 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee0511-6f36-4e9c-b56b-5d28911e28d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:46.461364 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee0511-6f36-4e9c-b56b-5d28911e28d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:46.462334 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee0511-6f36-4e9c-b56b-5d28911e28d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:46.539494 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee0511-6f36-4e9c-b56b-5d28911e28d8 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:46.554148 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 879/1749] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:46 2021] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:46.559343 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02178337-158b-4cac-a8b8-762a8c6d203d admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:46.574074 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02178337-158b-4cac-a8b8-762a8c6d203d admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:46.587741 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee0511-6f36-4e9c-b56b-5d28911e28d8 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:46.589311 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c62f8-65bc-4711-89be-05ea3edbbc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:46.590164 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-76ee0511-6f36-4e9c-b56b-5d28911e28d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:46.590271 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c62f8-65bc-4711-89be-05ea3edbbc42 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:46.590511 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c62f8-65bc-4711-89be-05ea3edbbc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:46.590796 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c62f8-65bc-4711-89be-05ea3edbbc42 admin admin] PATH_INFO: `/v3/projects/5bd4754caa5f43cf8595ba3fb17d6386/users/768b6c3e9faa49c7ae2aa2fe1c1aeb73/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:46.609623 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee0511-6f36-4e9c-b56b-5d28911e28d8 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:46.615608 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d6171-fc29-4d5f-af04-cb3142320484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:46.616697 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d6171-fc29-4d5f-af04-cb3142320484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:46.617194 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d6171-fc29-4d5f-af04-cb3142320484 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:46.617674 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d6171-fc29-4d5f-af04-cb3142320484 admin admin] PATH_INFO: `/v3/projects/e8efe1044e564cda9cc3575dee988110` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:46.619109 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d6171-fc29-4d5f-af04-cb3142320484 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8efe1044e564cda9cc3575dee988110)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:46.627417 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c62f8-65bc-4711-89be-05ea3edbbc42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bd4754caa5f43cf8595ba3fb17d6386, user_id=768b6c3e9faa49c7ae2aa2fe1c1aeb73, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:46.654862 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d6171-fc29-4d5f-af04-cb3142320484 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:46.657342 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c62f8-65bc-4711-89be-05ea3edbbc42 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:46.676518 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 871/1750] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:46 2021] PUT /identity/v3/projects/5bd4754caa5f43cf8595ba3fb17d6386/users/768b6c3e9faa49c7ae2aa2fe1c1aeb73/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:46.680679 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c62f8-65bc-4711-89be-05ea3edbbc42 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:46.725445 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-bb5d6171-fc29-4d5f-af04-cb3142320484 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8efe1044e564cda9cc3575dee988110', 'request_id': 'req-bb5d6171-fc29-4d5f-af04-cb3142320484'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:46.732613 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-bb5d6171-fc29-4d5f-af04-cb3142320484 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8efe1044e564cda9cc3575dee988110', 'request_id': 'req-bb5d6171-fc29-4d5f-af04-cb3142320484'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:46.744315 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-bb5d6171-fc29-4d5f-af04-cb3142320484 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8efe1044e564cda9cc3575dee988110', 'request_id': 'req-bb5d6171-fc29-4d5f-af04-cb3142320484'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:46.760242 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-bb5d6171-fc29-4d5f-af04-cb3142320484 admin admin] The token cache is being invalidate because project e8efe1044e564cda9cc3575dee988110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:05:46.760955 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-bb5d6171-fc29-4d5f-af04-cb3142320484 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:46.761961 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-bb5d6171-fc29-4d5f-af04-cb3142320484 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:46.766620 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c62f8-65bc-4711-89be-05ea3edbbc42 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:46.767527 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 880/1751] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:05:46 2021] DELETE /identity/v3/projects/e8efe1044e564cda9cc3575dee988110 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:05:46.770448 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e2760-6d81-45e9-80a2-1cbff0ff05c2 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:46.770740 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e2760-6d81-45e9-80a2-1cbff0ff05c2 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:46.771021 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e2760-6d81-45e9-80a2-1cbff0ff05c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:46.796518 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-553e2760-6d81-45e9-80a2-1cbff0ff05c2 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:46.797688 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-553e2760-6d81-45e9-80a2-1cbff0ff05c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:46.861002 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cd3cf-8c99-4954-9e11-85aaa67de394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:46.861534 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cd3cf-8c99-4954-9e11-85aaa67de394 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:46.861870 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cd3cf-8c99-4954-9e11-85aaa67de394 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:46.862259 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cd3cf-8c99-4954-9e11-85aaa67de394 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:46.863061 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cd3cf-8c99-4954-9e11-85aaa67de394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:46.889387 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cd3cf-8c99-4954-9e11-85aaa67de394 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:46.901768 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 881/1752] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:05:46.904190 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdc098-97c4-43b4-b091-568f8fc0f14f None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:46.905292 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdc098-97c4-43b4-b091-568f8fc0f14f None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:46.905768 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcdc098-97c4-43b4-b091-568f8fc0f14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:46.910505 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 872/1753] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:46 2021] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:46.914672 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cd3cf-8c99-4954-9e11-85aaa67de394 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:46.916759 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-b14cd3cf-8c99-4954-9e11-85aaa67de394 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:46.932824 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cd3cf-8c99-4954-9e11-85aaa67de394 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:46.938067 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80777e8-6574-4d85-8b53-1909e3df33a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:46.938892 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80777e8-6574-4d85-8b53-1909e3df33a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:46.939406 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80777e8-6574-4d85-8b53-1909e3df33a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:46.939741 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80777e8-6574-4d85-8b53-1909e3df33a9 admin admin] PATH_INFO: `/v3/projects/5bd4754caa5f43cf8595ba3fb17d6386/users/768b6c3e9faa49c7ae2aa2fe1c1aeb73/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:46.941573 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80777e8-6574-4d85-8b53-1909e3df33a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bd4754caa5f43cf8595ba3fb17d6386, user_id=768b6c3e9faa49c7ae2aa2fe1c1aeb73, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:46.943414 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-1fcdc098-97c4-43b4-b091-568f8fc0f14f None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:46.944942 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-1fcdc098-97c4-43b4-b091-568f8fc0f14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:46.954330 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 882/1754] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:46 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:46.958842 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcdc098-97c4-43b4-b091-568f8fc0f14f None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:46.971728 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcdc098-97c4-43b4-b091-568f8fc0f14f None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:46.978944 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59395500-4139-4263-aa4d-410303ff95e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:46.980585 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59395500-4139-4263-aa4d-410303ff95e1 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:46.981688 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59395500-4139-4263-aa4d-410303ff95e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:46.982070 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59395500-4139-4263-aa4d-410303ff95e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:46.983073 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59395500-4139-4263-aa4d-410303ff95e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:05:46.983586 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59395500-4139-4263-aa4d-410303ff95e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:46.992403 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80777e8-6574-4d85-8b53-1909e3df33a9 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:47.016191 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59395500-4139-4263-aa4d-410303ff95e1 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:47.017950 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 873/1755] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:46 2021] PUT /identity/v3/projects/5bd4754caa5f43cf8595ba3fb17d6386/users/768b6c3e9faa49c7ae2aa2fe1c1aeb73/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:47.021663 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80777e8-6574-4d85-8b53-1909e3df33a9 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:47.035508 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 883/1756] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:05:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 15:05:47.039484 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59395500-4139-4263-aa4d-410303ff95e1 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:47.050926 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59395500-4139-4263-aa4d-410303ff95e1 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:47.121171 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80777e8-6574-4d85-8b53-1909e3df33a9 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:47.121171 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf2b46-39d5-45a9-87a8-57c41ce01748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:47.121171 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf2b46-39d5-45a9-87a8-57c41ce01748 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:47.121171 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf2b46-39d5-45a9-87a8-57c41ce01748 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:47.121881 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf2b46-39d5-45a9-87a8-57c41ce01748 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:47.121881 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf2b46-39d5-45a9-87a8-57c41ce01748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:47.130931 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18192fac-59d3-40d2-bc4f-f969b5e5525c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:47.131906 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18192fac-59d3-40d2-bc4f-f969b5e5525c admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:47.132302 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18192fac-59d3-40d2-bc4f-f969b5e5525c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:47.132678 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18192fac-59d3-40d2-bc4f-f969b5e5525c admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:47.133424 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18192fac-59d3-40d2-bc4f-f969b5e5525c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:47.146984 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf2b46-39d5-45a9-87a8-57c41ce01748 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:47.159760 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 874/1757] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:47 2021] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:05:47.160964 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18192fac-59d3-40d2-bc4f-f969b5e5525c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:47.163676 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf2b46-39d5-45a9-87a8-57c41ce01748 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:47.173499 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf2b46-39d5-45a9-87a8-57c41ce01748 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:47.179010 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262118d-5e70-4400-8101-168defc5bb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:47.180179 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262118d-5e70-4400-8101-168defc5bb5b admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:47.180452 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262118d-5e70-4400-8101-168defc5bb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:47.180762 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262118d-5e70-4400-8101-168defc5bb5b admin admin] PATH_INFO: `/v3/projects/5bd4754caa5f43cf8595ba3fb17d6386/users/768b6c3e9faa49c7ae2aa2fe1c1aeb73/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:47.182711 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262118d-5e70-4400-8101-168defc5bb5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bd4754caa5f43cf8595ba3fb17d6386, user_id=768b6c3e9faa49c7ae2aa2fe1c1aeb73, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:47.191934 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 884/1758] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:05:47 2021] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:47.196173 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18192fac-59d3-40d2-bc4f-f969b5e5525c admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:47.214830 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262118d-5e70-4400-8101-168defc5bb5b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:47.239514 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 875/1759] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:47 2021] PUT /identity/v3/projects/5bd4754caa5f43cf8595ba3fb17d6386/users/768b6c3e9faa49c7ae2aa2fe1c1aeb73/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:47.241052 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19e364-af9e-4e85-865a-d8cad2493df1 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:47.241345 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19e364-af9e-4e85-865a-d8cad2493df1 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:47.241625 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19e364-af9e-4e85-865a-d8cad2493df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:47.289345 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18192fac-59d3-40d2-bc4f-f969b5e5525c admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:47.299991 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-cc19e364-af9e-4e85-865a-d8cad2493df1 None None] MFA Rules not processed for user `768b6c3e9faa49c7ae2aa2fe1c1aeb73`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:47.301158 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-cc19e364-af9e-4e85-865a-d8cad2493df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:47.363356 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30248bdd-1724-482d-9524-f54b2635c24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:47.363755 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30248bdd-1724-482d-9524-f54b2635c24f admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:47.363997 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30248bdd-1724-482d-9524-f54b2635c24f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:47.364278 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30248bdd-1724-482d-9524-f54b2635c24f admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:47.364921 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30248bdd-1724-482d-9524-f54b2635c24f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:47.391580 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30248bdd-1724-482d-9524-f54b2635c24f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:47.395408 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 876/1760] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:47 2021] POST /identity/v3/auth/tokens => generated 3729 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:05:47.406891 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19e364-af9e-4e85-865a-d8cad2493df1 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:47.408559 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-cc19e364-af9e-4e85-865a-d8cad2493df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:47.418221 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 885/1761] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:05:47 2021] POST /identity/v3/users => generated 294 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:47.422663 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30248bdd-1724-482d-9524-f54b2635c24f admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:47.433335 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30248bdd-1724-482d-9524-f54b2635c24f admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:47.438782 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da86b64-5d05-404a-bf9f-4656ef1b9c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:47.439501 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da86b64-5d05-404a-bf9f-4656ef1b9c67 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:47.440020 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da86b64-5d05-404a-bf9f-4656ef1b9c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:47.440390 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da86b64-5d05-404a-bf9f-4656ef1b9c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:47.441168 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da86b64-5d05-404a-bf9f-4656ef1b9c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:47.468917 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da86b64-5d05-404a-bf9f-4656ef1b9c67 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:47.480856 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 886/1762] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:47 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:05:47.485564 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da86b64-5d05-404a-bf9f-4656ef1b9c67 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:47.497942 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da86b64-5d05-404a-bf9f-4656ef1b9c67 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:47.503169 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd72e42-c98c-471d-a94f-e52058423da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:47.504914 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd72e42-c98c-471d-a94f-e52058423da3 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:47.504914 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd72e42-c98c-471d-a94f-e52058423da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:47.504914 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd72e42-c98c-471d-a94f-e52058423da3 admin admin] PATH_INFO: `/v3/projects/3e62a2e7c677432ba4bf562c97f205d1/users/9dcc5981e44146b9befca946218f3df9/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:47.515946 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19e364-af9e-4e85-865a-d8cad2493df1 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:47.521555 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96cc3de-3104-4ea8-ba92-87e6764dab89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:47.522942 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96cc3de-3104-4ea8-ba92-87e6764dab89 service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:47.523381 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96cc3de-3104-4ea8-ba92-87e6764dab89 service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:47.523719 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96cc3de-3104-4ea8-ba92-87e6764dab89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:47.532440 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd72e42-c98c-471d-a94f-e52058423da3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e62a2e7c677432ba4bf562c97f205d1, user_id=9dcc5981e44146b9befca946218f3df9, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:47.535967 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96cc3de-3104-4ea8-ba92-87e6764dab89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:47.562999 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96cc3de-3104-4ea8-ba92-87e6764dab89 service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:47.567683 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd72e42-c98c-471d-a94f-e52058423da3 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:47.575016 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 877/1763] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:47 2021] GET /identity/v3/auth/tokens => generated 3729 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:47.605150 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 887/1764] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:47 2021] PUT /identity/v3/projects/3e62a2e7c677432ba4bf562c97f205d1/users/9dcc5981e44146b9befca946218f3df9/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:47.665473 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26993b26-aa55-4fcc-b26b-40e28661e1f4 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:47.665821 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26993b26-aa55-4fcc-b26b-40e28661e1f4 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:47.666244 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26993b26-aa55-4fcc-b26b-40e28661e1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:47.748140 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-26993b26-aa55-4fcc-b26b-40e28661e1f4 None None] MFA Rules not processed for user `9dcc5981e44146b9befca946218f3df9`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:47.749558 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-26993b26-aa55-4fcc-b26b-40e28661e1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:47.754281 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd72e42-c98c-471d-a94f-e52058423da3 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:47.833710 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd72e42-c98c-471d-a94f-e52058423da3 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:47.837670 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eaac35-9e8e-4179-91b9-7a194ab6a0b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:47.838265 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eaac35-9e8e-4179-91b9-7a194ab6a0b6 service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:47.838551 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eaac35-9e8e-4179-91b9-7a194ab6a0b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:47.839095 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eaac35-9e8e-4179-91b9-7a194ab6a0b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:47.841332 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-e2eaac35-9e8e-4179-91b9-7a194ab6a0b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:47.849342 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 878/1765] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:47 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:47.854030 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26993b26-aa55-4fcc-b26b-40e28661e1f4 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:47.947967 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26993b26-aa55-4fcc-b26b-40e28661e1f4 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:47.949615 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eaac35-9e8e-4179-91b9-7a194ab6a0b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:47.953633 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d17536-72db-493e-8fa0-5b1741fb8faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:47.954356 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d17536-72db-493e-8fa0-5b1741fb8faa admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:47.954602 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d17536-72db-493e-8fa0-5b1741fb8faa admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:47.955077 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d17536-72db-493e-8fa0-5b1741fb8faa admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:47.955583 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d17536-72db-493e-8fa0-5b1741fb8faa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:47.982677 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d17536-72db-493e-8fa0-5b1741fb8faa admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:47.983204 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eaac35-9e8e-4179-91b9-7a194ab6a0b6 service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:47.993134 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 888/1766] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:47 2021] GET /identity/v3/auth/tokens => generated 3662 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:05:48.013957 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 879/1767] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:05:47 2021] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:48.018636 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eaac35-9e8e-4179-91b9-7a194ab6a0b6 service cinder] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:48.028910 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eaac35-9e8e-4179-91b9-7a194ab6a0b6 service cinder] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:48.121628 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c011a6-d664-4a2b-93fb-6bfba0d8757e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:48.123632 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c011a6-d664-4a2b-93fb-6bfba0d8757e admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:48.123632 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c011a6-d664-4a2b-93fb-6bfba0d8757e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:48.123632 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c011a6-d664-4a2b-93fb-6bfba0d8757e admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:48.123632 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c011a6-d664-4a2b-93fb-6bfba0d8757e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:48.150398 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c011a6-d664-4a2b-93fb-6bfba0d8757e admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:48.183564 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 889/1768] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:05:48 2021] POST /identity/v3/users => generated 299 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:48.186810 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d17536-72db-493e-8fa0-5b1741fb8faa admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:48.200246 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d17536-72db-493e-8fa0-5b1741fb8faa admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:48.207395 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9660f3-4b84-4553-b856-98a83d21fdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:48.208723 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9660f3-4b84-4553-b856-98a83d21fdca admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:48.209343 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9660f3-4b84-4553-b856-98a83d21fdca admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:48.209856 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9660f3-4b84-4553-b856-98a83d21fdca admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:48.210804 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9660f3-4b84-4553-b856-98a83d21fdca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:48.263074 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9660f3-4b84-4553-b856-98a83d21fdca admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:48.276117 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 880/1769] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:48 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:05:48.284418 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c011a6-d664-4a2b-93fb-6bfba0d8757e admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:48.297428 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c011a6-d664-4a2b-93fb-6bfba0d8757e admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:48.309713 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60edda-77bb-4556-8312-62bf22ebb906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:48.310609 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60edda-77bb-4556-8312-62bf22ebb906 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:48.310860 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60edda-77bb-4556-8312-62bf22ebb906 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:48.311135 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60edda-77bb-4556-8312-62bf22ebb906 admin admin] PATH_INFO: `/v3/projects/e6fd043f8afa4ffd9fa4287ef2e021ef/users/bd5226ba20b841a683a5565254a57dea/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:48.335679 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60edda-77bb-4556-8312-62bf22ebb906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6fd043f8afa4ffd9fa4287ef2e021ef, user_id=bd5226ba20b841a683a5565254a57dea, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:48.362959 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60edda-77bb-4556-8312-62bf22ebb906 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:48.376045 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 890/1770] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:48 2021] PUT /identity/v3/projects/e6fd043f8afa4ffd9fa4287ef2e021ef/users/bd5226ba20b841a683a5565254a57dea/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:05:48.380037 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9660f3-4b84-4553-b856-98a83d21fdca admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:48.390120 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9660f3-4b84-4553-b856-98a83d21fdca admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:48.452404 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c20e50-32cf-46c5-87c1-d1a92aeb79e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:48.453006 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c20e50-32cf-46c5-87c1-d1a92aeb79e0 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:48.453289 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c20e50-32cf-46c5-87c1-d1a92aeb79e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:48.453565 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c20e50-32cf-46c5-87c1-d1a92aeb79e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:48.454261 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c20e50-32cf-46c5-87c1-d1a92aeb79e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:48.479421 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c20e50-32cf-46c5-87c1-d1a92aeb79e0 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:48.490193 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 881/1771] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:48 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:48.494392 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60edda-77bb-4556-8312-62bf22ebb906 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:48.504383 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60edda-77bb-4556-8312-62bf22ebb906 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:48.508696 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d06e17-68c5-48a9-a354-2f6d1cf9b960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:48.509537 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d06e17-68c5-48a9-a354-2f6d1cf9b960 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:48.509829 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d06e17-68c5-48a9-a354-2f6d1cf9b960 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:48.510112 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d06e17-68c5-48a9-a354-2f6d1cf9b960 admin admin] PATH_INFO: `/v3/projects/e6fd043f8afa4ffd9fa4287ef2e021ef/users/bd5226ba20b841a683a5565254a57dea/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:48.512471 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d06e17-68c5-48a9-a354-2f6d1cf9b960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6fd043f8afa4ffd9fa4287ef2e021ef, user_id=bd5226ba20b841a683a5565254a57dea, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:48.540461 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d06e17-68c5-48a9-a354-2f6d1cf9b960 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:48.551660 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 891/1772] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:48 2021] PUT /identity/v3/projects/e6fd043f8afa4ffd9fa4287ef2e021ef/users/bd5226ba20b841a683a5565254a57dea/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:48.555759 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c20e50-32cf-46c5-87c1-d1a92aeb79e0 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:48.565436 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c20e50-32cf-46c5-87c1-d1a92aeb79e0 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:48.630478 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0998806-9742-43af-9036-866caf7e5e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:48.630999 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0998806-9742-43af-9036-866caf7e5e58 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:48.631280 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0998806-9742-43af-9036-866caf7e5e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:48.631584 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0998806-9742-43af-9036-866caf7e5e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:48.632277 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0998806-9742-43af-9036-866caf7e5e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:48.658841 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0998806-9742-43af-9036-866caf7e5e58 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:48.669400 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 882/1773] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:48 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:48.673715 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d06e17-68c5-48a9-a354-2f6d1cf9b960 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:48.683758 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d06e17-68c5-48a9-a354-2f6d1cf9b960 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:48.688076 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3f4e1-1423-4664-ab90-3543afb74a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:48.688893 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3f4e1-1423-4664-ab90-3543afb74a57 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:48.689179 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3f4e1-1423-4664-ab90-3543afb74a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:48.689457 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3f4e1-1423-4664-ab90-3543afb74a57 admin admin] PATH_INFO: `/v3/projects/e6fd043f8afa4ffd9fa4287ef2e021ef/users/bd5226ba20b841a683a5565254a57dea/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:48.691255 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da3f4e1-1423-4664-ab90-3543afb74a57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6fd043f8afa4ffd9fa4287ef2e021ef, user_id=bd5226ba20b841a683a5565254a57dea, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:48.718614 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da3f4e1-1423-4664-ab90-3543afb74a57 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:48.734971 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 892/1774] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:48 2021] PUT /identity/v3/projects/e6fd043f8afa4ffd9fa4287ef2e021ef/users/bd5226ba20b841a683a5565254a57dea/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:48.745093 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c4d54-4cd7-44a4-87ff-e2c98cf400f2 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:48.745463 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c4d54-4cd7-44a4-87ff-e2c98cf400f2 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:48.745747 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c4d54-4cd7-44a4-87ff-e2c98cf400f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:48.786024 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-2c5c4d54-4cd7-44a4-87ff-e2c98cf400f2 None None] MFA Rules not processed for user `bd5226ba20b841a683a5565254a57dea`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:48.787237 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-2c5c4d54-4cd7-44a4-87ff-e2c98cf400f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:48.868739 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 883/1775] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:48 2021] POST /identity/v3/auth/tokens => generated 3759 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:05:48.881106 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3f4e1-1423-4664-ab90-3543afb74a57 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:48.882646 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-6da3f4e1-1423-4664-ab90-3543afb74a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:48.945827 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3f4e1-1423-4664-ab90-3543afb74a57 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:48.949758 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a942893-243c-4bf8-bc57-1f27a5306aef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:48.950345 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a942893-243c-4bf8-bc57-1f27a5306aef service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:48.950635 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a942893-243c-4bf8-bc57-1f27a5306aef service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:48.950918 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a942893-243c-4bf8-bc57-1f27a5306aef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:48.959944 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a942893-243c-4bf8-bc57-1f27a5306aef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:48.984859 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a942893-243c-4bf8-bc57-1f27a5306aef service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:48.994853 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 893/1776] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:48 2021] GET /identity/v3/auth/tokens => generated 3759 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:49.188851 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c4d54-4cd7-44a4-87ff-e2c98cf400f2 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:49.341324 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c4d54-4cd7-44a4-87ff-e2c98cf400f2 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:49.351567 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842562f0-dec4-4af7-9dc9-429e342a34e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:49.353090 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842562f0-dec4-4af7-9dc9-429e342a34e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:49.353641 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842562f0-dec4-4af7-9dc9-429e342a34e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:49.354993 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842562f0-dec4-4af7-9dc9-429e342a34e4 admin admin] PATH_INFO: `/v3/users/9dcc5981e44146b9befca946218f3df9` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:49.357231 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842562f0-dec4-4af7-9dc9-429e342a34e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dcc5981e44146b9befca946218f3df9)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:49.448970 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842562f0-dec4-4af7-9dc9-429e342a34e4 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:49.596163 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-842562f0-dec4-4af7-9dc9-429e342a34e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dcc5981e44146b9befca946218f3df9'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:49.657678 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-842562f0-dec4-4af7-9dc9-429e342a34e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dcc5981e44146b9befca946218f3df9'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:49.659095 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-842562f0-dec4-4af7-9dc9-429e342a34e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dcc5981e44146b9befca946218f3df9'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:49.673788 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-842562f0-dec4-4af7-9dc9-429e342a34e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dcc5981e44146b9befca946218f3df9'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:49.691548 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-842562f0-dec4-4af7-9dc9-429e342a34e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dcc5981e44146b9befca946218f3df9'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:49.706210 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 884/1777] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:05:49 2021] DELETE /identity/v3/users/9dcc5981e44146b9befca946218f3df9 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:49.712168 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9866a-a363-4913-ad80-3c6b1c7a9346 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:49.712729 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9866a-a363-4913-ad80-3c6b1c7a9346 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:49.713099 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9866a-a363-4913-ad80-3c6b1c7a9346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:49.774084 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-c6d9866a-a363-4913-ad80-3c6b1c7a9346 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:49.775651 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-c6d9866a-a363-4913-ad80-3c6b1c7a9346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:49.978105 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 894/1778] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:49 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:49.993215 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842562f0-dec4-4af7-9dc9-429e342a34e4 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:49.996081 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-842562f0-dec4-4af7-9dc9-429e342a34e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:50.160852 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842562f0-dec4-4af7-9dc9-429e342a34e4 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:50.164944 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140ecc3-5f04-489d-8517-ae0d133ce25a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:50.165534 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140ecc3-5f04-489d-8517-ae0d133ce25a service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:50.165859 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140ecc3-5f04-489d-8517-ae0d133ce25a service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:50.166097 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140ecc3-5f04-489d-8517-ae0d133ce25a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:50.183302 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140ecc3-5f04-489d-8517-ae0d133ce25a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:50.209994 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140ecc3-5f04-489d-8517-ae0d133ce25a service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:50.220461 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 885/1779] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:49 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:05:51.819052 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9866a-a363-4913-ad80-3c6b1c7a9346 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:51.820510 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-c6d9866a-a363-4913-ad80-3c6b1c7a9346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:51.857420 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9866a-a363-4913-ad80-3c6b1c7a9346 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:51.870116 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5e6bf-8e2a-41ac-9e9f-b3a7b7421fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:51.871247 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5e6bf-8e2a-41ac-9e9f-b3a7b7421fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:51.871717 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5e6bf-8e2a-41ac-9e9f-b3a7b7421fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:51.872118 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5e6bf-8e2a-41ac-9e9f-b3a7b7421fcd admin admin] PATH_INFO: `/v3/users/327902bba66747d98f0b27015396225b` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:51.875069 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d5e6bf-8e2a-41ac-9e9f-b3a7b7421fcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=327902bba66747d98f0b27015396225b)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:51.936312 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d5e6bf-8e2a-41ac-9e9f-b3a7b7421fcd admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:52.040869 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140ecc3-5f04-489d-8517-ae0d133ce25a service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:52.042466 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-e140ecc3-5f04-489d-8517-ae0d133ce25a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:52.071046 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140ecc3-5f04-489d-8517-ae0d133ce25a service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:52.100189 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c6bac-900f-40b0-871d-41223f5756c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:52.101581 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c6bac-900f-40b0-871d-41223f5756c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:52.102021 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c6bac-900f-40b0-871d-41223f5756c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:52.102355 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c6bac-900f-40b0-871d-41223f5756c2 admin admin] PATH_INFO: `/v3/projects/3e62a2e7c677432ba4bf562c97f205d1` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:52.104090 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c6bac-900f-40b0-871d-41223f5756c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e62a2e7c677432ba4bf562c97f205d1)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:52.117836 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-e3d5e6bf-8e2a-41ac-9e9f-b3a7b7421fcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '327902bba66747d98f0b27015396225b'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:52.119132 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-e3d5e6bf-8e2a-41ac-9e9f-b3a7b7421fcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '327902bba66747d98f0b27015396225b'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:52.155481 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-e3d5e6bf-8e2a-41ac-9e9f-b3a7b7421fcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '327902bba66747d98f0b27015396225b'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:52.183278 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c6bac-900f-40b0-871d-41223f5756c2 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:52.183502 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-e3d5e6bf-8e2a-41ac-9e9f-b3a7b7421fcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '327902bba66747d98f0b27015396225b'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:52.206868 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-e3d5e6bf-8e2a-41ac-9e9f-b3a7b7421fcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '327902bba66747d98f0b27015396225b'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:52.227419 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 895/1780] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:05:51 2021] DELETE /identity/v3/users/327902bba66747d98f0b27015396225b => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:05:52.230417 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d846d-f343-4516-b0c0-4816e7fcac8a None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:52.230763 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d846d-f343-4516-b0c0-4816e7fcac8a None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:52.231051 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d846d-f343-4516-b0c0-4816e7fcac8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:52.304263 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-7c7c6bac-900f-40b0-871d-41223f5756c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e62a2e7c677432ba4bf562c97f205d1', 'request_id': 'req-7c7c6bac-900f-40b0-871d-41223f5756c2'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:52.308721 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-b96d846d-f343-4516-b0c0-4816e7fcac8a None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:52.311932 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-7c7c6bac-900f-40b0-871d-41223f5756c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e62a2e7c677432ba4bf562c97f205d1', 'request_id': 'req-7c7c6bac-900f-40b0-871d-41223f5756c2'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:52.312136 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-b96d846d-f343-4516-b0c0-4816e7fcac8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:52.327715 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-7c7c6bac-900f-40b0-871d-41223f5756c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e62a2e7c677432ba4bf562c97f205d1', 'request_id': 'req-7c7c6bac-900f-40b0-871d-41223f5756c2'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:52.360802 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-7c7c6bac-900f-40b0-871d-41223f5756c2 admin admin] The token cache is being invalidate because project 3e62a2e7c677432ba4bf562c97f205d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:05:52.361351 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-7c7c6bac-900f-40b0-871d-41223f5756c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:52.362806 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-7c7c6bac-900f-40b0-871d-41223f5756c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:52.366162 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 886/1781] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:05:52 2021] DELETE /identity/v3/projects/3e62a2e7c677432ba4bf562c97f205d1 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:05:52.370940 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c6bac-900f-40b0-871d-41223f5756c2 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:52.375856 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-7c7c6bac-900f-40b0-871d-41223f5756c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:52.512235 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 896/1782] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:52 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:52.530514 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c6bac-900f-40b0-871d-41223f5756c2 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:52.544959 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf56298-29c2-4c1c-88cc-e1c87bd0d9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:52.546462 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf56298-29c2-4c1c-88cc-e1c87bd0d9c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:52.546462 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf56298-29c2-4c1c-88cc-e1c87bd0d9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:52.546462 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf56298-29c2-4c1c-88cc-e1c87bd0d9c6 admin admin] PATH_INFO: `/v3/users/bd5226ba20b841a683a5565254a57dea` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:52.548847 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf56298-29c2-4c1c-88cc-e1c87bd0d9c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd5226ba20b841a683a5565254a57dea)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:52.581881 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf56298-29c2-4c1c-88cc-e1c87bd0d9c6 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:52.647350 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-acf56298-29c2-4c1c-88cc-e1c87bd0d9c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd5226ba20b841a683a5565254a57dea'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:52.660126 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d846d-f343-4516-b0c0-4816e7fcac8a None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:52.661965 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-b96d846d-f343-4516-b0c0-4816e7fcac8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:52.666812 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-acf56298-29c2-4c1c-88cc-e1c87bd0d9c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd5226ba20b841a683a5565254a57dea'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:52.668552 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-acf56298-29c2-4c1c-88cc-e1c87bd0d9c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd5226ba20b841a683a5565254a57dea'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:52.680449 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-acf56298-29c2-4c1c-88cc-e1c87bd0d9c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd5226ba20b841a683a5565254a57dea'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:52.694181 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-acf56298-29c2-4c1c-88cc-e1c87bd0d9c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd5226ba20b841a683a5565254a57dea'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:52.708370 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 887/1783] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:05:52 2021] DELETE /identity/v3/users/bd5226ba20b841a683a5565254a57dea => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:52.822563 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d846d-f343-4516-b0c0-4816e7fcac8a None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:52.916392 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aab7fb-0233-4edc-8690-70135aea8692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:52.918275 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aab7fb-0233-4edc-8690-70135aea8692 service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:52.918758 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aab7fb-0233-4edc-8690-70135aea8692 service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:52.919228 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aab7fb-0233-4edc-8690-70135aea8692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:52.922705 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-21aab7fb-0233-4edc-8690-70135aea8692 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:53.038407 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aab7fb-0233-4edc-8690-70135aea8692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:53.071129 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aab7fb-0233-4edc-8690-70135aea8692 service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:53.082963 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 897/1784] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:52 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:53.636893 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf56298-29c2-4c1c-88cc-e1c87bd0d9c6 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:53.638439 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-acf56298-29c2-4c1c-88cc-e1c87bd0d9c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:53.654944 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf56298-29c2-4c1c-88cc-e1c87bd0d9c6 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:53.660256 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0c8f7-3cdc-462e-92ff-85fbf921615b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:53.661125 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0c8f7-3cdc-462e-92ff-85fbf921615b admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:53.661408 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0c8f7-3cdc-462e-92ff-85fbf921615b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:53.661879 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd0c8f7-3cdc-462e-92ff-85fbf921615b admin admin] PATH_INFO: `/v3/projects/742715a41e7146eda020d4773281249d` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:53.663029 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd0c8f7-3cdc-462e-92ff-85fbf921615b admin admin] RBAC: Authorizing `identity:delete_project(project_id=742715a41e7146eda020d4773281249d)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:53.690872 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd0c8f7-3cdc-462e-92ff-85fbf921615b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:53.752596 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-ebd0c8f7-3cdc-462e-92ff-85fbf921615b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '742715a41e7146eda020d4773281249d', 'request_id': 'req-ebd0c8f7-3cdc-462e-92ff-85fbf921615b'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:53.757819 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-ebd0c8f7-3cdc-462e-92ff-85fbf921615b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '742715a41e7146eda020d4773281249d', 'request_id': 'req-ebd0c8f7-3cdc-462e-92ff-85fbf921615b'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:53.769666 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-ebd0c8f7-3cdc-462e-92ff-85fbf921615b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '742715a41e7146eda020d4773281249d', 'request_id': 'req-ebd0c8f7-3cdc-462e-92ff-85fbf921615b'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:53.785100 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-ebd0c8f7-3cdc-462e-92ff-85fbf921615b admin admin] The token cache is being invalidate because project 742715a41e7146eda020d4773281249d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:05:53.785586 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-ebd0c8f7-3cdc-462e-92ff-85fbf921615b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:53.787138 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-ebd0c8f7-3cdc-462e-92ff-85fbf921615b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:53.789074 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 888/1785] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:05:53 2021] DELETE /identity/v3/projects/742715a41e7146eda020d4773281249d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:53.794011 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aab7fb-0233-4edc-8690-70135aea8692 service neutron] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:53.805841 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aab7fb-0233-4edc-8690-70135aea8692 service neutron] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:53.908050 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd26a86-2669-4690-9be5-7eecbdc66aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:53.908870 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd26a86-2669-4690-9be5-7eecbdc66aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:53.909155 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd26a86-2669-4690-9be5-7eecbdc66aff admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:53.909429 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd26a86-2669-4690-9be5-7eecbdc66aff admin admin] PATH_INFO: `/v3/users/ed95b6eff4e44d9dbb561ff002018ecb` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:53.910729 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd26a86-2669-4690-9be5-7eecbdc66aff admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed95b6eff4e44d9dbb561ff002018ecb)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:53.940004 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd26a86-2669-4690-9be5-7eecbdc66aff admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:54.048326 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-0dd26a86-2669-4690-9be5-7eecbdc66aff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed95b6eff4e44d9dbb561ff002018ecb'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:54.049823 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-0dd26a86-2669-4690-9be5-7eecbdc66aff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed95b6eff4e44d9dbb561ff002018ecb'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:54.079818 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-0dd26a86-2669-4690-9be5-7eecbdc66aff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed95b6eff4e44d9dbb561ff002018ecb'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:54.094063 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-0dd26a86-2669-4690-9be5-7eecbdc66aff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed95b6eff4e44d9dbb561ff002018ecb'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:54.112832 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-0dd26a86-2669-4690-9be5-7eecbdc66aff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed95b6eff4e44d9dbb561ff002018ecb'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:54.128358 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 898/1786] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:05:53 2021] DELETE /identity/v3/users/ed95b6eff4e44d9dbb561ff002018ecb => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:54.259764 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0c8f7-3cdc-462e-92ff-85fbf921615b admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:54.261382 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-ebd0c8f7-3cdc-462e-92ff-85fbf921615b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:54.281719 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd0c8f7-3cdc-462e-92ff-85fbf921615b admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:54.406615 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5e5eb-b584-44de-bfc2-1d1b3a96d9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:54.407954 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5e5eb-b584-44de-bfc2-1d1b3a96d9e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:54.408201 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5e5eb-b584-44de-bfc2-1d1b3a96d9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:54.408477 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5e5eb-b584-44de-bfc2-1d1b3a96d9e8 admin admin] PATH_INFO: `/v3/users/a5245703d05a4efa9714da594f235668` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:54.410435 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5e5eb-b584-44de-bfc2-1d1b3a96d9e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5245703d05a4efa9714da594f235668)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:54.447060 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5e5eb-b584-44de-bfc2-1d1b3a96d9e8 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:54.520290 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-f6f5e5eb-b584-44de-bfc2-1d1b3a96d9e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5245703d05a4efa9714da594f235668'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:54.546464 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-f6f5e5eb-b584-44de-bfc2-1d1b3a96d9e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5245703d05a4efa9714da594f235668'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:54.547955 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-f6f5e5eb-b584-44de-bfc2-1d1b3a96d9e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5245703d05a4efa9714da594f235668'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:54.557598 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-f6f5e5eb-b584-44de-bfc2-1d1b3a96d9e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5245703d05a4efa9714da594f235668'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:54.569643 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-f6f5e5eb-b584-44de-bfc2-1d1b3a96d9e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5245703d05a4efa9714da594f235668'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:54.580587 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 889/1787] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:05:54 2021] DELETE /identity/v3/users/a5245703d05a4efa9714da594f235668 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:54.582255 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae451d5-9e64-4b89-b18e-b64b9acf602b None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:54.582552 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae451d5-9e64-4b89-b18e-b64b9acf602b None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:54.582837 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae451d5-9e64-4b89-b18e-b64b9acf602b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:54.615471 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-bae451d5-9e64-4b89-b18e-b64b9acf602b None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:54.617492 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-bae451d5-9e64-4b89-b18e-b64b9acf602b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:54.778312 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 899/1788] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:54.807385 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5e5eb-b584-44de-bfc2-1d1b3a96d9e8 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:54.809507 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-f6f5e5eb-b584-44de-bfc2-1d1b3a96d9e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:54.920530 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5e5eb-b584-44de-bfc2-1d1b3a96d9e8 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:54.925681 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf597f-240a-4231-b3ec-c447247c5e61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:54.926964 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf597f-240a-4231-b3ec-c447247c5e61 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:54.927658 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf597f-240a-4231-b3ec-c447247c5e61 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:54.928082 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf597f-240a-4231-b3ec-c447247c5e61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:54.943217 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf597f-240a-4231-b3ec-c447247c5e61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:54.978552 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf597f-240a-4231-b3ec-c447247c5e61 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:55.003220 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 890/1789] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:54 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:55.602124 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae451d5-9e64-4b89-b18e-b64b9acf602b None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:55.604952 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-bae451d5-9e64-4b89-b18e-b64b9acf602b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:55.628285 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae451d5-9e64-4b89-b18e-b64b9acf602b None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:55.636697 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f764bad-5d5f-490b-9e41-ec4a744e1608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:55.638001 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f764bad-5d5f-490b-9e41-ec4a744e1608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:55.638508 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f764bad-5d5f-490b-9e41-ec4a744e1608 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:55.638925 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f764bad-5d5f-490b-9e41-ec4a744e1608 admin admin] PATH_INFO: `/v3/projects/e6fd043f8afa4ffd9fa4287ef2e021ef` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:55.642096 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f764bad-5d5f-490b-9e41-ec4a744e1608 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6fd043f8afa4ffd9fa4287ef2e021ef)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:55.686211 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f764bad-5d5f-490b-9e41-ec4a744e1608 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:55.786957 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-1f764bad-5d5f-490b-9e41-ec4a744e1608 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6fd043f8afa4ffd9fa4287ef2e021ef', 'request_id': 'req-1f764bad-5d5f-490b-9e41-ec4a744e1608'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:55.795365 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf597f-240a-4231-b3ec-c447247c5e61 service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:55.796896 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-24bf597f-240a-4231-b3ec-c447247c5e61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:55.797353 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-1f764bad-5d5f-490b-9e41-ec4a744e1608 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6fd043f8afa4ffd9fa4287ef2e021ef', 'request_id': 'req-1f764bad-5d5f-490b-9e41-ec4a744e1608'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:55.816269 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf597f-240a-4231-b3ec-c447247c5e61 service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:55.824385 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-1f764bad-5d5f-490b-9e41-ec4a744e1608 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6fd043f8afa4ffd9fa4287ef2e021ef', 'request_id': 'req-1f764bad-5d5f-490b-9e41-ec4a744e1608'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:55.850214 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-1f764bad-5d5f-490b-9e41-ec4a744e1608 admin admin] The token cache is being invalidate because project e6fd043f8afa4ffd9fa4287ef2e021ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:05:55.851420 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-1f764bad-5d5f-490b-9e41-ec4a744e1608 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:55.853699 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-1f764bad-5d5f-490b-9e41-ec4a744e1608 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:55.863907 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 900/1790] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:05:55 2021] DELETE /identity/v3/projects/e6fd043f8afa4ffd9fa4287ef2e021ef => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:55.867249 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a64ff7-b53e-4b82-befb-e116815f9050 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:55.868300 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a64ff7-b53e-4b82-befb-e116815f9050 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:55.870082 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a64ff7-b53e-4b82-befb-e116815f9050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:55.915495 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-31a64ff7-b53e-4b82-befb-e116815f9050 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:55.918153 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-31a64ff7-b53e-4b82-befb-e116815f9050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:55.971759 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30a5b9-c0c9-484f-87d7-f2699e24cc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:55.972574 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30a5b9-c0c9-484f-87d7-f2699e24cc0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:55.972890 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30a5b9-c0c9-484f-87d7-f2699e24cc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:55.973138 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30a5b9-c0c9-484f-87d7-f2699e24cc0e admin admin] PATH_INFO: `/v3/projects/1fef6cc608224e13aedffe867d77187b` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:55.975408 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30a5b9-c0c9-484f-87d7-f2699e24cc0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fef6cc608224e13aedffe867d77187b)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:56.013767 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30a5b9-c0c9-484f-87d7-f2699e24cc0e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:56.105028 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-ab30a5b9-c0c9-484f-87d7-f2699e24cc0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fef6cc608224e13aedffe867d77187b', 'request_id': 'req-ab30a5b9-c0c9-484f-87d7-f2699e24cc0e'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:56.120320 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-ab30a5b9-c0c9-484f-87d7-f2699e24cc0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fef6cc608224e13aedffe867d77187b', 'request_id': 'req-ab30a5b9-c0c9-484f-87d7-f2699e24cc0e'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:56.129464 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 901/1791] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:55 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:56.131188 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c39153-bd1e-44a1-b996-0f5ff414a360 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:56.131810 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c39153-bd1e-44a1-b996-0f5ff414a360 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:56.132195 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c39153-bd1e-44a1-b996-0f5ff414a360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:56.163649 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-19c39153-bd1e-44a1-b996-0f5ff414a360 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:56.165077 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-19c39153-bd1e-44a1-b996-0f5ff414a360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:56.177359 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-ab30a5b9-c0c9-484f-87d7-f2699e24cc0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fef6cc608224e13aedffe867d77187b', 'request_id': 'req-ab30a5b9-c0c9-484f-87d7-f2699e24cc0e'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:56.210224 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-ab30a5b9-c0c9-484f-87d7-f2699e24cc0e admin admin] The token cache is being invalidate because project 1fef6cc608224e13aedffe867d77187b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:05:56.211597 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-ab30a5b9-c0c9-484f-87d7-f2699e24cc0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:56.230110 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-ab30a5b9-c0c9-484f-87d7-f2699e24cc0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:56.236576 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 891/1792] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:05:55 2021] DELETE /identity/v3/projects/1fef6cc608224e13aedffe867d77187b => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:05:56.245527 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec947f-0176-4f71-b5ce-47b77c3d1e67 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:56.246269 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec947f-0176-4f71-b5ce-47b77c3d1e67 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:56.246960 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec947f-0176-4f71-b5ce-47b77c3d1e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:56.285164 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 902/1793] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:56.291608 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c39153-bd1e-44a1-b996-0f5ff414a360 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:56.315529 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c39153-bd1e-44a1-b996-0f5ff414a360 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:56.316130 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-3cec947f-0176-4f71-b5ce-47b77c3d1e67 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:56.320577 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-3cec947f-0176-4f71-b5ce-47b77c3d1e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:56.330662 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef7e51-cbec-4c87-a4c1-2088d9b9803d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:56.332289 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef7e51-cbec-4c87-a4c1-2088d9b9803d admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:56.333027 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef7e51-cbec-4c87-a4c1-2088d9b9803d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:56.334650 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef7e51-cbec-4c87-a4c1-2088d9b9803d admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:56.336717 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ef7e51-cbec-4c87-a4c1-2088d9b9803d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:05:56.337324 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ef7e51-cbec-4c87-a4c1-2088d9b9803d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:56.348179 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 892/1794] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:56.349869 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30649f79-28cb-4ec5-a1d6-eb6473a403a0 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:56.350400 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30649f79-28cb-4ec5-a1d6-eb6473a403a0 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:56.350781 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30649f79-28cb-4ec5-a1d6-eb6473a403a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:56.401806 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-30649f79-28cb-4ec5-a1d6-eb6473a403a0 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:56.409050 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ef7e51-cbec-4c87-a4c1-2088d9b9803d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:56.414559 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-30649f79-28cb-4ec5-a1d6-eb6473a403a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:56.436996 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 893/1795] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:56.440672 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30649f79-28cb-4ec5-a1d6-eb6473a403a0 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:56.448045 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 903/1796] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:05:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:05:56.449167 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef7e51-cbec-4c87-a4c1-2088d9b9803d admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:56.462261 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef7e51-cbec-4c87-a4c1-2088d9b9803d admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:56.464878 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30649f79-28cb-4ec5-a1d6-eb6473a403a0 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:56.468039 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c99f5-a03d-49d9-9762-d9e7b703d6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:56.468657 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c99f5-a03d-49d9-9762-d9e7b703d6e1 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:56.468947 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c99f5-a03d-49d9-9762-d9e7b703d6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:56.469940 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c99f5-a03d-49d9-9762-d9e7b703d6e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:56.470181 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c99f5-a03d-49d9-9762-d9e7b703d6e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:56.482435 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfd639-6a2b-4209-8ba8-4b12d2b4813d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:56.483326 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfd639-6a2b-4209-8ba8-4b12d2b4813d admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:56.483798 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfd639-6a2b-4209-8ba8-4b12d2b4813d admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:56.484237 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfd639-6a2b-4209-8ba8-4b12d2b4813d admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:56.485080 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dfd639-6a2b-4209-8ba8-4b12d2b4813d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:05:56.485517 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dfd639-6a2b-4209-8ba8-4b12d2b4813d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:56.507982 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c99f5-a03d-49d9-9762-d9e7b703d6e1 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:56.529556 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dfd639-6a2b-4209-8ba8-4b12d2b4813d admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:56.554374 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 894/1797] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:05:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 15:05:56.559003 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfd639-6a2b-4209-8ba8-4b12d2b4813d admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:56.574532 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfd639-6a2b-4209-8ba8-4b12d2b4813d admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:56.584600 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8b459-5c76-4cc7-ac7e-78ba82b3ea7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:56.585489 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8b459-5c76-4cc7-ac7e-78ba82b3ea7c admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:56.585851 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8b459-5c76-4cc7-ac7e-78ba82b3ea7c admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:56.586198 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b8b459-5c76-4cc7-ac7e-78ba82b3ea7c admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:56.586937 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8b459-5c76-4cc7-ac7e-78ba82b3ea7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:56.596929 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 904/1798] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:05:56 2021] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:05:56.602352 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c99f5-a03d-49d9-9762-d9e7b703d6e1 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:56.633818 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b8b459-5c76-4cc7-ac7e-78ba82b3ea7c admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:56.693951 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 895/1799] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:05:56 2021] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:05:56.699871 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8b459-5c76-4cc7-ac7e-78ba82b3ea7c admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:56.801982 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c99f5-a03d-49d9-9762-d9e7b703d6e1 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:56.861434 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b8b459-5c76-4cc7-ac7e-78ba82b3ea7c admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:56.875150 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822c52d-183e-4df6-b808-25c1c2d315ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:56.876103 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822c52d-183e-4df6-b808-25c1c2d315ed admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:56.876683 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822c52d-183e-4df6-b808-25c1c2d315ed admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:56.877109 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822c52d-183e-4df6-b808-25c1c2d315ed admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:56.877907 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822c52d-183e-4df6-b808-25c1c2d315ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:56.939185 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822c52d-183e-4df6-b808-25c1c2d315ed admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:56.980945 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 896/1800] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:05:56 2021] POST /identity/v3/users => generated 287 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:57.002126 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822c52d-183e-4df6-b808-25c1c2d315ed admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:57.003154 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4d761-2afb-49fd-85f6-6705fe97557e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:57.003889 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4d761-2afb-49fd-85f6-6705fe97557e admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:57.004178 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4d761-2afb-49fd-85f6-6705fe97557e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:57.004458 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4d761-2afb-49fd-85f6-6705fe97557e admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:57.005886 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be4d761-2afb-49fd-85f6-6705fe97557e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:57.027607 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822c52d-183e-4df6-b808-25c1c2d315ed admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:57.039946 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbcdf1-6d1a-4496-97a0-51214de474c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:57.046855 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbcdf1-6d1a-4496-97a0-51214de474c8 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:57.051636 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbcdf1-6d1a-4496-97a0-51214de474c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:57.080597 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbcdf1-6d1a-4496-97a0-51214de474c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:57.084281 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cbcdf1-6d1a-4496-97a0-51214de474c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:57.123100 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be4d761-2afb-49fd-85f6-6705fe97557e admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:57.176661 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 905/1801] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:05:56 2021] POST /identity/v3/users => generated 291 bytes in 576 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:05:57.177496 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4d761-2afb-49fd-85f6-6705fe97557e admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:57.181358 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cbcdf1-6d1a-4496-97a0-51214de474c8 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:57.188314 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-2be4d761-2afb-49fd-85f6-6705fe97557e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:57.208452 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4d761-2afb-49fd-85f6-6705fe97557e admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:57.218720 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 897/1802] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:56 2021] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:57.223177 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbcdf1-6d1a-4496-97a0-51214de474c8 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:57.238041 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a2394-9fab-4aa9-9800-05eeaaa6590f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:57.238904 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a2394-9fab-4aa9-9800-05eeaaa6590f admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:57.239148 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a2394-9fab-4aa9-9800-05eeaaa6590f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:57.239426 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127a2394-9fab-4aa9-9800-05eeaaa6590f admin admin] PATH_INFO: `/v3/projects/8f6a68b253804daf9abf15e101ef3f9b` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:57.242088 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127a2394-9fab-4aa9-9800-05eeaaa6590f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f6a68b253804daf9abf15e101ef3f9b)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:57.252067 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbcdf1-6d1a-4496-97a0-51214de474c8 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:57.274712 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae0699-f668-4fb6-b7a8-3e9c0cb34fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:57.275327 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae0699-f668-4fb6-b7a8-3e9c0cb34fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:57.276558 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae0699-f668-4fb6-b7a8-3e9c0cb34fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:57.276558 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ae0699-f668-4fb6-b7a8-3e9c0cb34fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:57.277264 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae0699-f668-4fb6-b7a8-3e9c0cb34fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:57.321216 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127a2394-9fab-4aa9-9800-05eeaaa6590f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:57.361245 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ae0699-f668-4fb6-b7a8-3e9c0cb34fa8 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:57.402371 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 898/1803] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:57 2021] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:57.405647 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae0699-f668-4fb6-b7a8-3e9c0cb34fa8 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:57.426428 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-127a2394-9fab-4aa9-9800-05eeaaa6590f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f6a68b253804daf9abf15e101ef3f9b', 'request_id': 'req-127a2394-9fab-4aa9-9800-05eeaaa6590f'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:57.428004 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ae0699-f668-4fb6-b7a8-3e9c0cb34fa8 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:57.433315 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-127a2394-9fab-4aa9-9800-05eeaaa6590f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f6a68b253804daf9abf15e101ef3f9b', 'request_id': 'req-127a2394-9fab-4aa9-9800-05eeaaa6590f'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:57.458280 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-127a2394-9fab-4aa9-9800-05eeaaa6590f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f6a68b253804daf9abf15e101ef3f9b', 'request_id': 'req-127a2394-9fab-4aa9-9800-05eeaaa6590f'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:57.486894 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-127a2394-9fab-4aa9-9800-05eeaaa6590f admin admin] The token cache is being invalidate because project 8f6a68b253804daf9abf15e101ef3f9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:05:57.487264 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-127a2394-9fab-4aa9-9800-05eeaaa6590f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:57.495960 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-127a2394-9fab-4aa9-9800-05eeaaa6590f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:57.497857 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 906/1804] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:05:57 2021] DELETE /identity/v3/projects/8f6a68b253804daf9abf15e101ef3f9b => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:57.498787 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a2394-9fab-4aa9-9800-05eeaaa6590f admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:57.502562 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-127a2394-9fab-4aa9-9800-05eeaaa6590f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:57.572268 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918baf7-271f-40c8-bc8f-a1286d3284e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:57.573689 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918baf7-271f-40c8-bc8f-a1286d3284e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:57.573922 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918baf7-271f-40c8-bc8f-a1286d3284e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:57.574198 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918baf7-271f-40c8-bc8f-a1286d3284e7 admin admin] PATH_INFO: `/v3/projects/ab8e51a4f38941c297ce4c4610901b89/users/dab6c6e72dbf4b5fbfcc7321f51517bb/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:57.617008 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918baf7-271f-40c8-bc8f-a1286d3284e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab8e51a4f38941c297ce4c4610901b89, user_id=dab6c6e72dbf4b5fbfcc7321f51517bb, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:57.642517 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127a2394-9fab-4aa9-9800-05eeaaa6590f admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:57.660753 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb468c2-02e7-44d0-8dec-890bf0ea7a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:57.661389 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb468c2-02e7-44d0-8dec-890bf0ea7a8a admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:57.661604 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb468c2-02e7-44d0-8dec-890bf0ea7a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:57.661884 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb468c2-02e7-44d0-8dec-890bf0ea7a8a admin admin] PATH_INFO: `/v3/projects/3a02da69fa964b8caf6f485429457544/users/3623c9aa4de64a8684a3660fd6fe5f03/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:57.670504 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918baf7-271f-40c8-bc8f-a1286d3284e7 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:57.685750 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb468c2-02e7-44d0-8dec-890bf0ea7a8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a02da69fa964b8caf6f485429457544, user_id=3623c9aa4de64a8684a3660fd6fe5f03, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:57.698288 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 899/1805] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:57 2021] PUT /identity/v3/projects/ab8e51a4f38941c297ce4c4610901b89/users/dab6c6e72dbf4b5fbfcc7321f51517bb/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:57.708404 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918baf7-271f-40c8-bc8f-a1286d3284e7 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:57.716493 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-8918baf7-271f-40c8-bc8f-a1286d3284e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:57.746101 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb468c2-02e7-44d0-8dec-890bf0ea7a8a admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:57.789541 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 907/1806] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:57 2021] PUT /identity/v3/projects/3a02da69fa964b8caf6f485429457544/users/3623c9aa4de64a8684a3660fd6fe5f03/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:57.789541 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19f746-d5a3-4138-b1ee-fc5a098c4167 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:57.789541 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19f746-d5a3-4138-b1ee-fc5a098c4167 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:57.789541 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19f746-d5a3-4138-b1ee-fc5a098c4167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:57.870516 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-dd19f746-d5a3-4138-b1ee-fc5a098c4167 None None] MFA Rules not processed for user `dab6c6e72dbf4b5fbfcc7321f51517bb`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:57.871858 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-dd19f746-d5a3-4138-b1ee-fc5a098c4167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:57.884127 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918baf7-271f-40c8-bc8f-a1286d3284e7 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:57.960837 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 908/1807] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:57 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:57.962244 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d5405-2816-43d6-8a0f-934be240a58f None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:57.962634 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d5405-2816-43d6-8a0f-934be240a58f None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:57.963499 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d5405-2816-43d6-8a0f-934be240a58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:58.007493 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-6a4d5405-2816-43d6-8a0f-934be240a58f None None] MFA Rules not processed for user `3623c9aa4de64a8684a3660fd6fe5f03`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:58.008734 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-6a4d5405-2816-43d6-8a0f-934be240a58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:58.048435 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51624ce-fd02-4f80-accd-ebca4907cef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:58.049266 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51624ce-fd02-4f80-accd-ebca4907cef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:58.049549 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51624ce-fd02-4f80-accd-ebca4907cef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:58.049825 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51624ce-fd02-4f80-accd-ebca4907cef8 admin admin] PATH_INFO: `/v3/users/37eba2186add4d0db9685a5a30176757` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:58.060456 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51624ce-fd02-4f80-accd-ebca4907cef8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37eba2186add4d0db9685a5a30176757)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:58.099661 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51624ce-fd02-4f80-accd-ebca4907cef8 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:58.100540 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 909/1808] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:57 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:58.101503 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d5405-2816-43d6-8a0f-934be240a58f None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:58.106698 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-6a4d5405-2816-43d6-8a0f-934be240a58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:58.282606 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-e51624ce-fd02-4f80-accd-ebca4907cef8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37eba2186add4d0db9685a5a30176757'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:58.317399 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-e51624ce-fd02-4f80-accd-ebca4907cef8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37eba2186add4d0db9685a5a30176757'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:58.318317 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-e51624ce-fd02-4f80-accd-ebca4907cef8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37eba2186add4d0db9685a5a30176757'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:58.338124 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-e51624ce-fd02-4f80-accd-ebca4907cef8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37eba2186add4d0db9685a5a30176757'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:58.343201 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d5405-2816-43d6-8a0f-934be240a58f None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:58.347641 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdebd70-d9c4-4e03-9232-dff1ca006ce0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:58.348235 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdebd70-d9c4-4e03-9232-dff1ca006ce0 service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:58.348520 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdebd70-d9c4-4e03-9232-dff1ca006ce0 service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:58.348796 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdebd70-d9c4-4e03-9232-dff1ca006ce0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:58.351787 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-e51624ce-fd02-4f80-accd-ebca4907cef8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37eba2186add4d0db9685a5a30176757'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:58.353519 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-9cdebd70-d9c4-4e03-9232-dff1ca006ce0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:58.371016 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 900/1809] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:05:57 2021] DELETE /identity/v3/users/37eba2186add4d0db9685a5a30176757 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:58.372120 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51624ce-fd02-4f80-accd-ebca4907cef8 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:58.374617 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-e51624ce-fd02-4f80-accd-ebca4907cef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:58.376088 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdebd70-d9c4-4e03-9232-dff1ca006ce0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:58.429537 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdebd70-d9c4-4e03-9232-dff1ca006ce0 service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:58.442333 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 910/1810] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:58 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:58.467905 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdebd70-d9c4-4e03-9232-dff1ca006ce0 service cinder] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:58.469355 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-9cdebd70-d9c4-4e03-9232-dff1ca006ce0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:58.495374 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdebd70-d9c4-4e03-9232-dff1ca006ce0 service cinder] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:58.553613 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51624ce-fd02-4f80-accd-ebca4907cef8 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:58.560327 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d65ac-73d7-48d0-989c-5f0d02c11274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:58.561539 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d65ac-73d7-48d0-989c-5f0d02c11274 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:58.562066 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d65ac-73d7-48d0-989c-5f0d02c11274 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:58.562589 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d65ac-73d7-48d0-989c-5f0d02c11274 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:58.563480 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d65ac-73d7-48d0-989c-5f0d02c11274 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:58.639717 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d65ac-73d7-48d0-989c-5f0d02c11274 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:58.664254 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e792d7-800a-42fb-878f-f338a701b92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:58.667908 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e792d7-800a-42fb-878f-f338a701b92f admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:58.669459 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e792d7-800a-42fb-878f-f338a701b92f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:58.669802 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e792d7-800a-42fb-878f-f338a701b92f admin admin] PATH_INFO: `/v3/users/dab6c6e72dbf4b5fbfcc7321f51517bb` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:58.674221 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e792d7-800a-42fb-878f-f338a701b92f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dab6c6e72dbf4b5fbfcc7321f51517bb)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:58.719218 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 901/1811] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:05:58 2021] POST /identity/v3/projects => generated 379 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:58.725671 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d65ac-73d7-48d0-989c-5f0d02c11274 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:58.768359 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e792d7-800a-42fb-878f-f338a701b92f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:58.899949 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-87e792d7-800a-42fb-878f-f338a701b92f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dab6c6e72dbf4b5fbfcc7321f51517bb'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:58.911317 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-87e792d7-800a-42fb-878f-f338a701b92f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dab6c6e72dbf4b5fbfcc7321f51517bb'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:58.929784 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-87e792d7-800a-42fb-878f-f338a701b92f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dab6c6e72dbf4b5fbfcc7321f51517bb'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:58.936768 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d65ac-73d7-48d0-989c-5f0d02c11274 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:58.943146 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-87e792d7-800a-42fb-878f-f338a701b92f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dab6c6e72dbf4b5fbfcc7321f51517bb'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:58.947305 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34586563-7e52-420e-b1f2-5b8b63450568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:58.949201 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34586563-7e52-420e-b1f2-5b8b63450568 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:58.949499 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34586563-7e52-420e-b1f2-5b8b63450568 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:58.949784 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34586563-7e52-420e-b1f2-5b8b63450568 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:58.950444 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34586563-7e52-420e-b1f2-5b8b63450568 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:58.957852 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-87e792d7-800a-42fb-878f-f338a701b92f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dab6c6e72dbf4b5fbfcc7321f51517bb'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:05:58.972496 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 911/1812] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:05:58 2021] DELETE /identity/v3/users/dab6c6e72dbf4b5fbfcc7321f51517bb => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:05:58.977591 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212435c-493b-4acb-8645-94993c3ae9e1 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:58.977888 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212435c-493b-4acb-8645-94993c3ae9e1 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:58.978172 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212435c-493b-4acb-8645-94993c3ae9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:59.045061 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-0212435c-493b-4acb-8645-94993c3ae9e1 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:59.050907 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-0212435c-493b-4acb-8645-94993c3ae9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:59.053737 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34586563-7e52-420e-b1f2-5b8b63450568 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:59.129907 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 902/1813] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:05:58 2021] POST /identity/v3/users => generated 296 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:05:59.130181 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae311e-5ad3-4cbe-9a93-6fe5c4c0b663 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:59.130351 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae311e-5ad3-4cbe-9a93-6fe5c4c0b663 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:59.130647 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae311e-5ad3-4cbe-9a93-6fe5c4c0b663 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:59.132844 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 903/1814] 10.222.0.89 () {54 vars in 921 bytes} [Wed Oct 27 15:05:59 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:05:59.133643 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae311e-5ad3-4cbe-9a93-6fe5c4c0b663 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:59.136165 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-9cae311e-5ad3-4cbe-9a93-6fe5c4c0b663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:59.290849 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 912/1815] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:05:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:59.294211 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1f483-a1cb-4311-b6f1-76b5dee59d36 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:59.294629 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1f483-a1cb-4311-b6f1-76b5dee59d36 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:59.297420 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1f483-a1cb-4311-b6f1-76b5dee59d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:59.337758 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae311e-5ad3-4cbe-9a93-6fe5c4c0b663 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:59.355224 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0edea13-1412-48c8-8ebc-ba4f7c597a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:59.356754 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edea13-1412-48c8-8ebc-ba4f7c597a2a admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:59.360315 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edea13-1412-48c8-8ebc-ba4f7c597a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:59.361454 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0edea13-1412-48c8-8ebc-ba4f7c597a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:59.363230 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0edea13-1412-48c8-8ebc-ba4f7c597a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:59.392860 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-f6f1f483-a1cb-4311-b6f1-76b5dee59d36 None None] MFA Rules not processed for user `01acdb65e66441418d4abe1f0ed804bc`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:05:59.397884 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-f6f1f483-a1cb-4311-b6f1-76b5dee59d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:59.454474 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0edea13-1412-48c8-8ebc-ba4f7c597a2a admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:59.507617 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 904/1816] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:59 2021] GET /identity/v3/roles => generated 1420 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:59.508564 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0edea13-1412-48c8-8ebc-ba4f7c597a2a admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:59.517277 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-b0edea13-1412-48c8-8ebc-ba4f7c597a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:05:59.681958 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 913/1817] 10.222.0.89 () {58 vars in 1018 bytes} [Wed Oct 27 15:05:59 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:05:59.683961 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1f483-a1cb-4311-b6f1-76b5dee59d36 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:59.694797 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1f483-a1cb-4311-b6f1-76b5dee59d36 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:59.709911 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d690a-873e-4a71-b9d5-2e0cd5356cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:59.710968 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d690a-873e-4a71-b9d5-2e0cd5356cd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:59.711585 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d690a-873e-4a71-b9d5-2e0cd5356cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:59.712090 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d690a-873e-4a71-b9d5-2e0cd5356cd1 admin admin] PATH_INFO: `/v3/projects/9cc708816314443d876aa154fea691b1/users/3482986cd3134837be14703377c67e04/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:59.712697 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0edea13-1412-48c8-8ebc-ba4f7c597a2a admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:59.724201 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e3b0e-43a3-49c1-b22a-b9637c4a5f28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:59.724810 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e3b0e-43a3-49c1-b22a-b9637c4a5f28 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:59.725099 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e3b0e-43a3-49c1-b22a-b9637c4a5f28 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:59.725377 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e3b0e-43a3-49c1-b22a-b9637c4a5f28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:59.743892 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e3b0e-43a3-49c1-b22a-b9637c4a5f28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:59.752976 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d690a-873e-4a71-b9d5-2e0cd5356cd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc708816314443d876aa154fea691b1, user_id=3482986cd3134837be14703377c67e04, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:59.782700 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866d690a-873e-4a71-b9d5-2e0cd5356cd1 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:59.800084 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 914/1818] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:59 2021] PUT /identity/v3/projects/9cc708816314443d876aa154fea691b1/users/3482986cd3134837be14703377c67e04/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:05:59.805008 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d690a-873e-4a71-b9d5-2e0cd5356cd1 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:59.808628 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e3b0e-43a3-49c1-b22a-b9637c4a5f28 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:59.833906 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 905/1819] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:05:59 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:05:59.908190 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d690a-873e-4a71-b9d5-2e0cd5356cd1 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:59.914343 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f6d1d-1aaf-4a71-bfbd-3391c3135667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:59.915276 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f6d1d-1aaf-4a71-bfbd-3391c3135667 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:59.916232 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f6d1d-1aaf-4a71-bfbd-3391c3135667 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:59.916232 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f6d1d-1aaf-4a71-bfbd-3391c3135667 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:59.917550 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f6d1d-1aaf-4a71-bfbd-3391c3135667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:05:59.949333 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f6d1d-1aaf-4a71-bfbd-3391c3135667 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:05:59.963558 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 915/1820] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:05:59 2021] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:05:59.969072 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e3b0e-43a3-49c1-b22a-b9637c4a5f28 service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:05:59.980101 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e3b0e-43a3-49c1-b22a-b9637c4a5f28 service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:05:59.987557 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82347e46-340e-4636-a39a-59928b03d5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:05:59.989147 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82347e46-340e-4636-a39a-59928b03d5ed admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:05:59.989147 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82347e46-340e-4636-a39a-59928b03d5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:05:59.989318 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82347e46-340e-4636-a39a-59928b03d5ed admin admin] PATH_INFO: `/v3/projects/9cc708816314443d876aa154fea691b1/users/3482986cd3134837be14703377c67e04/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:05:59.991462 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82347e46-340e-4636-a39a-59928b03d5ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc708816314443d876aa154fea691b1, user_id=3482986cd3134837be14703377c67e04, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:00.026110 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82347e46-340e-4636-a39a-59928b03d5ed admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:00.045866 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 906/1821] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:05:59 2021] PUT /identity/v3/projects/9cc708816314443d876aa154fea691b1/users/3482986cd3134837be14703377c67e04/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:06:00.050862 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f6d1d-1aaf-4a71-bfbd-3391c3135667 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:00.072105 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f6d1d-1aaf-4a71-bfbd-3391c3135667 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:00.188914 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074cc7c8-04b0-4fcc-8ec9-1d6ac240a58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:00.189656 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cc7c8-04b0-4fcc-8ec9-1d6ac240a58c admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:00.190040 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cc7c8-04b0-4fcc-8ec9-1d6ac240a58c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:00.190367 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074cc7c8-04b0-4fcc-8ec9-1d6ac240a58c admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:00.191096 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074cc7c8-04b0-4fcc-8ec9-1d6ac240a58c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:00.224081 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074cc7c8-04b0-4fcc-8ec9-1d6ac240a58c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:00.238044 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 916/1822] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:00 2021] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:06:00.244175 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82347e46-340e-4636-a39a-59928b03d5ed admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:00.260014 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82347e46-340e-4636-a39a-59928b03d5ed admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:00.267500 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cab4c1-1fbb-44b6-9258-339d7de2b234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:00.268552 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cab4c1-1fbb-44b6-9258-339d7de2b234 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:00.268849 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cab4c1-1fbb-44b6-9258-339d7de2b234 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:00.269478 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cab4c1-1fbb-44b6-9258-339d7de2b234 admin admin] PATH_INFO: `/v3/projects/9cc708816314443d876aa154fea691b1/users/3482986cd3134837be14703377c67e04/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:00.271767 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cab4c1-1fbb-44b6-9258-339d7de2b234 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cc708816314443d876aa154fea691b1, user_id=3482986cd3134837be14703377c67e04, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:00.312387 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cab4c1-1fbb-44b6-9258-339d7de2b234 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:00.336560 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 907/1823] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:00 2021] PUT /identity/v3/projects/9cc708816314443d876aa154fea691b1/users/3482986cd3134837be14703377c67e04/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:00.357720 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066a08f-8e77-4781-8ed8-f26e7c89880c None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:00.358749 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066a08f-8e77-4781-8ed8-f26e7c89880c None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:00.359038 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066a08f-8e77-4781-8ed8-f26e7c89880c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:00.522477 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-0066a08f-8e77-4781-8ed8-f26e7c89880c None None] MFA Rules not processed for user `3482986cd3134837be14703377c67e04`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:00.528171 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-0066a08f-8e77-4781-8ed8-f26e7c89880c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:00.603714 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cab4c1-1fbb-44b6-9258-339d7de2b234 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:00.605802 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-a3cab4c1-1fbb-44b6-9258-339d7de2b234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:00.711179 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 917/1824] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:00 2021] POST /identity/v3/auth/tokens => generated 3753 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:00.712562 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca92b5-9725-4cee-98f5-8121447bd8e2 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:00.712857 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca92b5-9725-4cee-98f5-8121447bd8e2 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:00.713136 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca92b5-9725-4cee-98f5-8121447bd8e2 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:00.726637 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 918/1825] 10.222.0.89 () {54 vars in 921 bytes} [Wed Oct 27 15:06:00 2021] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:06:00.729052 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca92b5-9725-4cee-98f5-8121447bd8e2 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:00.734538 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-ecca92b5-9725-4cee-98f5-8121447bd8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:00.769488 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cab4c1-1fbb-44b6-9258-339d7de2b234 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:00.781607 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20988c-5b5d-4902-88af-253d1c45ccbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:00.782737 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20988c-5b5d-4902-88af-253d1c45ccbd service nova] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:00.783034 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20988c-5b5d-4902-88af-253d1c45ccbd service nova] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:00.783313 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20988c-5b5d-4902-88af-253d1c45ccbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:00.795483 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf20988c-5b5d-4902-88af-253d1c45ccbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:00.827345 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf20988c-5b5d-4902-88af-253d1c45ccbd service nova] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:00.894569 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 908/1826] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:06:00 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:06:00.897791 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20988c-5b5d-4902-88af-253d1c45ccbd service nova] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:00.903381 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-cf20988c-5b5d-4902-88af-253d1c45ccbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:00.935421 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca92b5-9725-4cee-98f5-8121447bd8e2 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:00.943217 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855708ef-4e50-400f-8455-cefb32c53695 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:00.945687 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855708ef-4e50-400f-8455-cefb32c53695 service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:00.946178 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855708ef-4e50-400f-8455-cefb32c53695 service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:00.946642 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855708ef-4e50-400f-8455-cefb32c53695 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:00.989552 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855708ef-4e50-400f-8455-cefb32c53695 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:01.134024 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855708ef-4e50-400f-8455-cefb32c53695 service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:01.215512 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 919/1827] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:06:00 2021] GET /identity/v3/auth/tokens => generated 3753 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:06:01.221546 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff90d5-d598-429e-ab9e-a050bb17770d None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:01.222045 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff90d5-d598-429e-ab9e-a050bb17770d None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:01.222531 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff90d5-d598-429e-ab9e-a050bb17770d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:01.235410 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20988c-5b5d-4902-88af-253d1c45ccbd service nova] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:01.264647 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc7f71-bbba-474d-9bd1-dee05bf70672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:01.265491 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc7f71-bbba-474d-9bd1-dee05bf70672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:01.265811 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc7f71-bbba-474d-9bd1-dee05bf70672 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:01.266367 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc7f71-bbba-474d-9bd1-dee05bf70672 admin admin] PATH_INFO: `/v3/projects/f8b6a563cf02494393c354d7082c9d45` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:01.275808 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc7f71-bbba-474d-9bd1-dee05bf70672 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8b6a563cf02494393c354d7082c9d45)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:01.368379 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc7f71-bbba-474d-9bd1-dee05bf70672 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:01.401957 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-9eff90d5-d598-429e-ab9e-a050bb17770d None None] MFA Rules not processed for user `01acdb65e66441418d4abe1f0ed804bc`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:01.403912 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-9eff90d5-d598-429e-ab9e-a050bb17770d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:01.463372 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 920/1828] 10.222.0.89 () {58 vars in 1018 bytes} [Wed Oct 27 15:06:01 2021] POST /identity/v3/auth/tokens => generated 3802 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:01.464835 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff90d5-d598-429e-ab9e-a050bb17770d None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:01.486048 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff90d5-d598-429e-ab9e-a050bb17770d None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:01.491686 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-2dbc7f71-bbba-474d-9bd1-dee05bf70672 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8b6a563cf02494393c354d7082c9d45', 'request_id': 'req-2dbc7f71-bbba-474d-9bd1-dee05bf70672'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:01.504726 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-2dbc7f71-bbba-474d-9bd1-dee05bf70672 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8b6a563cf02494393c354d7082c9d45', 'request_id': 'req-2dbc7f71-bbba-474d-9bd1-dee05bf70672'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:01.532466 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-2dbc7f71-bbba-474d-9bd1-dee05bf70672 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8b6a563cf02494393c354d7082c9d45', 'request_id': 'req-2dbc7f71-bbba-474d-9bd1-dee05bf70672'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:01.553573 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-2dbc7f71-bbba-474d-9bd1-dee05bf70672 admin admin] The token cache is being invalidate because project f8b6a563cf02494393c354d7082c9d45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:06:01.553960 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-2dbc7f71-bbba-474d-9bd1-dee05bf70672 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:01.555808 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-2dbc7f71-bbba-474d-9bd1-dee05bf70672 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:01.559726 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 909/1829] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:06:00 2021] DELETE /identity/v3/projects/f8b6a563cf02494393c354d7082c9d45 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:01.565794 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd88a3-cd7f-4a8e-82c9-fdc3474ae134 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:01.566176 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd88a3-cd7f-4a8e-82c9-fdc3474ae134 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:01.566638 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd88a3-cd7f-4a8e-82c9-fdc3474ae134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:01.593852 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de3c6e-a685-41fc-b623-5ea45034eb64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:01.595352 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de3c6e-a685-41fc-b623-5ea45034eb64 service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:01.595747 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de3c6e-a685-41fc-b623-5ea45034eb64 service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:01.596409 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de3c6e-a685-41fc-b623-5ea45034eb64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:01.598335 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-43de3c6e-a685-41fc-b623-5ea45034eb64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:01.624440 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-73fd88a3-cd7f-4a8e-82c9-fdc3474ae134 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:01.625616 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-73fd88a3-cd7f-4a8e-82c9-fdc3474ae134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:01.750799 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de3c6e-a685-41fc-b623-5ea45034eb64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:01.838792 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 910/1830] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:06:01.838995 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de3c6e-a685-41fc-b623-5ea45034eb64 service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:01.841614 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc1041-c165-4097-823d-7c969bb04541 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:01.841912 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc1041-c165-4097-823d-7c969bb04541 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:01.842200 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc1041-c165-4097-823d-7c969bb04541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:01.864339 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 921/1831] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:06:01 2021] GET /identity/v3/auth/tokens => generated 3688 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:06:01.928900 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-6dcc1041-c165-4097-823d-7c969bb04541 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:01.930235 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-6dcc1041-c165-4097-823d-7c969bb04541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:01.947048 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 911/1832] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:06:01.948997 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de3c6e-a685-41fc-b623-5ea45034eb64 service cinder] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:01.963057 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de3c6e-a685-41fc-b623-5ea45034eb64 service cinder] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:01.975367 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac7bc1-a62a-49ac-9dc1-67e50fcc11c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:01.976077 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac7bc1-a62a-49ac-9dc1-67e50fcc11c1 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:01.976364 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac7bc1-a62a-49ac-9dc1-67e50fcc11c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:01.976639 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac7bc1-a62a-49ac-9dc1-67e50fcc11c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:01.979678 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac7bc1-a62a-49ac-9dc1-67e50fcc11c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:06:01.982093 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac7bc1-a62a-49ac-9dc1-67e50fcc11c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:02.054677 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac7bc1-a62a-49ac-9dc1-67e50fcc11c1 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:02.089042 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc1041-c165-4097-823d-7c969bb04541 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:02.091807 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-6dcc1041-c165-4097-823d-7c969bb04541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:02.116284 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 922/1833] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:06:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:06:02.116477 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc1041-c165-4097-823d-7c969bb04541 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:02.117967 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac7bc1-a62a-49ac-9dc1-67e50fcc11c1 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:02.128894 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae7fd6-016f-4316-9739-407a5ca31c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:02.134267 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae7fd6-016f-4316-9739-407a5ca31c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:02.134581 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae7fd6-016f-4316-9739-407a5ca31c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:02.134860 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae7fd6-016f-4316-9739-407a5ca31c56 admin admin] PATH_INFO: `/v3/projects/ab8e51a4f38941c297ce4c4610901b89` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:02.141498 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae7fd6-016f-4316-9739-407a5ca31c56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab8e51a4f38941c297ce4c4610901b89)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:02.146899 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac7bc1-a62a-49ac-9dc1-67e50fcc11c1 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:02.173514 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacce62-4a9e-4451-a5fc-64d79f0da8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:02.174127 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacce62-4a9e-4451-a5fc-64d79f0da8c4 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:02.174413 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacce62-4a9e-4451-a5fc-64d79f0da8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:02.174694 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacce62-4a9e-4451-a5fc-64d79f0da8c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:02.175338 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aacce62-4a9e-4451-a5fc-64d79f0da8c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:02.243693 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae7fd6-016f-4316-9739-407a5ca31c56 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:02.263044 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aacce62-4a9e-4451-a5fc-64d79f0da8c4 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:02.351144 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 923/1834] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:06:02 2021] POST /identity/v3/projects => generated 369 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:02.355326 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacce62-4a9e-4451-a5fc-64d79f0da8c4 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:02.465035 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-c5ae7fd6-016f-4316-9739-407a5ca31c56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab8e51a4f38941c297ce4c4610901b89', 'request_id': 'req-c5ae7fd6-016f-4316-9739-407a5ca31c56'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:02.497041 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-c5ae7fd6-016f-4316-9739-407a5ca31c56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab8e51a4f38941c297ce4c4610901b89', 'request_id': 'req-c5ae7fd6-016f-4316-9739-407a5ca31c56'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:02.575828 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-c5ae7fd6-016f-4316-9739-407a5ca31c56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab8e51a4f38941c297ce4c4610901b89', 'request_id': 'req-c5ae7fd6-016f-4316-9739-407a5ca31c56'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:02.635940 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-c5ae7fd6-016f-4316-9739-407a5ca31c56 admin admin] The token cache is being invalidate because project ab8e51a4f38941c297ce4c4610901b89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:06:02.636810 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-c5ae7fd6-016f-4316-9739-407a5ca31c56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:02.642600 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-c5ae7fd6-016f-4316-9739-407a5ca31c56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:02.647928 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 912/1835] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:06:02 2021] DELETE /identity/v3/projects/ab8e51a4f38941c297ce4c4610901b89 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:02.654407 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82ffe7-765e-4257-be0b-13f5c9cc32df None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:02.654870 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82ffe7-765e-4257-be0b-13f5c9cc32df None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:02.655318 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a82ffe7-765e-4257-be0b-13f5c9cc32df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:02.726136 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacce62-4a9e-4451-a5fc-64d79f0da8c4 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:02.742641 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-6a82ffe7-765e-4257-be0b-13f5c9cc32df None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:02.746503 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-6a82ffe7-765e-4257-be0b-13f5c9cc32df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:02.923882 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471b63a7-92d5-412e-a6e2-6d0bcfdca77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:02.924869 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b63a7-92d5-412e-a6e2-6d0bcfdca77c admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:02.925163 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b63a7-92d5-412e-a6e2-6d0bcfdca77c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:02.925444 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471b63a7-92d5-412e-a6e2-6d0bcfdca77c admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:02.926100 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b63a7-92d5-412e-a6e2-6d0bcfdca77c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:02.944717 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 913/1836] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:02.945622 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82ffe7-765e-4257-be0b-13f5c9cc32df None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:02.947240 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-6a82ffe7-765e-4257-be0b-13f5c9cc32df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:02.981999 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471b63a7-92d5-412e-a6e2-6d0bcfdca77c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:03.015733 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 924/1837] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:06:02 2021] POST /identity/v3/users => generated 285 bytes in 661 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:06:03.016697 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06bafd-b567-48fe-8aec-1d3e9a6599f4 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:03.016985 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06bafd-b567-48fe-8aec-1d3e9a6599f4 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:03.017262 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca06bafd-b567-48fe-8aec-1d3e9a6599f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:03.074458 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-ca06bafd-b567-48fe-8aec-1d3e9a6599f4 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:03.078593 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-ca06bafd-b567-48fe-8aec-1d3e9a6599f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:03.107344 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 925/1838] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:03 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:03.107344 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06bafd-b567-48fe-8aec-1d3e9a6599f4 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:03.108294 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-ca06bafd-b567-48fe-8aec-1d3e9a6599f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:03.138828 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca06bafd-b567-48fe-8aec-1d3e9a6599f4 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:03.147949 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a82ffe7-765e-4257-be0b-13f5c9cc32df None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:03.155284 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d655f2-17d0-4dd3-a082-924fb960a084 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:03.156916 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d655f2-17d0-4dd3-a082-924fb960a084 service nova] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:03.157358 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d655f2-17d0-4dd3-a082-924fb960a084 service nova] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:03.157833 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d655f2-17d0-4dd3-a082-924fb960a084 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:03.158866 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834d1b0-16be-4251-a8ff-b0cfeb47c286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:03.159503 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834d1b0-16be-4251-a8ff-b0cfeb47c286 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:03.159806 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834d1b0-16be-4251-a8ff-b0cfeb47c286 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:03.160123 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834d1b0-16be-4251-a8ff-b0cfeb47c286 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:03.160634 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-27d655f2-17d0-4dd3-a082-924fb960a084 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:03.160885 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834d1b0-16be-4251-a8ff-b0cfeb47c286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:03.187176 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d655f2-17d0-4dd3-a082-924fb960a084 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:03.195062 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8834d1b0-16be-4251-a8ff-b0cfeb47c286 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:03.215263 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 926/1839] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:03 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:06:03.216004 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834d1b0-16be-4251-a8ff-b0cfeb47c286 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:03.236024 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d655f2-17d0-4dd3-a082-924fb960a084 service nova] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:03.244925 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834d1b0-16be-4251-a8ff-b0cfeb47c286 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:03.250167 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b72102-bc86-46a0-b1c0-7d00554e2a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:03.250778 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b72102-bc86-46a0-b1c0-7d00554e2a7f admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:03.251063 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b72102-bc86-46a0-b1c0-7d00554e2a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:03.251348 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b72102-bc86-46a0-b1c0-7d00554e2a7f admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:03.252079 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b72102-bc86-46a0-b1c0-7d00554e2a7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:06:03.252376 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b72102-bc86-46a0-b1c0-7d00554e2a7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:03.270424 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 914/1840] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:06:02 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:06:03.271827 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d655f2-17d0-4dd3-a082-924fb960a084 service nova] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:03.294316 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d655f2-17d0-4dd3-a082-924fb960a084 service nova] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:03.296814 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b72102-bc86-46a0-b1c0-7d00554e2a7f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:03.311762 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202cf2c-d6ed-4436-9f5b-9b1bfe71a5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:03.312878 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202cf2c-d6ed-4436-9f5b-9b1bfe71a5b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:03.313297 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202cf2c-d6ed-4436-9f5b-9b1bfe71a5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:03.313708 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202cf2c-d6ed-4436-9f5b-9b1bfe71a5b6 admin admin] PATH_INFO: `/v3/projects/61c170a543f54581ba86ce4589fd1101/users/0b08d8db9a864685967515c603af51ec/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:03.322459 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 927/1841] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:06:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:06:03.333994 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b72102-bc86-46a0-b1c0-7d00554e2a7f admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:03.358386 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b72102-bc86-46a0-b1c0-7d00554e2a7f admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:03.368710 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29ce87-ffbe-420e-83c3-62b36b1c96b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:03.370303 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29ce87-ffbe-420e-83c3-62b36b1c96b8 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:03.370736 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29ce87-ffbe-420e-83c3-62b36b1c96b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:03.371154 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef29ce87-ffbe-420e-83c3-62b36b1c96b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:03.372875 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29ce87-ffbe-420e-83c3-62b36b1c96b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:03.374138 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202cf2c-d6ed-4436-9f5b-9b1bfe71a5b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c170a543f54581ba86ce4589fd1101, user_id=0b08d8db9a864685967515c603af51ec, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:03.420751 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef29ce87-ffbe-420e-83c3-62b36b1c96b8 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:03.454416 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7202cf2c-d6ed-4436-9f5b-9b1bfe71a5b6 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:03.487267 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 928/1842] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:06:03 2021] POST /identity/v3/projects => generated 375 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:03.492070 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29ce87-ffbe-420e-83c3-62b36b1c96b8 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:03.516626 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 915/1843] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:03 2021] PUT /identity/v3/projects/61c170a543f54581ba86ce4589fd1101/users/0b08d8db9a864685967515c603af51ec/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:03.518542 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9f7d6-efd1-485a-96f5-a9b91e66de2c None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:03.526577 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9f7d6-efd1-485a-96f5-a9b91e66de2c None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:03.527009 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9f7d6-efd1-485a-96f5-a9b91e66de2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:03.654679 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-76d9f7d6-efd1-485a-96f5-a9b91e66de2c None None] MFA Rules not processed for user `0b08d8db9a864685967515c603af51ec`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:03.663330 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-76d9f7d6-efd1-485a-96f5-a9b91e66de2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:03.704503 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef29ce87-ffbe-420e-83c3-62b36b1c96b8 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:03.810946 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4065b-ab7e-4680-9300-4c7cac4242fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:03.811880 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4065b-ab7e-4680-9300-4c7cac4242fe admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:03.812466 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4065b-ab7e-4680-9300-4c7cac4242fe admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:03.812890 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4065b-ab7e-4680-9300-4c7cac4242fe admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:03.813874 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4065b-ab7e-4680-9300-4c7cac4242fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:03.819172 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 916/1844] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:03 2021] POST /identity/v3/auth/tokens => generated 3676 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:03.823580 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9f7d6-efd1-485a-96f5-a9b91e66de2c None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:03.835426 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9f7d6-efd1-485a-96f5-a9b91e66de2c None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:03.841831 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d019275-ad07-4d41-9223-4a939e4def9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:03.842716 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d019275-ad07-4d41-9223-4a939e4def9f admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:03.843411 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d019275-ad07-4d41-9223-4a939e4def9f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:03.844156 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d019275-ad07-4d41-9223-4a939e4def9f admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:03.845212 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d019275-ad07-4d41-9223-4a939e4def9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:03.846573 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4065b-ab7e-4680-9300-4c7cac4242fe admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:03.874375 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 929/1845] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:06:03 2021] POST /identity/v3/users => generated 288 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:03.879046 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4065b-ab7e-4680-9300-4c7cac4242fe admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:03.884168 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d019275-ad07-4d41-9223-4a939e4def9f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:03.892697 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4065b-ab7e-4680-9300-4c7cac4242fe admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:03.905248 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e84f0-8006-4cf7-938a-4b6f95cbe714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:03.906116 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e84f0-8006-4cf7-938a-4b6f95cbe714 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:03.906941 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e84f0-8006-4cf7-938a-4b6f95cbe714 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:03.907665 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e84f0-8006-4cf7-938a-4b6f95cbe714 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:03.909303 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e84f0-8006-4cf7-938a-4b6f95cbe714 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:03.925170 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 917/1846] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:06:03 2021] POST /identity/v3/projects => generated 367 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:03.926380 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d019275-ad07-4d41-9223-4a939e4def9f admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:03.962246 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e84f0-8006-4cf7-938a-4b6f95cbe714 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:03.977782 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 930/1847] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:03 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:06:03.981051 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e84f0-8006-4cf7-938a-4b6f95cbe714 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:03.994852 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e84f0-8006-4cf7-938a-4b6f95cbe714 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:04.016241 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d019275-ad07-4d41-9223-4a939e4def9f admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:04.021816 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5879335-3303-46a2-8226-fe25c43321d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:04.022411 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5879335-3303-46a2-8226-fe25c43321d2 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:04.022809 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5879335-3303-46a2-8226-fe25c43321d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:04.023220 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5879335-3303-46a2-8226-fe25c43321d2 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:04.024047 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5879335-3303-46a2-8226-fe25c43321d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:04.070478 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5879335-3303-46a2-8226-fe25c43321d2 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:04.102683 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 918/1848] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:06:03 2021] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:04.107889 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5879335-3303-46a2-8226-fe25c43321d2 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:04.123558 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5879335-3303-46a2-8226-fe25c43321d2 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:04.124554 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae192153-de9b-472e-a3a6-30564a465077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:04.125660 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae192153-de9b-472e-a3a6-30564a465077 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:04.125942 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae192153-de9b-472e-a3a6-30564a465077 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:04.126218 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae192153-de9b-472e-a3a6-30564a465077 admin admin] PATH_INFO: `/v3/projects/e07ff6f5d64a43258c0d677996b535a6/users/1044ddfabd6541cd99d8743c08689832/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:04.130003 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e6530-c815-4f7f-a8e7-fafd6bdaa73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:04.131553 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e6530-c815-4f7f-a8e7-fafd6bdaa73b admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:04.132066 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e6530-c815-4f7f-a8e7-fafd6bdaa73b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:04.132679 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e6530-c815-4f7f-a8e7-fafd6bdaa73b admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:04.133602 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e6530-c815-4f7f-a8e7-fafd6bdaa73b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:04.167592 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae192153-de9b-472e-a3a6-30564a465077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e07ff6f5d64a43258c0d677996b535a6, user_id=1044ddfabd6541cd99d8743c08689832, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:04.173695 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e6530-c815-4f7f-a8e7-fafd6bdaa73b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:04.215677 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 919/1849] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:04 2021] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:06:04.223672 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e6530-c815-4f7f-a8e7-fafd6bdaa73b admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:04.240508 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae192153-de9b-472e-a3a6-30564a465077 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:04.245608 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e6530-c815-4f7f-a8e7-fafd6bdaa73b admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:04.259665 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4490fd-4a5c-4a84-a69a-92e11e75e092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:04.261293 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4490fd-4a5c-4a84-a69a-92e11e75e092 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:04.261750 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4490fd-4a5c-4a84-a69a-92e11e75e092 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:04.262177 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4490fd-4a5c-4a84-a69a-92e11e75e092 admin admin] PATH_INFO: `/v3/projects/ae9cf28c250b4c9ab9a67af0d57afc76/users/45cd7c18da0247cabbdbeed5fbe18b07/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:04.280721 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 931/1850] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:03 2021] PUT /identity/v3/projects/e07ff6f5d64a43258c0d677996b535a6/users/1044ddfabd6541cd99d8743c08689832/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:04.293222 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0b06c-186a-4b60-a665-47d8d781392d None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:04.293516 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0b06c-186a-4b60-a665-47d8d781392d None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:04.294162 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f0b06c-186a-4b60-a665-47d8d781392d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:04.300863 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4490fd-4a5c-4a84-a69a-92e11e75e092 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae9cf28c250b4c9ab9a67af0d57afc76, user_id=45cd7c18da0247cabbdbeed5fbe18b07, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:04.386777 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-a7f0b06c-186a-4b60-a665-47d8d781392d None None] MFA Rules not processed for user `1044ddfabd6541cd99d8743c08689832`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:04.389919 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-a7f0b06c-186a-4b60-a665-47d8d781392d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:04.438539 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4490fd-4a5c-4a84-a69a-92e11e75e092 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:04.530143 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 920/1851] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:04 2021] PUT /identity/v3/projects/ae9cf28c250b4c9ab9a67af0d57afc76/users/45cd7c18da0247cabbdbeed5fbe18b07/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:04.534644 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4490fd-4a5c-4a84-a69a-92e11e75e092 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:04.578119 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 932/1852] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:04 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:04.585307 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0b06c-186a-4b60-a665-47d8d781392d None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:04.672242 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4490fd-4a5c-4a84-a69a-92e11e75e092 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:04.678530 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e44d9-c9c9-4177-9269-523b5fc6b479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:04.679651 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e44d9-c9c9-4177-9269-523b5fc6b479 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:04.680038 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f0b06c-186a-4b60-a665-47d8d781392d None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:04.680381 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e44d9-c9c9-4177-9269-523b5fc6b479 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:04.680991 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e44d9-c9c9-4177-9269-523b5fc6b479 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:04.682552 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e44d9-c9c9-4177-9269-523b5fc6b479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:04.686996 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e28442-e79f-4264-9617-3288b31a35de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:04.687758 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e28442-e79f-4264-9617-3288b31a35de admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:04.688129 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e28442-e79f-4264-9617-3288b31a35de admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:04.688485 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e28442-e79f-4264-9617-3288b31a35de admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:04.689212 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e28442-e79f-4264-9617-3288b31a35de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:04.715236 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5e44d9-c9c9-4177-9269-523b5fc6b479 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:04.723660 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e28442-e79f-4264-9617-3288b31a35de admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:04.730022 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 921/1853] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:04 2021] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:06:04.743488 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e44d9-c9c9-4177-9269-523b5fc6b479 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:04.763588 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5e44d9-c9c9-4177-9269-523b5fc6b479 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:04.777559 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591538b0-d2e2-4639-ba96-fd4905d49cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:04.778628 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591538b0-d2e2-4639-ba96-fd4905d49cd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:04.778920 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591538b0-d2e2-4639-ba96-fd4905d49cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:04.779218 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591538b0-d2e2-4639-ba96-fd4905d49cd7 admin admin] PATH_INFO: `/v3/projects/ae9cf28c250b4c9ab9a67af0d57afc76/users/45cd7c18da0247cabbdbeed5fbe18b07/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:04.783702 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591538b0-d2e2-4639-ba96-fd4905d49cd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae9cf28c250b4c9ab9a67af0d57afc76, user_id=45cd7c18da0247cabbdbeed5fbe18b07, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:04.817292 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 933/1854] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:06:04 2021] POST /identity/v3/projects => generated 375 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:04.821485 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e28442-e79f-4264-9617-3288b31a35de admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:04.838700 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591538b0-d2e2-4639-ba96-fd4905d49cd7 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:04.850908 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 922/1855] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:04 2021] PUT /identity/v3/projects/ae9cf28c250b4c9ab9a67af0d57afc76/users/45cd7c18da0247cabbdbeed5fbe18b07/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:04.855392 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591538b0-d2e2-4639-ba96-fd4905d49cd7 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:04.968282 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e28442-e79f-4264-9617-3288b31a35de admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:04.984504 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591538b0-d2e2-4639-ba96-fd4905d49cd7 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:04.996938 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777d146-37f4-4ef3-b5d0-b63147da2a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:04.997849 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777d146-37f4-4ef3-b5d0-b63147da2a02 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:04.998378 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777d146-37f4-4ef3-b5d0-b63147da2a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:04.998860 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777d146-37f4-4ef3-b5d0-b63147da2a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:05.000010 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777d146-37f4-4ef3-b5d0-b63147da2a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:05.032052 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777d146-37f4-4ef3-b5d0-b63147da2a02 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:05.047809 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824272d-8475-41c0-b06c-17b998f13157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:05.048673 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824272d-8475-41c0-b06c-17b998f13157 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:05.049147 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824272d-8475-41c0-b06c-17b998f13157 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:05.050270 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824272d-8475-41c0-b06c-17b998f13157 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:05.051429 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824272d-8475-41c0-b06c-17b998f13157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:05.056608 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 923/1856] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:04 2021] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:06:05.059614 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777d146-37f4-4ef3-b5d0-b63147da2a02 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:05.073631 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777d146-37f4-4ef3-b5d0-b63147da2a02 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:05.082441 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656b6e34-35be-4be5-8a9c-149045de397d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:05.084443 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b6e34-35be-4be5-8a9c-149045de397d admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:05.085027 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b6e34-35be-4be5-8a9c-149045de397d admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:05.086194 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656b6e34-35be-4be5-8a9c-149045de397d admin admin] PATH_INFO: `/v3/projects/ae9cf28c250b4c9ab9a67af0d57afc76/users/45cd7c18da0247cabbdbeed5fbe18b07/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:05.088650 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b6e34-35be-4be5-8a9c-149045de397d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae9cf28c250b4c9ab9a67af0d57afc76, user_id=45cd7c18da0247cabbdbeed5fbe18b07, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:05.108919 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824272d-8475-41c0-b06c-17b998f13157 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:05.145771 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656b6e34-35be-4be5-8a9c-149045de397d admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:05.172478 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 934/1858] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:06:04 2021] POST /identity/v3/users => generated 294 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:05.172841 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 924/1858] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:05 2021] PUT /identity/v3/projects/ae9cf28c250b4c9ab9a67af0d57afc76/users/45cd7c18da0247cabbdbeed5fbe18b07/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:05.176438 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824272d-8475-41c0-b06c-17b998f13157 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:05.181221 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae307c-afe9-4090-9631-39929eec8526 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:05.181602 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae307c-afe9-4090-9631-39929eec8526 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:05.182539 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae307c-afe9-4090-9631-39929eec8526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:05.188851 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824272d-8475-41c0-b06c-17b998f13157 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:05.230249 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-b1ae307c-afe9-4090-9631-39929eec8526 None None] MFA Rules not processed for user `45cd7c18da0247cabbdbeed5fbe18b07`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:05.231479 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-b1ae307c-afe9-4090-9631-39929eec8526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:05.302571 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a161001-31ce-42e3-8c18-ae944b40173c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:05.303480 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a161001-31ce-42e3-8c18-ae944b40173c admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:05.303932 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a161001-31ce-42e3-8c18-ae944b40173c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:05.304217 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a161001-31ce-42e3-8c18-ae944b40173c admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:05.304980 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a161001-31ce-42e3-8c18-ae944b40173c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:05.332682 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a161001-31ce-42e3-8c18-ae944b40173c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:05.348621 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 935/1859] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:05 2021] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:06:05.348885 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 925/1860] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:05 2021] POST /identity/v3/auth/tokens => generated 3741 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:05.349550 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a161001-31ce-42e3-8c18-ae944b40173c admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:05.356757 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae307c-afe9-4090-9631-39929eec8526 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:05.358356 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-b1ae307c-afe9-4090-9631-39929eec8526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:05.370927 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a161001-31ce-42e3-8c18-ae944b40173c admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:05.381828 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cd978-b52f-4230-acdf-c45d954b95c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:05.382674 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cd978-b52f-4230-acdf-c45d954b95c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:05.382963 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cd978-b52f-4230-acdf-c45d954b95c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:05.383242 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cd978-b52f-4230-acdf-c45d954b95c3 admin admin] PATH_INFO: `/v3/projects/cd82917ced6f4cb9b189abb49b3acad0/users/89ed5c415c894ced8255891ca1e0a5d3/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:05.407433 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0cd978-b52f-4230-acdf-c45d954b95c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd82917ced6f4cb9b189abb49b3acad0, user_id=89ed5c415c894ced8255891ca1e0a5d3, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:05.444711 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0cd978-b52f-4230-acdf-c45d954b95c3 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:05.454147 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae307c-afe9-4090-9631-39929eec8526 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:05.464777 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 936/1861] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:05 2021] PUT /identity/v3/projects/cd82917ced6f4cb9b189abb49b3acad0/users/89ed5c415c894ced8255891ca1e0a5d3/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:05.466091 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cd978-b52f-4230-acdf-c45d954b95c3 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:05.546625 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1db196-2923-478d-9d37-81d083001cd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:05.548118 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1db196-2923-478d-9d37-81d083001cd4 service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:05.551109 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1db196-2923-478d-9d37-81d083001cd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:05.551417 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1db196-2923-478d-9d37-81d083001cd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:05.578871 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cd978-b52f-4230-acdf-c45d954b95c3 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:05.594507 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf2b8e-e05e-47d1-b5ea-4eee7228f13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:05.595628 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf2b8e-e05e-47d1-b5ea-4eee7228f13e admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:05.595928 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf2b8e-e05e-47d1-b5ea-4eee7228f13e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:05.596363 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf2b8e-e05e-47d1-b5ea-4eee7228f13e admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:05.599230 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf2b8e-e05e-47d1-b5ea-4eee7228f13e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:05.649473 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf2b8e-e05e-47d1-b5ea-4eee7228f13e admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:05.665636 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 937/1862] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:05 2021] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:06:05.668030 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf2b8e-e05e-47d1-b5ea-4eee7228f13e admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:05.699007 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf2b8e-e05e-47d1-b5ea-4eee7228f13e admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:05.709300 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4585a8-9ed7-442b-b23b-ca6044297e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:05.710464 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4585a8-9ed7-442b-b23b-ca6044297e67 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:05.710955 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4585a8-9ed7-442b-b23b-ca6044297e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:05.711459 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4585a8-9ed7-442b-b23b-ca6044297e67 admin admin] PATH_INFO: `/v3/projects/cd82917ced6f4cb9b189abb49b3acad0/users/89ed5c415c894ced8255891ca1e0a5d3/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:05.714046 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4585a8-9ed7-442b-b23b-ca6044297e67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd82917ced6f4cb9b189abb49b3acad0, user_id=89ed5c415c894ced8255891ca1e0a5d3, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:05.747623 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4585a8-9ed7-442b-b23b-ca6044297e67 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:05.763485 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1db196-2923-478d-9d37-81d083001cd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:05.764059 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 938/1863] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:05 2021] PUT /identity/v3/projects/cd82917ced6f4cb9b189abb49b3acad0/users/89ed5c415c894ced8255891ca1e0a5d3/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:05.765233 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4585a8-9ed7-442b-b23b-ca6044297e67 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:05.830783 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1db196-2923-478d-9d37-81d083001cd4 service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:05.876136 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4585a8-9ed7-442b-b23b-ca6044297e67 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:05.901515 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 926/1864] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:06:05 2021] GET /identity/v3/auth/tokens => generated 3741 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:06:05.907755 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e796df-5158-4638-aa08-33d2977fd3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:05.908383 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e796df-5158-4638-aa08-33d2977fd3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:05.908677 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e796df-5158-4638-aa08-33d2977fd3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:05.908958 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e796df-5158-4638-aa08-33d2977fd3a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:05.916503 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e796df-5158-4638-aa08-33d2977fd3a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:05.986893 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e796df-5158-4638-aa08-33d2977fd3a4 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:06.014830 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 939/1865] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:05 2021] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:06:06.017134 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1db196-2923-478d-9d37-81d083001cd4 service cinder] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:06.050379 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1db196-2923-478d-9d37-81d083001cd4 service cinder] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:06.060849 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d8645-18f1-4c07-81b3-d2eb668a6072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:06.063130 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d8645-18f1-4c07-81b3-d2eb668a6072 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:06.064699 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d8645-18f1-4c07-81b3-d2eb668a6072 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:06.065873 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d8645-18f1-4c07-81b3-d2eb668a6072 admin admin] PATH_INFO: `/v3/projects/cd82917ced6f4cb9b189abb49b3acad0/users/89ed5c415c894ced8255891ca1e0a5d3/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:06.072276 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d8645-18f1-4c07-81b3-d2eb668a6072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd82917ced6f4cb9b189abb49b3acad0, user_id=89ed5c415c894ced8255891ca1e0a5d3, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:06.165776 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d8645-18f1-4c07-81b3-d2eb668a6072 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:06.172389 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e796df-5158-4638-aa08-33d2977fd3a4 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:06.174139 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-f1e796df-5158-4638-aa08-33d2977fd3a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:06.194447 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 927/1866] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:06 2021] PUT /identity/v3/projects/cd82917ced6f4cb9b189abb49b3acad0/users/89ed5c415c894ced8255891ca1e0a5d3/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:06.208135 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4a969-8a7b-49d1-b7ae-2cae835520a8 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:06.208554 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4a969-8a7b-49d1-b7ae-2cae835520a8 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:06.208930 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca4a969-8a7b-49d1-b7ae-2cae835520a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:06.227215 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e796df-5158-4638-aa08-33d2977fd3a4 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:06.263886 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-dca4a969-8a7b-49d1-b7ae-2cae835520a8 None None] MFA Rules not processed for user `89ed5c415c894ced8255891ca1e0a5d3`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:06.265371 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-dca4a969-8a7b-49d1-b7ae-2cae835520a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:06.430285 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 928/1867] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:06 2021] POST /identity/v3/auth/tokens => generated 3749 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:06:06.437886 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4a969-8a7b-49d1-b7ae-2cae835520a8 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:06.441043 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-dca4a969-8a7b-49d1-b7ae-2cae835520a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:06.470996 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033ec32-d3c7-4ee2-8eb5-f569712e7ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:06.472122 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033ec32-d3c7-4ee2-8eb5-f569712e7ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:06.472454 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033ec32-d3c7-4ee2-8eb5-f569712e7ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:06.472787 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033ec32-d3c7-4ee2-8eb5-f569712e7ac0 admin admin] PATH_INFO: `/v3/users/3623c9aa4de64a8684a3660fd6fe5f03` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:06.474217 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033ec32-d3c7-4ee2-8eb5-f569712e7ac0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3623c9aa4de64a8684a3660fd6fe5f03)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:06.510683 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033ec32-d3c7-4ee2-8eb5-f569712e7ac0 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:06.606642 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-6033ec32-d3c7-4ee2-8eb5-f569712e7ac0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3623c9aa4de64a8684a3660fd6fe5f03'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:06.607471 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-6033ec32-d3c7-4ee2-8eb5-f569712e7ac0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3623c9aa4de64a8684a3660fd6fe5f03'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:06.625343 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-6033ec32-d3c7-4ee2-8eb5-f569712e7ac0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3623c9aa4de64a8684a3660fd6fe5f03'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:06.649999 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-6033ec32-d3c7-4ee2-8eb5-f569712e7ac0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3623c9aa4de64a8684a3660fd6fe5f03'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:06.670445 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-6033ec32-d3c7-4ee2-8eb5-f569712e7ac0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3623c9aa4de64a8684a3660fd6fe5f03'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:06.673273 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca4a969-8a7b-49d1-b7ae-2cae835520a8 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:06.677830 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 940/1868] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:06:06 2021] DELETE /identity/v3/users/3623c9aa4de64a8684a3660fd6fe5f03 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:06.684044 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c094a74-a467-46b9-b82e-c0a6703dbf04 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:06.684502 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c094a74-a467-46b9-b82e-c0a6703dbf04 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:06.689966 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c094a74-a467-46b9-b82e-c0a6703dbf04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:06.692356 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85595b16-cd74-4a41-b37e-1bb4f5cc7980 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:06.693454 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85595b16-cd74-4a41-b37e-1bb4f5cc7980 service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:06.693762 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85595b16-cd74-4a41-b37e-1bb4f5cc7980 service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:06.694263 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85595b16-cd74-4a41-b37e-1bb4f5cc7980 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:06.700722 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-85595b16-cd74-4a41-b37e-1bb4f5cc7980 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:06.725243 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-0c094a74-a467-46b9-b82e-c0a6703dbf04 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:06.726849 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-0c094a74-a467-46b9-b82e-c0a6703dbf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:06.842479 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85595b16-cd74-4a41-b37e-1bb4f5cc7980 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:06.862694 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 941/1869] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:06 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:06.876177 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c094a74-a467-46b9-b82e-c0a6703dbf04 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:06.879485 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-0c094a74-a467-46b9-b82e-c0a6703dbf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:06.881147 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85595b16-cd74-4a41-b37e-1bb4f5cc7980 service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:06.891997 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 929/1870] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:06:06 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:06:07.053642 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c094a74-a467-46b9-b82e-c0a6703dbf04 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:07.067543 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6a14a-04d1-4466-b21a-abb1fbe90e55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:07.068161 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6a14a-04d1-4466-b21a-abb1fbe90e55 service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:07.068451 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6a14a-04d1-4466-b21a-abb1fbe90e55 service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:07.068735 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6a14a-04d1-4466-b21a-abb1fbe90e55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:07.091476 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6a14a-04d1-4466-b21a-abb1fbe90e55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:07.123402 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6a14a-04d1-4466-b21a-abb1fbe90e55 service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:07.149307 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 942/1871] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:06:06 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:06:07.724693 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85595b16-cd74-4a41-b37e-1bb4f5cc7980 service cinder] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:07.726643 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-85595b16-cd74-4a41-b37e-1bb4f5cc7980 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:07.764969 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85595b16-cd74-4a41-b37e-1bb4f5cc7980 service cinder] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:07.777534 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5700529-8625-41d6-89ec-cd67ea513928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:07.779291 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5700529-8625-41d6-89ec-cd67ea513928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:07.781569 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5700529-8625-41d6-89ec-cd67ea513928 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:07.781998 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5700529-8625-41d6-89ec-cd67ea513928 admin admin] PATH_INFO: `/v3/projects/3a02da69fa964b8caf6f485429457544` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:07.788330 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5700529-8625-41d6-89ec-cd67ea513928 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a02da69fa964b8caf6f485429457544)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:07.851381 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5700529-8625-41d6-89ec-cd67ea513928 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:08.015185 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-f5700529-8625-41d6-89ec-cd67ea513928 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a02da69fa964b8caf6f485429457544', 'request_id': 'req-f5700529-8625-41d6-89ec-cd67ea513928'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:08.038915 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-f5700529-8625-41d6-89ec-cd67ea513928 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a02da69fa964b8caf6f485429457544', 'request_id': 'req-f5700529-8625-41d6-89ec-cd67ea513928'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:08.090549 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-f5700529-8625-41d6-89ec-cd67ea513928 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a02da69fa964b8caf6f485429457544', 'request_id': 'req-f5700529-8625-41d6-89ec-cd67ea513928'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:08.124819 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-f5700529-8625-41d6-89ec-cd67ea513928 admin admin] The token cache is being invalidate because project 3a02da69fa964b8caf6f485429457544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:06:08.125212 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-f5700529-8625-41d6-89ec-cd67ea513928 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:08.126625 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-f5700529-8625-41d6-89ec-cd67ea513928 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:08.130599 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 930/1872] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:06:07 2021] DELETE /identity/v3/projects/3a02da69fa964b8caf6f485429457544 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:08.134415 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6a14a-04d1-4466-b21a-abb1fbe90e55 service neutron] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:08.154824 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6a14a-04d1-4466-b21a-abb1fbe90e55 service neutron] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:08.313467 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788b7a7-264a-4942-b025-7faf83d78b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:08.317863 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788b7a7-264a-4942-b025-7faf83d78b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:08.328952 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788b7a7-264a-4942-b025-7faf83d78b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:08.329325 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788b7a7-264a-4942-b025-7faf83d78b3a admin admin] PATH_INFO: `/v3/users/3482986cd3134837be14703377c67e04` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:08.335184 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788b7a7-264a-4942-b025-7faf83d78b3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3482986cd3134837be14703377c67e04)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:08.434812 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788b7a7-264a-4942-b025-7faf83d78b3a admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:08.528024 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-f788b7a7-264a-4942-b025-7faf83d78b3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3482986cd3134837be14703377c67e04'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:08.529014 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-f788b7a7-264a-4942-b025-7faf83d78b3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3482986cd3134837be14703377c67e04'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:08.543713 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-f788b7a7-264a-4942-b025-7faf83d78b3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3482986cd3134837be14703377c67e04'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:08.556174 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-f788b7a7-264a-4942-b025-7faf83d78b3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3482986cd3134837be14703377c67e04'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:08.567689 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-f788b7a7-264a-4942-b025-7faf83d78b3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3482986cd3134837be14703377c67e04'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:08.579600 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 943/1873] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:06:08 2021] DELETE /identity/v3/users/3482986cd3134837be14703377c67e04 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:09.132526 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5700529-8625-41d6-89ec-cd67ea513928 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:09.134641 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-f5700529-8625-41d6-89ec-cd67ea513928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:09.148888 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5700529-8625-41d6-89ec-cd67ea513928 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:09.254191 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3a4d1-9773-4c1e-b243-de092b67914d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:09.255112 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3a4d1-9773-4c1e-b243-de092b67914d admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:09.255552 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3a4d1-9773-4c1e-b243-de092b67914d admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:09.256213 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3a4d1-9773-4c1e-b243-de092b67914d admin admin] PATH_INFO: `/v3/projects/9cc708816314443d876aa154fea691b1` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:09.257870 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3a4d1-9773-4c1e-b243-de092b67914d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cc708816314443d876aa154fea691b1)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:09.293398 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab3a4d1-9773-4c1e-b243-de092b67914d admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:09.374113 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-dab3a4d1-9773-4c1e-b243-de092b67914d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cc708816314443d876aa154fea691b1', 'request_id': 'req-dab3a4d1-9773-4c1e-b243-de092b67914d'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:09.385325 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-dab3a4d1-9773-4c1e-b243-de092b67914d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cc708816314443d876aa154fea691b1', 'request_id': 'req-dab3a4d1-9773-4c1e-b243-de092b67914d'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:09.398640 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-dab3a4d1-9773-4c1e-b243-de092b67914d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cc708816314443d876aa154fea691b1', 'request_id': 'req-dab3a4d1-9773-4c1e-b243-de092b67914d'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:09.412625 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-dab3a4d1-9773-4c1e-b243-de092b67914d admin admin] The token cache is being invalidate because project 9cc708816314443d876aa154fea691b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:06:09.412907 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-dab3a4d1-9773-4c1e-b243-de092b67914d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:09.413717 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-dab3a4d1-9773-4c1e-b243-de092b67914d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:09.415378 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 931/1874] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:06:09 2021] DELETE /identity/v3/projects/9cc708816314443d876aa154fea691b1 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:09.421705 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122a5df-07ce-4628-9d76-810c053eae92 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:09.422186 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122a5df-07ce-4628-9d76-810c053eae92 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:09.422548 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122a5df-07ce-4628-9d76-810c053eae92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:09.449038 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-d122a5df-07ce-4628-9d76-810c053eae92 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:09.450302 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-d122a5df-07ce-4628-9d76-810c053eae92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:09.546557 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 944/1875] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:06:09.564410 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce45458-37e1-43f5-a4f8-e1c648af912c None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:09.564697 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce45458-37e1-43f5-a4f8-e1c648af912c None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:09.565252 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce45458-37e1-43f5-a4f8-e1c648af912c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:09.620744 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-fce45458-37e1-43f5-a4f8-e1c648af912c None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:09.622027 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-fce45458-37e1-43f5-a4f8-e1c648af912c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:09.639506 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 932/1876] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:09 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:09.644271 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122a5df-07ce-4628-9d76-810c053eae92 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:09.658606 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122a5df-07ce-4628-9d76-810c053eae92 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:09.672177 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b32a7b-6793-42e9-a42f-90ba18e15c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:09.672992 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b32a7b-6793-42e9-a42f-90ba18e15c87 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:09.673428 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b32a7b-6793-42e9-a42f-90ba18e15c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:09.673853 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b32a7b-6793-42e9-a42f-90ba18e15c87 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:09.674698 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b32a7b-6793-42e9-a42f-90ba18e15c87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:06:09.677006 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b32a7b-6793-42e9-a42f-90ba18e15c87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:09.706750 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b32a7b-6793-42e9-a42f-90ba18e15c87 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:09.724817 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 945/1877] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:06:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:06:09.734095 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce45458-37e1-43f5-a4f8-e1c648af912c None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:09.747911 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce45458-37e1-43f5-a4f8-e1c648af912c None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:09.755837 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f40a3-3711-48a0-a8d4-091bed334fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:09.756798 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f40a3-3711-48a0-a8d4-091bed334fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:09.757590 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f40a3-3711-48a0-a8d4-091bed334fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:09.758088 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f40a3-3711-48a0-a8d4-091bed334fe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:09.759367 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f40a3-3711-48a0-a8d4-091bed334fe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:09.793277 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f40a3-3711-48a0-a8d4-091bed334fe2 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:09.861372 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b32a7b-6793-42e9-a42f-90ba18e15c87 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:09.862704 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 933/1878] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:06:09 2021] POST /identity/v3/projects => generated 367 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:09.879737 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b32a7b-6793-42e9-a42f-90ba18e15c87 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:09.895615 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f40a3-3711-48a0-a8d4-091bed334fe2 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:09.897878 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-1c0f40a3-3711-48a0-a8d4-091bed334fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:09.974622 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1003d4-ba2a-42c0-94d6-7ad76e9906c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:09.975385 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1003d4-ba2a-42c0-94d6-7ad76e9906c5 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:09.975803 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1003d4-ba2a-42c0-94d6-7ad76e9906c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:09.976186 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1003d4-ba2a-42c0-94d6-7ad76e9906c5 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:09.977221 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1003d4-ba2a-42c0-94d6-7ad76e9906c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:10.014818 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1003d4-ba2a-42c0-94d6-7ad76e9906c5 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:10.057504 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 946/1879] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:06:09 2021] POST /identity/v3/users => generated 284 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:10.061346 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1003d4-ba2a-42c0-94d6-7ad76e9906c5 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:10.081440 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1003d4-ba2a-42c0-94d6-7ad76e9906c5 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:10.096318 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab057c-8e26-4efe-92f7-fd8f5c3e2573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:10.099786 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab057c-8e26-4efe-92f7-fd8f5c3e2573 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:10.100329 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab057c-8e26-4efe-92f7-fd8f5c3e2573 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:10.100831 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eab057c-8e26-4efe-92f7-fd8f5c3e2573 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:10.101778 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab057c-8e26-4efe-92f7-fd8f5c3e2573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:10.113910 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f40a3-3711-48a0-a8d4-091bed334fe2 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:10.131946 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e2ee6-bdb9-4312-a5d4-ba7f940b516f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:10.132767 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e2ee6-bdb9-4312-a5d4-ba7f940b516f admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:10.133328 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e2ee6-bdb9-4312-a5d4-ba7f940b516f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:10.133328 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e2ee6-bdb9-4312-a5d4-ba7f940b516f admin admin] PATH_INFO: `/v3/users/0b08d8db9a864685967515c603af51ec` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:10.135938 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e2ee6-bdb9-4312-a5d4-ba7f940b516f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b08d8db9a864685967515c603af51ec)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:10.146252 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eab057c-8e26-4efe-92f7-fd8f5c3e2573 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:10.182904 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 947/1880] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:10 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:06:10.188214 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab057c-8e26-4efe-92f7-fd8f5c3e2573 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:10.214221 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eab057c-8e26-4efe-92f7-fd8f5c3e2573 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:10.215836 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435e2ee6-bdb9-4312-a5d4-ba7f940b516f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:10.223350 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84f8d2-ec95-4b7d-a60a-f5e179406900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:10.225745 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84f8d2-ec95-4b7d-a60a-f5e179406900 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:10.226038 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84f8d2-ec95-4b7d-a60a-f5e179406900 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:10.226324 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84f8d2-ec95-4b7d-a60a-f5e179406900 admin admin] PATH_INFO: `/v3/projects/bbdbc71608614965a6f962cf977a08a1/users/884a643ed3f049e9878c9580ba540d7d/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:10.282795 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84f8d2-ec95-4b7d-a60a-f5e179406900 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbdbc71608614965a6f962cf977a08a1, user_id=884a643ed3f049e9878c9580ba540d7d, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:10.350488 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-435e2ee6-bdb9-4312-a5d4-ba7f940b516f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b08d8db9a864685967515c603af51ec'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:10.368944 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84f8d2-ec95-4b7d-a60a-f5e179406900 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:10.380393 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-435e2ee6-bdb9-4312-a5d4-ba7f940b516f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b08d8db9a864685967515c603af51ec'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:10.381480 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-435e2ee6-bdb9-4312-a5d4-ba7f940b516f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b08d8db9a864685967515c603af51ec'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:10.432056 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-435e2ee6-bdb9-4312-a5d4-ba7f940b516f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b08d8db9a864685967515c603af51ec'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:10.436026 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 948/1881] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:10 2021] PUT /identity/v3/projects/bbdbc71608614965a6f962cf977a08a1/users/884a643ed3f049e9878c9580ba540d7d/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:10.443887 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-435e2ee6-bdb9-4312-a5d4-ba7f940b516f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b08d8db9a864685967515c603af51ec'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:10.452292 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 934/1882] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:06:09 2021] DELETE /identity/v3/users/0b08d8db9a864685967515c603af51ec => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:06:10.457931 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d9773-f364-4d43-bce0-21a7c9bd44d4 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:10.459078 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980bc1f-8ad1-4690-84ac-ee9708e5337e None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:10.459590 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980bc1f-8ad1-4690-84ac-ee9708e5337e None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:10.460084 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d9773-f364-4d43-bce0-21a7c9bd44d4 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:10.460894 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980bc1f-8ad1-4690-84ac-ee9708e5337e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:10.462476 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d9773-f364-4d43-bce0-21a7c9bd44d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:10.520953 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-518d9773-f364-4d43-bce0-21a7c9bd44d4 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:10.522125 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-518d9773-f364-4d43-bce0-21a7c9bd44d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:10.557189 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-8980bc1f-8ad1-4690-84ac-ee9708e5337e None None] MFA Rules not processed for user `884a643ed3f049e9878c9580ba540d7d`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:10.558575 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-8980bc1f-8ad1-4690-84ac-ee9708e5337e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:10.677031 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 935/1883] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:10.678341 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d9773-f364-4d43-bce0-21a7c9bd44d4 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:10.679816 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-518d9773-f364-4d43-bce0-21a7c9bd44d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:10.699271 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d9773-f364-4d43-bce0-21a7c9bd44d4 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:10.711424 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d642ac-e0ba-44e3-b2e5-002c2ffe2778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:10.714130 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d642ac-e0ba-44e3-b2e5-002c2ffe2778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:10.714556 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d642ac-e0ba-44e3-b2e5-002c2ffe2778 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:10.714849 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d642ac-e0ba-44e3-b2e5-002c2ffe2778 admin admin] PATH_INFO: `/v3/users/1044ddfabd6541cd99d8743c08689832` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:10.716732 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d642ac-e0ba-44e3-b2e5-002c2ffe2778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1044ddfabd6541cd99d8743c08689832)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:10.756721 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d642ac-e0ba-44e3-b2e5-002c2ffe2778 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:10.783272 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 949/1884] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:10 2021] POST /identity/v3/auth/tokens => generated 3674 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:10.784305 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980bc1f-8ad1-4690-84ac-ee9708e5337e None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:10.794834 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-8980bc1f-8ad1-4690-84ac-ee9708e5337e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:10.841856 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-42d642ac-e0ba-44e3-b2e5-002c2ffe2778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1044ddfabd6541cd99d8743c08689832'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:10.872418 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-42d642ac-e0ba-44e3-b2e5-002c2ffe2778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1044ddfabd6541cd99d8743c08689832'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:10.873721 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-42d642ac-e0ba-44e3-b2e5-002c2ffe2778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1044ddfabd6541cd99d8743c08689832'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:10.887683 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-42d642ac-e0ba-44e3-b2e5-002c2ffe2778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1044ddfabd6541cd99d8743c08689832'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:10.901152 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-42d642ac-e0ba-44e3-b2e5-002c2ffe2778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1044ddfabd6541cd99d8743c08689832'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:10.912549 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980bc1f-8ad1-4690-84ac-ee9708e5337e None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:10.914574 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 936/1885] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:06:10 2021] DELETE /identity/v3/users/1044ddfabd6541cd99d8743c08689832 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:10.915318 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d642ac-e0ba-44e3-b2e5-002c2ffe2778 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:10.918122 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-42d642ac-e0ba-44e3-b2e5-002c2ffe2778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:11.022445 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2af8d-7cfa-480b-bf7e-e6ebbc845f22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:11.023164 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2af8d-7cfa-480b-bf7e-e6ebbc845f22 service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:11.023590 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2af8d-7cfa-480b-bf7e-e6ebbc845f22 service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:11.024045 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2af8d-7cfa-480b-bf7e-e6ebbc845f22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:11.030511 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-f1e2af8d-7cfa-480b-bf7e-e6ebbc845f22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:11.054275 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d642ac-e0ba-44e3-b2e5-002c2ffe2778 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:11.060408 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c20789-a2a1-4f04-aace-8670ef3cf26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:11.061778 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c20789-a2a1-4f04-aace-8670ef3cf26b admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:11.062842 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c20789-a2a1-4f04-aace-8670ef3cf26b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:11.063226 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c20789-a2a1-4f04-aace-8670ef3cf26b admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:11.064033 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c20789-a2a1-4f04-aace-8670ef3cf26b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:11.094529 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c20789-a2a1-4f04-aace-8670ef3cf26b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:11.145814 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 937/1886] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:06:10 2021] POST /identity/v3/projects => generated 365 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:11.147149 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aac728-ad98-4bdd-856f-c2ba7b1ac780 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:11.147475 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aac728-ad98-4bdd-856f-c2ba7b1ac780 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:11.147752 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aac728-ad98-4bdd-856f-c2ba7b1ac780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:11.203073 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2af8d-7cfa-480b-bf7e-e6ebbc845f22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:11.205278 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-b3aac728-ad98-4bdd-856f-c2ba7b1ac780 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:11.206834 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-b3aac728-ad98-4bdd-856f-c2ba7b1ac780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:11.304128 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2af8d-7cfa-480b-bf7e-e6ebbc845f22 service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:11.306333 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 938/1887] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:11.309812 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aac728-ad98-4bdd-856f-c2ba7b1ac780 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:11.312205 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-b3aac728-ad98-4bdd-856f-c2ba7b1ac780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:11.328396 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aac728-ad98-4bdd-856f-c2ba7b1ac780 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:11.334680 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff28c61-6c2b-4d0c-990e-e353351e9c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:11.336149 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff28c61-6c2b-4d0c-990e-e353351e9c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:11.336149 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff28c61-6c2b-4d0c-990e-e353351e9c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:11.336622 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff28c61-6c2b-4d0c-990e-e353351e9c1d admin admin] PATH_INFO: `/v3/users/86a5c5a45e2c4eed86b014d8a7d4c25b` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:11.337550 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 950/1888] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:06:10 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:06:11.338459 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff28c61-6c2b-4d0c-990e-e353351e9c1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=86a5c5a45e2c4eed86b014d8a7d4c25b)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:11.338950 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2af8d-7cfa-480b-bf7e-e6ebbc845f22 service neutron] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:11.353367 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2af8d-7cfa-480b-bf7e-e6ebbc845f22 service neutron] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:11.359157 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4c295-7d7c-495b-9ff4-0e3a423e69e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:11.359815 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4c295-7d7c-495b-9ff4-0e3a423e69e6 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:11.360242 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4c295-7d7c-495b-9ff4-0e3a423e69e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:11.360523 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4c295-7d7c-495b-9ff4-0e3a423e69e6 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:11.361162 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4c295-7d7c-495b-9ff4-0e3a423e69e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:11.372203 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff28c61-6c2b-4d0c-990e-e353351e9c1d admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:11.387079 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4c295-7d7c-495b-9ff4-0e3a423e69e6 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:11.430607 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 951/1889] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:06:11 2021] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:11.432206 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4c295-7d7c-495b-9ff4-0e3a423e69e6 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:11.435101 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-49f4c295-7d7c-495b-9ff4-0e3a423e69e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:11.454443 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-8ff28c61-6c2b-4d0c-990e-e353351e9c1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86a5c5a45e2c4eed86b014d8a7d4c25b'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:11.471660 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-8ff28c61-6c2b-4d0c-990e-e353351e9c1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86a5c5a45e2c4eed86b014d8a7d4c25b'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:11.472642 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-8ff28c61-6c2b-4d0c-990e-e353351e9c1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86a5c5a45e2c4eed86b014d8a7d4c25b'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:11.484618 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-8ff28c61-6c2b-4d0c-990e-e353351e9c1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86a5c5a45e2c4eed86b014d8a7d4c25b'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:11.498314 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-8ff28c61-6c2b-4d0c-990e-e353351e9c1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86a5c5a45e2c4eed86b014d8a7d4c25b'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:11.508644 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 939/1890] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:06:11 2021] DELETE /identity/v3/users/86a5c5a45e2c4eed86b014d8a7d4c25b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:11.509495 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff28c61-6c2b-4d0c-990e-e353351e9c1d admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:11.511566 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-8ff28c61-6c2b-4d0c-990e-e353351e9c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:11.561420 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4c295-7d7c-495b-9ff4-0e3a423e69e6 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:11.628061 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff28c61-6c2b-4d0c-990e-e353351e9c1d admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:11.633341 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81066d61-1e88-436c-82a8-7165188c36cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:11.634156 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81066d61-1e88-436c-82a8-7165188c36cf admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:11.634527 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81066d61-1e88-436c-82a8-7165188c36cf admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:11.634907 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81066d61-1e88-436c-82a8-7165188c36cf admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:11.636423 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81066d61-1e88-436c-82a8-7165188c36cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:11.662610 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9a021-aeea-4dc9-8a59-c5f2ef5dd679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:11.663289 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9a021-aeea-4dc9-8a59-c5f2ef5dd679 service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:11.663798 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9a021-aeea-4dc9-8a59-c5f2ef5dd679 service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:11.664177 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9a021-aeea-4dc9-8a59-c5f2ef5dd679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:11.666111 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-9ea9a021-aeea-4dc9-8a59-c5f2ef5dd679 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:11.679571 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9a021-aeea-4dc9-8a59-c5f2ef5dd679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:11.700295 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81066d61-1e88-436c-82a8-7165188c36cf admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:11.707308 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9a021-aeea-4dc9-8a59-c5f2ef5dd679 service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:11.715172 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 940/1891] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:11 2021] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:06:11.716992 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f9eaf-92bd-4370-a792-69133f22f170 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:11.717301 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f9eaf-92bd-4370-a792-69133f22f170 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:11.717590 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f9eaf-92bd-4370-a792-69133f22f170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:11.721200 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 952/1892] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:06:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:06:11.722237 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9a021-aeea-4dc9-8a59-c5f2ef5dd679 service neutron] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:11.733729 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9a021-aeea-4dc9-8a59-c5f2ef5dd679 service neutron] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:11.744764 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e24fa8-2c89-40f2-8816-4bbf0b26763d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:11.745995 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e24fa8-2c89-40f2-8816-4bbf0b26763d admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:11.746590 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e24fa8-2c89-40f2-8816-4bbf0b26763d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:11.747376 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e24fa8-2c89-40f2-8816-4bbf0b26763d admin admin] PATH_INFO: `/v3/projects/6d93142dee4f43de9f0d05ca23a7ad2e/users/ee7c7ee9073c44f0b3ed7a2e14d7a725/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:11.749524 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-f09f9eaf-92bd-4370-a792-69133f22f170 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:11.751503 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-f09f9eaf-92bd-4370-a792-69133f22f170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:11.761226 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 941/1893] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:11.773658 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f9eaf-92bd-4370-a792-69133f22f170 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:11.775304 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-f09f9eaf-92bd-4370-a792-69133f22f170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:11.807132 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f9eaf-92bd-4370-a792-69133f22f170 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:11.808931 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e24fa8-2c89-40f2-8816-4bbf0b26763d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d93142dee4f43de9f0d05ca23a7ad2e, user_id=ee7c7ee9073c44f0b3ed7a2e14d7a725, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:11.811525 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6679c-b1e7-4514-ac59-34955c0b05a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:11.812111 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6679c-b1e7-4514-ac59-34955c0b05a3 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:11.812396 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6679c-b1e7-4514-ac59-34955c0b05a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:11.812725 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6679c-b1e7-4514-ac59-34955c0b05a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:11.826576 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6679c-b1e7-4514-ac59-34955c0b05a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:11.858870 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6679c-b1e7-4514-ac59-34955c0b05a3 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:11.872638 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 942/1894] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:06:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:06:11.883804 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e24fa8-2c89-40f2-8816-4bbf0b26763d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:11.909983 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 953/1895] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:11 2021] PUT /identity/v3/projects/6d93142dee4f43de9f0d05ca23a7ad2e/users/ee7c7ee9073c44f0b3ed7a2e14d7a725/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:11.915841 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6679c-b1e7-4514-ac59-34955c0b05a3 service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:11.934190 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6679c-b1e7-4514-ac59-34955c0b05a3 service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:12.065909 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ee74f-d5ee-4f34-9104-dd8c88df2037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:12.066668 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ee74f-d5ee-4f34-9104-dd8c88df2037 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:12.067029 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ee74f-d5ee-4f34-9104-dd8c88df2037 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:12.067403 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ee74f-d5ee-4f34-9104-dd8c88df2037 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:12.068204 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ee74f-d5ee-4f34-9104-dd8c88df2037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:12.112371 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ee74f-d5ee-4f34-9104-dd8c88df2037 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:12.128390 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 943/1896] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:11 2021] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:06:12.134061 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e24fa8-2c89-40f2-8816-4bbf0b26763d admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:12.155741 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e24fa8-2c89-40f2-8816-4bbf0b26763d admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:12.161122 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3e993-1e2d-4860-9199-3f62a28d0243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:12.162002 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3e993-1e2d-4860-9199-3f62a28d0243 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:12.162288 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3e993-1e2d-4860-9199-3f62a28d0243 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:12.162840 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3e993-1e2d-4860-9199-3f62a28d0243 admin admin] PATH_INFO: `/v3/projects/6d93142dee4f43de9f0d05ca23a7ad2e/users/ee7c7ee9073c44f0b3ed7a2e14d7a725/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:12.165278 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3e993-1e2d-4860-9199-3f62a28d0243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d93142dee4f43de9f0d05ca23a7ad2e, user_id=ee7c7ee9073c44f0b3ed7a2e14d7a725, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:12.205919 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3e993-1e2d-4860-9199-3f62a28d0243 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:12.228981 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ee74f-d5ee-4f34-9104-dd8c88df2037 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:12.231240 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-b17ee74f-d5ee-4f34-9104-dd8c88df2037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:12.231367 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 954/1897] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:12 2021] PUT /identity/v3/projects/6d93142dee4f43de9f0d05ca23a7ad2e/users/ee7c7ee9073c44f0b3ed7a2e14d7a725/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:12.235565 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3e993-1e2d-4860-9199-3f62a28d0243 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:12.258133 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ee74f-d5ee-4f34-9104-dd8c88df2037 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:12.366780 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3e993-1e2d-4860-9199-3f62a28d0243 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:12.380581 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38497917-e6fb-4adb-9688-27d00e562588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:12.381406 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38497917-e6fb-4adb-9688-27d00e562588 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:12.381837 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38497917-e6fb-4adb-9688-27d00e562588 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:12.382281 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38497917-e6fb-4adb-9688-27d00e562588 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:12.383424 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38497917-e6fb-4adb-9688-27d00e562588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:12.451118 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea8b56-58a6-4ba6-99f1-499a2b50d56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:12.452844 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea8b56-58a6-4ba6-99f1-499a2b50d56f admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:12.453933 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea8b56-58a6-4ba6-99f1-499a2b50d56f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:12.463229 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea8b56-58a6-4ba6-99f1-499a2b50d56f admin admin] PATH_INFO: `/v3/projects/61c170a543f54581ba86ce4589fd1101` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:12.465835 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea8b56-58a6-4ba6-99f1-499a2b50d56f admin admin] RBAC: Authorizing `identity:delete_project(project_id=61c170a543f54581ba86ce4589fd1101)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:12.478257 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38497917-e6fb-4adb-9688-27d00e562588 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:12.512265 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 955/1898] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:12 2021] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:06:12.513434 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38497917-e6fb-4adb-9688-27d00e562588 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:12.532447 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38497917-e6fb-4adb-9688-27d00e562588 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:12.538933 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2241b-a6fe-4b4e-8a84-bec425d60ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:12.540085 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2241b-a6fe-4b4e-8a84-bec425d60ae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:12.540389 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2241b-a6fe-4b4e-8a84-bec425d60ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:12.540675 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2241b-a6fe-4b4e-8a84-bec425d60ae7 admin admin] PATH_INFO: `/v3/projects/6d93142dee4f43de9f0d05ca23a7ad2e/users/ee7c7ee9073c44f0b3ed7a2e14d7a725/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:12.543546 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd2241b-a6fe-4b4e-8a84-bec425d60ae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d93142dee4f43de9f0d05ca23a7ad2e, user_id=ee7c7ee9073c44f0b3ed7a2e14d7a725, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:12.581562 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd2241b-a6fe-4b4e-8a84-bec425d60ae7 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:12.601085 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea8b56-58a6-4ba6-99f1-499a2b50d56f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:12.613533 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 956/1899] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:12 2021] PUT /identity/v3/projects/6d93142dee4f43de9f0d05ca23a7ad2e/users/ee7c7ee9073c44f0b3ed7a2e14d7a725/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:12.617190 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa89cb-0fc5-4b3e-98f7-14c4ba5010b5 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:12.617190 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa89cb-0fc5-4b3e-98f7-14c4ba5010b5 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:12.617368 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efa89cb-0fc5-4b3e-98f7-14c4ba5010b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:12.686523 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-9efa89cb-0fc5-4b3e-98f7-14c4ba5010b5 None None] MFA Rules not processed for user `ee7c7ee9073c44f0b3ed7a2e14d7a725`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:12.687737 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-9efa89cb-0fc5-4b3e-98f7-14c4ba5010b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:12.742683 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-30ea8b56-58a6-4ba6-99f1-499a2b50d56f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61c170a543f54581ba86ce4589fd1101', 'request_id': 'req-30ea8b56-58a6-4ba6-99f1-499a2b50d56f'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:12.755845 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-30ea8b56-58a6-4ba6-99f1-499a2b50d56f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61c170a543f54581ba86ce4589fd1101', 'request_id': 'req-30ea8b56-58a6-4ba6-99f1-499a2b50d56f'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:12.796474 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-30ea8b56-58a6-4ba6-99f1-499a2b50d56f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61c170a543f54581ba86ce4589fd1101', 'request_id': 'req-30ea8b56-58a6-4ba6-99f1-499a2b50d56f'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:12.825870 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-30ea8b56-58a6-4ba6-99f1-499a2b50d56f admin admin] The token cache is being invalidate because project 61c170a543f54581ba86ce4589fd1101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:06:12.826365 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-30ea8b56-58a6-4ba6-99f1-499a2b50d56f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:12.828127 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-30ea8b56-58a6-4ba6-99f1-499a2b50d56f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:12.831294 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 944/1900] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:06:12 2021] DELETE /identity/v3/projects/61c170a543f54581ba86ce4589fd1101 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:06:12.835606 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea8b56-58a6-4ba6-99f1-499a2b50d56f admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:12.837103 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-30ea8b56-58a6-4ba6-99f1-499a2b50d56f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:12.852418 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 957/1901] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:12 2021] POST /identity/v3/auth/tokens => generated 3739 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:06:12.872248 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa89cb-0fc5-4b3e-98f7-14c4ba5010b5 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:12.873892 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-9efa89cb-0fc5-4b3e-98f7-14c4ba5010b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:12.981375 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efa89cb-0fc5-4b3e-98f7-14c4ba5010b5 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:13.024450 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea8b56-58a6-4ba6-99f1-499a2b50d56f admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:13.030034 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c037250-3bba-4854-ada9-ddd769dbdf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:13.030986 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c037250-3bba-4854-ada9-ddd769dbdf78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:13.031405 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c037250-3bba-4854-ada9-ddd769dbdf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:13.032056 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c037250-3bba-4854-ada9-ddd769dbdf78 admin admin] PATH_INFO: `/v3/users/45cd7c18da0247cabbdbeed5fbe18b07` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:13.033409 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c037250-3bba-4854-ada9-ddd769dbdf78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45cd7c18da0247cabbdbeed5fbe18b07)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:13.063585 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c037250-3bba-4854-ada9-ddd769dbdf78 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:13.108584 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776c918-0e20-42bf-8c6b-d635849cd562 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:13.109509 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776c918-0e20-42bf-8c6b-d635849cd562 service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:13.109892 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776c918-0e20-42bf-8c6b-d635849cd562 service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:13.110253 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e776c918-0e20-42bf-8c6b-d635849cd562 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:13.125564 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-e776c918-0e20-42bf-8c6b-d635849cd562 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:13.165124 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-1c037250-3bba-4854-ada9-ddd769dbdf78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45cd7c18da0247cabbdbeed5fbe18b07'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:13.188451 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-1c037250-3bba-4854-ada9-ddd769dbdf78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45cd7c18da0247cabbdbeed5fbe18b07'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:13.189946 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-1c037250-3bba-4854-ada9-ddd769dbdf78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45cd7c18da0247cabbdbeed5fbe18b07'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:13.221215 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-1c037250-3bba-4854-ada9-ddd769dbdf78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45cd7c18da0247cabbdbeed5fbe18b07'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:13.242623 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-1c037250-3bba-4854-ada9-ddd769dbdf78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45cd7c18da0247cabbdbeed5fbe18b07'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:13.258257 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 945/1902] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:06:12 2021] DELETE /identity/v3/users/45cd7c18da0247cabbdbeed5fbe18b07 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:06:13.259015 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c037250-3bba-4854-ada9-ddd769dbdf78 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:13.263710 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-1c037250-3bba-4854-ada9-ddd769dbdf78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:13.301863 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e776c918-0e20-42bf-8c6b-d635849cd562 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:13.370200 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e776c918-0e20-42bf-8c6b-d635849cd562 service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:13.397698 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 958/1903] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:06:12 2021] GET /identity/v3/auth/tokens => generated 3739 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:06:13.409053 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776c918-0e20-42bf-8c6b-d635849cd562 service cinder] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:13.410591 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-e776c918-0e20-42bf-8c6b-d635849cd562 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:13.434327 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e776c918-0e20-42bf-8c6b-d635849cd562 service cinder] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:13.620551 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d100b-a3c8-480b-b856-8e238cb50be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:13.622297 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d100b-a3c8-480b-b856-8e238cb50be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:13.622938 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d100b-a3c8-480b-b856-8e238cb50be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:13.623416 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d100b-a3c8-480b-b856-8e238cb50be0 admin admin] PATH_INFO: `/v3/projects/43ae0b5b9d22478ba661b0c31e118231` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:13.625886 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d100b-a3c8-480b-b856-8e238cb50be0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43ae0b5b9d22478ba661b0c31e118231)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:13.680307 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c037250-3bba-4854-ada9-ddd769dbdf78 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:13.694312 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e1b01-00cd-4e3f-b486-dad3e002934e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:13.695631 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e1b01-00cd-4e3f-b486-dad3e002934e admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:13.696267 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e1b01-00cd-4e3f-b486-dad3e002934e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:13.696786 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e1b01-00cd-4e3f-b486-dad3e002934e admin admin] PATH_INFO: `/v3/projects/e07ff6f5d64a43258c0d677996b535a6` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:13.699034 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d100b-a3c8-480b-b856-8e238cb50be0 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:13.699562 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e1b01-00cd-4e3f-b486-dad3e002934e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e07ff6f5d64a43258c0d677996b535a6)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:13.736440 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e1b01-00cd-4e3f-b486-dad3e002934e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:13.783601 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b72d100b-a3c8-480b-b856-8e238cb50be0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43ae0b5b9d22478ba661b0c31e118231', 'request_id': 'req-b72d100b-a3c8-480b-b856-8e238cb50be0'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:13.792441 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b72d100b-a3c8-480b-b856-8e238cb50be0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43ae0b5b9d22478ba661b0c31e118231', 'request_id': 'req-b72d100b-a3c8-480b-b856-8e238cb50be0'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:13.816134 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b72d100b-a3c8-480b-b856-8e238cb50be0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43ae0b5b9d22478ba661b0c31e118231', 'request_id': 'req-b72d100b-a3c8-480b-b856-8e238cb50be0'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:13.817904 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-601e1b01-00cd-4e3f-b486-dad3e002934e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e07ff6f5d64a43258c0d677996b535a6', 'request_id': 'req-601e1b01-00cd-4e3f-b486-dad3e002934e'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:13.825977 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-601e1b01-00cd-4e3f-b486-dad3e002934e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e07ff6f5d64a43258c0d677996b535a6', 'request_id': 'req-601e1b01-00cd-4e3f-b486-dad3e002934e'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:13.840889 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-601e1b01-00cd-4e3f-b486-dad3e002934e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e07ff6f5d64a43258c0d677996b535a6', 'request_id': 'req-601e1b01-00cd-4e3f-b486-dad3e002934e'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:13.856731 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b72d100b-a3c8-480b-b856-8e238cb50be0 admin admin] The token cache is being invalidate because project 43ae0b5b9d22478ba661b0c31e118231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:06:13.857208 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b72d100b-a3c8-480b-b856-8e238cb50be0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:13.857890 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-601e1b01-00cd-4e3f-b486-dad3e002934e admin admin] The token cache is being invalidate because project e07ff6f5d64a43258c0d677996b535a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:06:13.858594 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-601e1b01-00cd-4e3f-b486-dad3e002934e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:13.858947 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b72d100b-a3c8-480b-b856-8e238cb50be0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:13.859920 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-601e1b01-00cd-4e3f-b486-dad3e002934e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:13.861779 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 946/1904] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:06:13 2021] DELETE /identity/v3/projects/e07ff6f5d64a43258c0d677996b535a6 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:13.863038 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e1b01-00cd-4e3f-b486-dad3e002934e admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:13.863152 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 959/1905] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:06:13 2021] DELETE /identity/v3/projects/43ae0b5b9d22478ba661b0c31e118231 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:06:13.866476 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-601e1b01-00cd-4e3f-b486-dad3e002934e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:13.867681 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d100b-a3c8-480b-b856-8e238cb50be0 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:13.873193 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-b72d100b-a3c8-480b-b856-8e238cb50be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:13.973520 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e1b01-00cd-4e3f-b486-dad3e002934e admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:13.976679 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d100b-a3c8-480b-b856-8e238cb50be0 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:13.979530 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494bbfd-56c8-4bfe-b4f6-19141767f682 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:13.980178 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494bbfd-56c8-4bfe-b4f6-19141767f682 service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:13.980584 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494bbfd-56c8-4bfe-b4f6-19141767f682 service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:13.981109 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b494bbfd-56c8-4bfe-b4f6-19141767f682 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:13.985335 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-b494bbfd-56c8-4bfe-b4f6-19141767f682 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:14.084971 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495119df-8785-48e2-afad-2d973c7f515d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:14.085953 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495119df-8785-48e2-afad-2d973c7f515d admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:14.086301 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495119df-8785-48e2-afad-2d973c7f515d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:14.086584 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495119df-8785-48e2-afad-2d973c7f515d admin admin] PATH_INFO: `/v3/users/89ed5c415c894ced8255891ca1e0a5d3` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:14.088048 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495119df-8785-48e2-afad-2d973c7f515d admin admin] RBAC: Authorizing `identity:delete_user(user_id=89ed5c415c894ced8255891ca1e0a5d3)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:14.102796 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494bbfd-56c8-4bfe-b4f6-19141767f682 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:14.119255 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495119df-8785-48e2-afad-2d973c7f515d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:14.141086 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b494bbfd-56c8-4bfe-b4f6-19141767f682 service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:14.154152 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 947/1906] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:06:13 2021] GET /identity/v3/auth/tokens => generated 3674 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:06:14.155906 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494bbfd-56c8-4bfe-b4f6-19141767f682 service cinder] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:14.160376 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-b494bbfd-56c8-4bfe-b4f6-19141767f682 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:14.179409 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b494bbfd-56c8-4bfe-b4f6-19141767f682 service cinder] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:14.186957 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1bbfdc-88d1-4cfe-811d-0d564667bf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:14.188296 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bbfdc-88d1-4cfe-811d-0d564667bf64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:14.191318 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bbfdc-88d1-4cfe-811d-0d564667bf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:14.192876 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bbfdc-88d1-4cfe-811d-0d564667bf64 admin admin] PATH_INFO: `/v3/users/768b6c3e9faa49c7ae2aa2fe1c1aeb73` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:14.196526 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-495119df-8785-48e2-afad-2d973c7f515d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89ed5c415c894ced8255891ca1e0a5d3'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:14.198190 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-495119df-8785-48e2-afad-2d973c7f515d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89ed5c415c894ced8255891ca1e0a5d3'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:14.201505 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1bbfdc-88d1-4cfe-811d-0d564667bf64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=768b6c3e9faa49c7ae2aa2fe1c1aeb73)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:14.217990 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-495119df-8785-48e2-afad-2d973c7f515d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89ed5c415c894ced8255891ca1e0a5d3'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:14.229179 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-495119df-8785-48e2-afad-2d973c7f515d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89ed5c415c894ced8255891ca1e0a5d3'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:14.243610 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-495119df-8785-48e2-afad-2d973c7f515d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89ed5c415c894ced8255891ca1e0a5d3'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:14.255269 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 960/1907] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:06:13 2021] DELETE /identity/v3/users/89ed5c415c894ced8255891ca1e0a5d3 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:14.287954 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1bbfdc-88d1-4cfe-811d-0d564667bf64 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:14.400059 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-de1bbfdc-88d1-4cfe-811d-0d564667bf64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '768b6c3e9faa49c7ae2aa2fe1c1aeb73'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:14.430489 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-de1bbfdc-88d1-4cfe-811d-0d564667bf64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '768b6c3e9faa49c7ae2aa2fe1c1aeb73'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:14.432552 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-de1bbfdc-88d1-4cfe-811d-0d564667bf64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '768b6c3e9faa49c7ae2aa2fe1c1aeb73'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:14.446814 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-de1bbfdc-88d1-4cfe-811d-0d564667bf64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '768b6c3e9faa49c7ae2aa2fe1c1aeb73'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:14.460806 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-de1bbfdc-88d1-4cfe-811d-0d564667bf64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '768b6c3e9faa49c7ae2aa2fe1c1aeb73'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:14.469939 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 948/1908] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:06:14 2021] DELETE /identity/v3/users/768b6c3e9faa49c7ae2aa2fe1c1aeb73 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:14.561265 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495119df-8785-48e2-afad-2d973c7f515d admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:14.562552 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-495119df-8785-48e2-afad-2d973c7f515d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:14.714160 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495119df-8785-48e2-afad-2d973c7f515d admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:14.827485 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3e68a-cc9a-4b84-8ade-5095447be3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:14.828564 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3e68a-cc9a-4b84-8ade-5095447be3c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:14.829006 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3e68a-cc9a-4b84-8ade-5095447be3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:14.829425 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3e68a-cc9a-4b84-8ade-5095447be3c4 admin admin] PATH_INFO: `/v3/projects/ae9cf28c250b4c9ab9a67af0d57afc76` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:14.830712 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3e68a-cc9a-4b84-8ade-5095447be3c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae9cf28c250b4c9ab9a67af0d57afc76)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:14.868569 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3e68a-cc9a-4b84-8ade-5095447be3c4 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:15.065305 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-64a3e68a-cc9a-4b84-8ade-5095447be3c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae9cf28c250b4c9ab9a67af0d57afc76', 'request_id': 'req-64a3e68a-cc9a-4b84-8ade-5095447be3c4'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:15.101169 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-64a3e68a-cc9a-4b84-8ade-5095447be3c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae9cf28c250b4c9ab9a67af0d57afc76', 'request_id': 'req-64a3e68a-cc9a-4b84-8ade-5095447be3c4'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:15.119806 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-64a3e68a-cc9a-4b84-8ade-5095447be3c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae9cf28c250b4c9ab9a67af0d57afc76', 'request_id': 'req-64a3e68a-cc9a-4b84-8ade-5095447be3c4'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:15.141806 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-64a3e68a-cc9a-4b84-8ade-5095447be3c4 admin admin] The token cache is being invalidate because project ae9cf28c250b4c9ab9a67af0d57afc76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:06:15.142261 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-64a3e68a-cc9a-4b84-8ade-5095447be3c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:15.143630 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-64a3e68a-cc9a-4b84-8ade-5095447be3c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:15.146844 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 961/1909] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:06:14 2021] DELETE /identity/v3/projects/ae9cf28c250b4c9ab9a67af0d57afc76 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:15.154697 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b98d0-1548-48a1-bcd1-b2f6a4101cf3 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:15.155000 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b98d0-1548-48a1-bcd1-b2f6a4101cf3 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:15.155288 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b98d0-1548-48a1-bcd1-b2f6a4101cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:15.252988 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-ab9b98d0-1548-48a1-bcd1-b2f6a4101cf3 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:15.259101 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-ab9b98d0-1548-48a1-bcd1-b2f6a4101cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:15.459019 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 949/1910] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:15.461131 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb966d-ca68-42b9-86b7-b265e70b7794 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:15.461273 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb966d-ca68-42b9-86b7-b265e70b7794 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:15.461571 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfb966d-ca68-42b9-86b7-b265e70b7794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:15.507105 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-bbfb966d-ca68-42b9-86b7-b265e70b7794 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:15.508339 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-bbfb966d-ca68-42b9-86b7-b265e70b7794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:15.526008 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 962/1911] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:15 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:15.530934 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b98d0-1548-48a1-bcd1-b2f6a4101cf3 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:15.544431 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b98d0-1548-48a1-bcd1-b2f6a4101cf3 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:15.551639 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c25e26-312c-4dfe-aa3d-dd907f86b3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:15.552267 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c25e26-312c-4dfe-aa3d-dd907f86b3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:15.552905 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c25e26-312c-4dfe-aa3d-dd907f86b3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:15.553163 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c25e26-312c-4dfe-aa3d-dd907f86b3a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:15.553992 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c25e26-312c-4dfe-aa3d-dd907f86b3a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:06:15.554268 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c25e26-312c-4dfe-aa3d-dd907f86b3a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:15.601131 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c25e26-312c-4dfe-aa3d-dd907f86b3a9 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:15.619599 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 950/1912] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:06:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:06:15.623910 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb966d-ca68-42b9-86b7-b265e70b7794 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:15.636863 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfb966d-ca68-42b9-86b7-b265e70b7794 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:15.642416 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710327e-915e-443b-88cd-c386b6deb0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:15.642999 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710327e-915e-443b-88cd-c386b6deb0ad admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:15.643399 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710327e-915e-443b-88cd-c386b6deb0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:15.643633 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9710327e-915e-443b-88cd-c386b6deb0ad admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:15.645134 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710327e-915e-443b-88cd-c386b6deb0ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:15.675826 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9710327e-915e-443b-88cd-c386b6deb0ad admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:15.737176 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 963/1913] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:06:15 2021] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:06:15.748465 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c25e26-312c-4dfe-aa3d-dd907f86b3a9 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:15.765339 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c25e26-312c-4dfe-aa3d-dd907f86b3a9 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:15.824435 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710327e-915e-443b-88cd-c386b6deb0ad admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:15.826068 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-9710327e-915e-443b-88cd-c386b6deb0ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:15.912330 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064eac43-3751-4262-ba7d-2189066d901c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:15.913323 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eac43-3751-4262-ba7d-2189066d901c admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:15.913805 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eac43-3751-4262-ba7d-2189066d901c admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:15.914169 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064eac43-3751-4262-ba7d-2189066d901c admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:15.916020 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064eac43-3751-4262-ba7d-2189066d901c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:15.975500 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064eac43-3751-4262-ba7d-2189066d901c admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:16.038342 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 951/1914] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:06:15 2021] POST /identity/v3/users => generated 289 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:16.044037 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064eac43-3751-4262-ba7d-2189066d901c admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:16.063926 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064eac43-3751-4262-ba7d-2189066d901c admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:16.079253 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502056f-0ab8-4b32-954e-0bf3ea8cae78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:16.079935 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502056f-0ab8-4b32-954e-0bf3ea8cae78 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:16.080301 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502056f-0ab8-4b32-954e-0bf3ea8cae78 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:16.080502 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3502056f-0ab8-4b32-954e-0bf3ea8cae78 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:16.081534 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502056f-0ab8-4b32-954e-0bf3ea8cae78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:16.138421 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3502056f-0ab8-4b32-954e-0bf3ea8cae78 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:16.147388 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9710327e-915e-443b-88cd-c386b6deb0ad admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:16.159194 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79cda0-daf2-4f32-89d5-73bc191aa105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:16.159994 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79cda0-daf2-4f32-89d5-73bc191aa105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:16.160357 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79cda0-daf2-4f32-89d5-73bc191aa105 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:16.160555 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79cda0-daf2-4f32-89d5-73bc191aa105 admin admin] PATH_INFO: `/v3/projects/cd82917ced6f4cb9b189abb49b3acad0` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:16.167720 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 952/1915] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:16 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:06:16.167720 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502056f-0ab8-4b32-954e-0bf3ea8cae78 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:16.167974 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79cda0-daf2-4f32-89d5-73bc191aa105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd82917ced6f4cb9b189abb49b3acad0)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:16.177321 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-3502056f-0ab8-4b32-954e-0bf3ea8cae78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:16.209509 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3502056f-0ab8-4b32-954e-0bf3ea8cae78 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:16.223399 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79cda0-daf2-4f32-89d5-73bc191aa105 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:16.226746 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7cb824-7626-4f52-876d-f9527f80a117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:16.227893 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cb824-7626-4f52-876d-f9527f80a117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:16.228239 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cb824-7626-4f52-876d-f9527f80a117 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:16.229095 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7cb824-7626-4f52-876d-f9527f80a117 admin admin] PATH_INFO: `/v3/projects/5bd4754caa5f43cf8595ba3fb17d6386` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:16.232362 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cb824-7626-4f52-876d-f9527f80a117 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bd4754caa5f43cf8595ba3fb17d6386)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:16.284302 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7cb824-7626-4f52-876d-f9527f80a117 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:16.368152 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-cb79cda0-daf2-4f32-89d5-73bc191aa105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd82917ced6f4cb9b189abb49b3acad0', 'request_id': 'req-cb79cda0-daf2-4f32-89d5-73bc191aa105'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:16.382790 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-cb79cda0-daf2-4f32-89d5-73bc191aa105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd82917ced6f4cb9b189abb49b3acad0', 'request_id': 'req-cb79cda0-daf2-4f32-89d5-73bc191aa105'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:16.401012 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-cb79cda0-daf2-4f32-89d5-73bc191aa105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd82917ced6f4cb9b189abb49b3acad0', 'request_id': 'req-cb79cda0-daf2-4f32-89d5-73bc191aa105'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:16.411072 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-4e7cb824-7626-4f52-876d-f9527f80a117 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bd4754caa5f43cf8595ba3fb17d6386', 'request_id': 'req-4e7cb824-7626-4f52-876d-f9527f80a117'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:16.424108 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-4e7cb824-7626-4f52-876d-f9527f80a117 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bd4754caa5f43cf8595ba3fb17d6386', 'request_id': 'req-4e7cb824-7626-4f52-876d-f9527f80a117'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:16.427521 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-cb79cda0-daf2-4f32-89d5-73bc191aa105 admin admin] The token cache is being invalidate because project cd82917ced6f4cb9b189abb49b3acad0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:06:16.427878 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-cb79cda0-daf2-4f32-89d5-73bc191aa105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:16.428565 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-cb79cda0-daf2-4f32-89d5-73bc191aa105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:16.431380 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 964/1916] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:06:15 2021] DELETE /identity/v3/projects/cd82917ced6f4cb9b189abb49b3acad0 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:16.432823 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79cda0-daf2-4f32-89d5-73bc191aa105 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:16.434161 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-cb79cda0-daf2-4f32-89d5-73bc191aa105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:16.443530 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-4e7cb824-7626-4f52-876d-f9527f80a117 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bd4754caa5f43cf8595ba3fb17d6386', 'request_id': 'req-4e7cb824-7626-4f52-876d-f9527f80a117'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:16.461815 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-4e7cb824-7626-4f52-876d-f9527f80a117 admin admin] The token cache is being invalidate because project 5bd4754caa5f43cf8595ba3fb17d6386 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:06:16.463061 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-4e7cb824-7626-4f52-876d-f9527f80a117 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:16.464258 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-4e7cb824-7626-4f52-876d-f9527f80a117 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:16.466926 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 953/1917] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:06:16 2021] DELETE /identity/v3/projects/5bd4754caa5f43cf8595ba3fb17d6386 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:16.469059 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0d865-08e6-4cbc-a83e-b6235bca80d7 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:16.469639 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0d865-08e6-4cbc-a83e-b6235bca80d7 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:16.470380 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0d865-08e6-4cbc-a83e-b6235bca80d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:16.504166 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-10e0d865-08e6-4cbc-a83e-b6235bca80d7 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:16.505878 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-10e0d865-08e6-4cbc-a83e-b6235bca80d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:16.531144 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79cda0-daf2-4f32-89d5-73bc191aa105 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:16.631100 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d21f4-0520-42bc-bea4-06750fff4bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:16.632640 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d21f4-0520-42bc-bea4-06750fff4bd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:16.633429 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d21f4-0520-42bc-bea4-06750fff4bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:16.633851 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d21f4-0520-42bc-bea4-06750fff4bd1 admin admin] PATH_INFO: `/v3/projects/010b0163e9ee4b699b90288f9970fec3/users/7eca2e2a1c00459ba91ab7b1c3e26939/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:16.647303 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 954/1918] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:16.648765 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee913e-9050-4301-a363-7d641a53d2f9 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:16.649447 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee913e-9050-4301-a363-7d641a53d2f9 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:16.649707 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee913e-9050-4301-a363-7d641a53d2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:16.679549 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d21f4-0520-42bc-bea4-06750fff4bd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=010b0163e9ee4b699b90288f9970fec3, user_id=7eca2e2a1c00459ba91ab7b1c3e26939, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:16.700371 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-76ee913e-9050-4301-a363-7d641a53d2f9 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:16.703892 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-76ee913e-9050-4301-a363-7d641a53d2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:16.726658 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 955/1919] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:16.733996 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d21f4-0520-42bc-bea4-06750fff4bd1 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:16.737353 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116dc4d-97bc-40fe-a7d8-9ec3e17c59ca None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:16.738412 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116dc4d-97bc-40fe-a7d8-9ec3e17c59ca None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:16.738412 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116dc4d-97bc-40fe-a7d8-9ec3e17c59ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:16.762961 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 965/1920] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:16 2021] PUT /identity/v3/projects/010b0163e9ee4b699b90288f9970fec3/users/7eca2e2a1c00459ba91ab7b1c3e26939/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:16.765693 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3585e-de77-4dfc-933c-f340ee84b6d8 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:16.766264 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3585e-de77-4dfc-933c-f340ee84b6d8 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:16.766772 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3585e-de77-4dfc-933c-f340ee84b6d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:16.786888 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-f116dc4d-97bc-40fe-a7d8-9ec3e17c59ca None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:16.788322 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-f116dc4d-97bc-40fe-a7d8-9ec3e17c59ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:16.830456 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-7fd3585e-de77-4dfc-933c-f340ee84b6d8 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:16.831946 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-7fd3585e-de77-4dfc-933c-f340ee84b6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:16.954591 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 966/1921] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:16.955789 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6c700-8188-46e8-8e7e-a899cd6a30eb None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:16.956081 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6c700-8188-46e8-8e7e-a899cd6a30eb None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:16.956365 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6c700-8188-46e8-8e7e-a899cd6a30eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:16.965904 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 956/1922] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:16.971191 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116dc4d-97bc-40fe-a7d8-9ec3e17c59ca None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:16.988704 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116dc4d-97bc-40fe-a7d8-9ec3e17c59ca None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:16.994254 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5417d-7f68-41cb-a9bc-adbc3e171ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:16.994970 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5417d-7f68-41cb-a9bc-adbc3e171ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:16.995333 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5417d-7f68-41cb-a9bc-adbc3e171ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:16.995739 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5417d-7f68-41cb-a9bc-adbc3e171ad1 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:16.996942 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5417d-7f68-41cb-a9bc-adbc3e171ad1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:06:16.997322 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5417d-7f68-41cb-a9bc-adbc3e171ad1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:17.032082 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5417d-7f68-41cb-a9bc-adbc3e171ad1 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:17.049685 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-e2d6c700-8188-46e8-8e7e-a899cd6a30eb None None] MFA Rules not processed for user `7eca2e2a1c00459ba91ab7b1c3e26939`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:17.051149 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-e2d6c700-8188-46e8-8e7e-a899cd6a30eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:17.059317 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 957/1923] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:06:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:06:17.059317 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5417d-7f68-41cb-a9bc-adbc3e171ad1 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:17.071178 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5417d-7f68-41cb-a9bc-adbc3e171ad1 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:17.078241 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ba911-2245-4a87-b98a-203fdd1b5af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:17.079258 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ba911-2245-4a87-b98a-203fdd1b5af0 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:17.080033 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ba911-2245-4a87-b98a-203fdd1b5af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:17.080333 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ba911-2245-4a87-b98a-203fdd1b5af0 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:17.081137 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ba911-2245-4a87-b98a-203fdd1b5af0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:06:17.082015 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ba911-2245-4a87-b98a-203fdd1b5af0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:17.112740 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464ba911-2245-4a87-b98a-203fdd1b5af0 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:17.131684 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 958/1924] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:06:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:06:17.133450 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ba911-2245-4a87-b98a-203fdd1b5af0 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:17.152123 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ba911-2245-4a87-b98a-203fdd1b5af0 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:17.158404 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d93d65-dd1b-40d1-802e-31a39f8ce96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:17.159303 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d93d65-dd1b-40d1-802e-31a39f8ce96e admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:17.159846 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d93d65-dd1b-40d1-802e-31a39f8ce96e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:17.160362 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d93d65-dd1b-40d1-802e-31a39f8ce96e admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:17.161204 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d93d65-dd1b-40d1-802e-31a39f8ce96e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:17.169177 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 967/1925] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:16 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:17.170319 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6c700-8188-46e8-8e7e-a899cd6a30eb None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:17.186017 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6c700-8188-46e8-8e7e-a899cd6a30eb None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:17.191310 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d93d65-dd1b-40d1-802e-31a39f8ce96e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:17.192742 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48853378-94b1-49ad-b3f3-37d88eada6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:17.193450 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48853378-94b1-49ad-b3f3-37d88eada6bf admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:17.194055 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48853378-94b1-49ad-b3f3-37d88eada6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:17.195197 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48853378-94b1-49ad-b3f3-37d88eada6bf admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:17.195884 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48853378-94b1-49ad-b3f3-37d88eada6bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:17.238070 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48853378-94b1-49ad-b3f3-37d88eada6bf admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:17.245062 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 959/1926] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:06:17 2021] POST /identity/v3/projects => generated 361 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:17.246275 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d93d65-dd1b-40d1-802e-31a39f8ce96e admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:17.250178 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-26d93d65-dd1b-40d1-802e-31a39f8ce96e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:17.310454 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 968/1927] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:06:17 2021] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:17.315024 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48853378-94b1-49ad-b3f3-37d88eada6bf admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:17.401533 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d93d65-dd1b-40d1-802e-31a39f8ce96e admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:17.408208 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48853378-94b1-49ad-b3f3-37d88eada6bf admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:17.413937 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c5447-8bd0-4ea8-bb94-ec607cff5a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:17.414881 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c5447-8bd0-4ea8-bb94-ec607cff5a30 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:17.415410 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c5447-8bd0-4ea8-bb94-ec607cff5a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:17.416735 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517c5447-8bd0-4ea8-bb94-ec607cff5a30 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:17.417777 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c5447-8bd0-4ea8-bb94-ec607cff5a30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:17.423169 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01815dc8-d1f0-4c81-8f5a-1395bbe31a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:17.424237 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01815dc8-d1f0-4c81-8f5a-1395bbe31a01 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:17.425394 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01815dc8-d1f0-4c81-8f5a-1395bbe31a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:17.426176 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01815dc8-d1f0-4c81-8f5a-1395bbe31a01 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:17.426960 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01815dc8-d1f0-4c81-8f5a-1395bbe31a01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:17.453811 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01815dc8-d1f0-4c81-8f5a-1395bbe31a01 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:17.456918 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517c5447-8bd0-4ea8-bb94-ec607cff5a30 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:17.488003 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 969/1928] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:06:17 2021] POST /identity/v3/users => generated 281 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:17.488003 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c5447-8bd0-4ea8-bb94-ec607cff5a30 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:17.501814 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517c5447-8bd0-4ea8-bb94-ec607cff5a30 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:17.508007 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d2693-9090-49b5-b58a-adb9f12cd06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:17.509021 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d2693-9090-49b5-b58a-adb9f12cd06f admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:17.510320 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d2693-9090-49b5-b58a-adb9f12cd06f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:17.510736 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d2693-9090-49b5-b58a-adb9f12cd06f admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:17.511521 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d2693-9090-49b5-b58a-adb9f12cd06f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:17.520002 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 960/1929] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:06:17 2021] POST /identity/v3/projects => generated 377 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:17.521965 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01815dc8-d1f0-4c81-8f5a-1395bbe31a01 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:17.541172 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d2693-9090-49b5-b58a-adb9f12cd06f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:17.569086 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 970/1930] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:06:17 2021] POST /identity/v3/users => generated 286 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:17.569086 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d2693-9090-49b5-b58a-adb9f12cd06f admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:17.584332 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d2693-9090-49b5-b58a-adb9f12cd06f admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:17.655010 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01815dc8-d1f0-4c81-8f5a-1395bbe31a01 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:17.663101 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09febd05-b79f-4b6d-80ac-a1b2d5ddfa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:17.664504 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09febd05-b79f-4b6d-80ac-a1b2d5ddfa72 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:17.665312 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09febd05-b79f-4b6d-80ac-a1b2d5ddfa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:17.666100 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09febd05-b79f-4b6d-80ac-a1b2d5ddfa72 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:17.667491 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09febd05-b79f-4b6d-80ac-a1b2d5ddfa72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:17.671748 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b8594-f61f-4455-960a-1dc834fc5ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:17.672422 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b8594-f61f-4455-960a-1dc834fc5ee4 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:17.672882 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b8594-f61f-4455-960a-1dc834fc5ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:17.673216 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b8594-f61f-4455-960a-1dc834fc5ee4 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:17.673875 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b8594-f61f-4455-960a-1dc834fc5ee4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:17.703156 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09febd05-b79f-4b6d-80ac-a1b2d5ddfa72 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:17.715794 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b8594-f61f-4455-960a-1dc834fc5ee4 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:17.716766 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 961/1931] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:17 2021] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:06:17.718029 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09febd05-b79f-4b6d-80ac-a1b2d5ddfa72 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:17.730831 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09febd05-b79f-4b6d-80ac-a1b2d5ddfa72 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:17.736323 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c7634-20b4-41bc-bd0c-52580f9a695b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:17.736927 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c7634-20b4-41bc-bd0c-52580f9a695b admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:17.737363 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c7634-20b4-41bc-bd0c-52580f9a695b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:17.737652 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c7634-20b4-41bc-bd0c-52580f9a695b admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:17.738354 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c7634-20b4-41bc-bd0c-52580f9a695b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:17.742414 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 971/1932] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:06:17 2021] POST /identity/v3/users => generated 295 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:17.742414 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b8594-f61f-4455-960a-1dc834fc5ee4 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:17.754109 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b8594-f61f-4455-960a-1dc834fc5ee4 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:17.759263 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556eda2-945a-4830-afc6-f4e5544f6e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:17.761119 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556eda2-945a-4830-afc6-f4e5544f6e57 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:17.761515 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556eda2-945a-4830-afc6-f4e5544f6e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:17.761946 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556eda2-945a-4830-afc6-f4e5544f6e57 admin admin] PATH_INFO: `/v3/projects/d96a1cc27f9f4d78b698c915f89f7d6d/users/ac66c6c60f244c5ab40627e3500dc812/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:17.767397 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c7634-20b4-41bc-bd0c-52580f9a695b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:17.786478 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 962/1933] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:17 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:06:17.787965 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c7634-20b4-41bc-bd0c-52580f9a695b admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:17.793294 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556eda2-945a-4830-afc6-f4e5544f6e57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d96a1cc27f9f4d78b698c915f89f7d6d, user_id=ac66c6c60f244c5ab40627e3500dc812, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:17.799954 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c7634-20b4-41bc-bd0c-52580f9a695b admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:17.804914 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b2c01-8076-4564-abc8-9767b50863fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:17.805601 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b2c01-8076-4564-abc8-9767b50863fd admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:17.805979 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b2c01-8076-4564-abc8-9767b50863fd admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:17.806327 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b2c01-8076-4564-abc8-9767b50863fd admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:17.809131 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b2c01-8076-4564-abc8-9767b50863fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:17.838294 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b2c01-8076-4564-abc8-9767b50863fd admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:17.854353 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556eda2-945a-4830-afc6-f4e5544f6e57 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:17.857235 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 963/1934] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:17 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:06:17.858122 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b2c01-8076-4564-abc8-9767b50863fd admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:17.870064 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b2c01-8076-4564-abc8-9767b50863fd admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:17.878515 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416057e-1af8-473a-a492-addf7b987a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:17.879746 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416057e-1af8-473a-a492-addf7b987a5e admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:17.880266 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416057e-1af8-473a-a492-addf7b987a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:17.880708 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416057e-1af8-473a-a492-addf7b987a5e admin admin] PATH_INFO: `/v3/projects/c9d4d6a0ecba4290b590a12a4051a90d/users/f791235ef392464486ff71b1ca9d8f24/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:17.884666 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 972/1935] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:17 2021] PUT /identity/v3/projects/d96a1cc27f9f4d78b698c915f89f7d6d/users/ac66c6c60f244c5ab40627e3500dc812/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:17.885496 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556eda2-945a-4830-afc6-f4e5544f6e57 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:17.926655 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416057e-1af8-473a-a492-addf7b987a5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d4d6a0ecba4290b590a12a4051a90d, user_id=f791235ef392464486ff71b1ca9d8f24, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:17.988646 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416057e-1af8-473a-a492-addf7b987a5e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:17.989532 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556eda2-945a-4830-afc6-f4e5544f6e57 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:17.997395 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c3c6b-11e2-47cd-9a06-c59e6913f1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:17.998381 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c3c6b-11e2-47cd-9a06-c59e6913f1ce admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:17.998835 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c3c6b-11e2-47cd-9a06-c59e6913f1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:17.999304 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c3c6b-11e2-47cd-9a06-c59e6913f1ce admin admin] PATH_INFO: `/v3/projects/9ad3c953de67450b96b7f9df354ee36d/users/3269e4d8333f446ba9344018f22a85bc/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:18.018426 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 964/1936] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:17 2021] PUT /identity/v3/projects/c9d4d6a0ecba4290b590a12a4051a90d/users/f791235ef392464486ff71b1ca9d8f24/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:18.021084 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0ee80-3c00-40c0-b0a0-ccf726e4c288 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:18.021499 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0ee80-3c00-40c0-b0a0-ccf726e4c288 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:18.023011 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0ee80-3c00-40c0-b0a0-ccf726e4c288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:18.037280 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c3c6b-11e2-47cd-9a06-c59e6913f1ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad3c953de67450b96b7f9df354ee36d, user_id=3269e4d8333f446ba9344018f22a85bc, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:18.071686 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c3c6b-11e2-47cd-9a06-c59e6913f1ce admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:18.094684 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 973/1937] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:17 2021] PUT /identity/v3/projects/9ad3c953de67450b96b7f9df354ee36d/users/3269e4d8333f446ba9344018f22a85bc/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:18.096007 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bef9d-9515-4ff9-a400-638df4127bef None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:18.096299 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bef9d-9515-4ff9-a400-638df4127bef None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:18.096602 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bef9d-9515-4ff9-a400-638df4127bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:18.110986 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-16a0ee80-3c00-40c0-b0a0-ccf726e4c288 None None] MFA Rules not processed for user `ac66c6c60f244c5ab40627e3500dc812`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:18.112200 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-16a0ee80-3c00-40c0-b0a0-ccf726e4c288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:18.209111 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-688bef9d-9515-4ff9-a400-638df4127bef None None] MFA Rules not processed for user `f791235ef392464486ff71b1ca9d8f24`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:18.210616 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-688bef9d-9515-4ff9-a400-638df4127bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:18.345566 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 965/1938] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:18 2021] POST /identity/v3/auth/tokens => generated 3668 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:18.346767 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0ee80-3c00-40c0-b0a0-ccf726e4c288 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:18.430316 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 974/1939] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:18 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:18.543365 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bef9d-9515-4ff9-a400-638df4127bef None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:18.548814 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-688bef9d-9515-4ff9-a400-638df4127bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:18.554445 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0ee80-3c00-40c0-b0a0-ccf726e4c288 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:18.563147 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81abfe-7c33-41eb-b9bf-69e66eca06e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:18.566182 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81abfe-7c33-41eb-b9bf-69e66eca06e9 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:18.566480 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81abfe-7c33-41eb-b9bf-69e66eca06e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:18.566889 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a81abfe-7c33-41eb-b9bf-69e66eca06e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:18.567809 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a81abfe-7c33-41eb-b9bf-69e66eca06e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:18.597606 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a81abfe-7c33-41eb-b9bf-69e66eca06e9 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:18.617196 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 966/1940] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:18 2021] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:06:18.618608 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81abfe-7c33-41eb-b9bf-69e66eca06e9 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:18.630015 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a81abfe-7c33-41eb-b9bf-69e66eca06e9 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:18.634468 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533fd351-0a63-4db0-ab32-f1b00b2ad8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:18.635863 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fd351-0a63-4db0-ab32-f1b00b2ad8da admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:18.636159 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fd351-0a63-4db0-ab32-f1b00b2ad8da admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:18.636561 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fd351-0a63-4db0-ab32-f1b00b2ad8da admin admin] PATH_INFO: `/v3/projects/9ad3c953de67450b96b7f9df354ee36d/users/3269e4d8333f446ba9344018f22a85bc/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:18.643722 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533fd351-0a63-4db0-ab32-f1b00b2ad8da admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad3c953de67450b96b7f9df354ee36d, user_id=3269e4d8333f446ba9344018f22a85bc, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:18.661929 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bef9d-9515-4ff9-a400-638df4127bef None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:18.668995 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889149a-3995-4e63-a9a5-3945fd48c48e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:18.670328 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889149a-3995-4e63-a9a5-3945fd48c48e service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:18.670791 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889149a-3995-4e63-a9a5-3945fd48c48e service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:18.671225 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889149a-3995-4e63-a9a5-3945fd48c48e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:18.683220 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889149a-3995-4e63-a9a5-3945fd48c48e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:18.724932 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889149a-3995-4e63-a9a5-3945fd48c48e service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:18.749752 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533fd351-0a63-4db0-ab32-f1b00b2ad8da admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:18.755454 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 975/1941] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:06:18 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:06:18.757797 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddf70b-846a-4727-a559-7310ea346f72 None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:18.759136 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddf70b-846a-4727-a559-7310ea346f72 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:18.759423 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bddf70b-846a-4727-a559-7310ea346f72 None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:18.772700 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 976/1942] 10.222.0.89 () {54 vars in 961 bytes} [Wed Oct 27 15:06:18 2021] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:06:18.775881 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 967/1943] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:18 2021] PUT /identity/v3/projects/9ad3c953de67450b96b7f9df354ee36d/users/3269e4d8333f446ba9344018f22a85bc/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:18.780268 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533fd351-0a63-4db0-ab32-f1b00b2ad8da admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:18.783866 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98d527-15d8-4209-93c0-5737247a5489 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:18.784273 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98d527-15d8-4209-93c0-5737247a5489 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:18.785864 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98d527-15d8-4209-93c0-5737247a5489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:18.847196 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-4e98d527-15d8-4209-93c0-5737247a5489 None None] MFA Rules not processed for user `0fca8f0282ea40ce9b378260b95b3d01`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:18.849050 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-4e98d527-15d8-4209-93c0-5737247a5489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:18.915933 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533fd351-0a63-4db0-ab32-f1b00b2ad8da admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:18.921330 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b0049-0fb7-457b-9464-82fde9adaf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:18.922443 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b0049-0fb7-457b-9464-82fde9adaf4e admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:18.922995 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b0049-0fb7-457b-9464-82fde9adaf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:18.923344 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b0049-0fb7-457b-9464-82fde9adaf4e admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:18.925464 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b0049-0fb7-457b-9464-82fde9adaf4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:18.952577 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 977/1944] 10.222.0.89 () {58 vars in 1058 bytes} [Wed Oct 27 15:06:18 2021] POST /identity/v3/auth/tokens => generated 3550 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:18.953903 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98d527-15d8-4209-93c0-5737247a5489 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:18.956739 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9b0049-0fb7-457b-9464-82fde9adaf4e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:18.963389 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98d527-15d8-4209-93c0-5737247a5489 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:18.968329 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e07112-a151-4bb2-971f-18b223d0bf65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:18.969464 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e07112-a151-4bb2-971f-18b223d0bf65 service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:18.970333 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e07112-a151-4bb2-971f-18b223d0bf65 service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:18.970851 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e07112-a151-4bb2-971f-18b223d0bf65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:18.975362 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 968/1945] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:18 2021] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:06:18.977240 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b0049-0fb7-457b-9464-82fde9adaf4e admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:18.989017 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9b0049-0fb7-457b-9464-82fde9adaf4e admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:18.996641 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0e8b6-259b-48e5-bb83-a0fa2129636e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:18.998079 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0e8b6-259b-48e5-bb83-a0fa2129636e admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:18.998719 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0e8b6-259b-48e5-bb83-a0fa2129636e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:18.999402 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0e8b6-259b-48e5-bb83-a0fa2129636e admin admin] PATH_INFO: `/v3/projects/9ad3c953de67450b96b7f9df354ee36d/users/3269e4d8333f446ba9344018f22a85bc/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:19.006185 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0e8b6-259b-48e5-bb83-a0fa2129636e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad3c953de67450b96b7f9df354ee36d, user_id=3269e4d8333f446ba9344018f22a85bc, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:19.058709 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0e8b6-259b-48e5-bb83-a0fa2129636e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:19.075675 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e07112-a151-4bb2-971f-18b223d0bf65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:19.087047 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 969/1946] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:18 2021] PUT /identity/v3/projects/9ad3c953de67450b96b7f9df354ee36d/users/3269e4d8333f446ba9344018f22a85bc/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:19.089037 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f9def-d8fa-4d17-a156-5bec28935d3e None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:19.089351 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f9def-d8fa-4d17-a156-5bec28935d3e None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:19.089657 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f9def-d8fa-4d17-a156-5bec28935d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:19.114414 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e07112-a151-4bb2-971f-18b223d0bf65 service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:19.126973 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 978/1947] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:06:18 2021] GET /identity/v3/auth/tokens => generated 3668 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:06:19.153830 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-0c7f9def-d8fa-4d17-a156-5bec28935d3e None None] MFA Rules not processed for user `3269e4d8333f446ba9344018f22a85bc`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:19.157209 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-0c7f9def-d8fa-4d17-a156-5bec28935d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:19.288904 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 970/1948] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:19 2021] POST /identity/v3/auth/tokens => generated 3751 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:19.417083 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e07112-a151-4bb2-971f-18b223d0bf65 service cinder] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:19.426115 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e07112-a151-4bb2-971f-18b223d0bf65 service cinder] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:19.515675 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2509e-2231-488c-a404-86a014c01d3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:19.516319 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2509e-2231-488c-a404-86a014c01d3b service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:19.516611 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2509e-2231-488c-a404-86a014c01d3b service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:19.516893 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2509e-2231-488c-a404-86a014c01d3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:19.612688 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f9def-d8fa-4d17-a156-5bec28935d3e None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:19.655319 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2509e-2231-488c-a404-86a014c01d3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:19.702224 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2509e-2231-488c-a404-86a014c01d3b service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:19.713538 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 979/1949] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:06:19 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:06:19.815826 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f9def-d8fa-4d17-a156-5bec28935d3e None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:19.818882 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74cca2-daeb-4465-9778-dc8619d510cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:19.820035 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74cca2-daeb-4465-9778-dc8619d510cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:19.820475 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74cca2-daeb-4465-9778-dc8619d510cf admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:19.820735 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74cca2-daeb-4465-9778-dc8619d510cf admin admin] PATH_INFO: `/v3/users/ac66c6c60f244c5ab40627e3500dc812` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:19.821745 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74cca2-daeb-4465-9778-dc8619d510cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac66c6c60f244c5ab40627e3500dc812)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:19.855367 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74cca2-daeb-4465-9778-dc8619d510cf admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:19.940205 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-9b74cca2-daeb-4465-9778-dc8619d510cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac66c6c60f244c5ab40627e3500dc812'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:19.947392 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-9b74cca2-daeb-4465-9778-dc8619d510cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac66c6c60f244c5ab40627e3500dc812'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:19.948088 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-9b74cca2-daeb-4465-9778-dc8619d510cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac66c6c60f244c5ab40627e3500dc812'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:19.964373 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-9b74cca2-daeb-4465-9778-dc8619d510cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac66c6c60f244c5ab40627e3500dc812'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:19.976341 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-9b74cca2-daeb-4465-9778-dc8619d510cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac66c6c60f244c5ab40627e3500dc812'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:19.986198 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 971/1950] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:06:19 2021] DELETE /identity/v3/users/ac66c6c60f244c5ab40627e3500dc812 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:06:19.991205 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eece17-7465-4b3d-b033-30640814ed12 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:19.991935 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eece17-7465-4b3d-b033-30640814ed12 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:19.991935 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eece17-7465-4b3d-b033-30640814ed12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:20.023732 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-56eece17-7465-4b3d-b033-30640814ed12 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:20.024995 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-56eece17-7465-4b3d-b033-30640814ed12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:20.116063 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 980/1951] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:20.129712 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74cca2-daeb-4465-9778-dc8619d510cf admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:20.131912 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-9b74cca2-daeb-4465-9778-dc8619d510cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:20.221093 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74cca2-daeb-4465-9778-dc8619d510cf admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:20.227847 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ebc94-83e7-42d6-931f-c8f94b76aa1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:20.228543 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ebc94-83e7-42d6-931f-c8f94b76aa1f service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:20.229067 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ebc94-83e7-42d6-931f-c8f94b76aa1f service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:20.229567 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ebc94-83e7-42d6-931f-c8f94b76aa1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:20.242990 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ebc94-83e7-42d6-931f-c8f94b76aa1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:20.272906 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ebc94-83e7-42d6-931f-c8f94b76aa1f service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:20.288578 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 972/1952] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:06:20 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:06:20.441986 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51998bc4-b84d-40a2-af4f-9b5d126cdd59 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:20.442373 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51998bc4-b84d-40a2-af4f-9b5d126cdd59 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:20.442715 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51998bc4-b84d-40a2-af4f-9b5d126cdd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:20.467350 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-51998bc4-b84d-40a2-af4f-9b5d126cdd59 None None] MFA Rules not processed for user `7a86cdc90706440c8fa6bf9e101573b9`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:20.469305 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-51998bc4-b84d-40a2-af4f-9b5d126cdd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:20.568059 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 981/1953] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:20 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:20.759935 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ebc94-83e7-42d6-931f-c8f94b76aa1f service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:20.763965 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-048ebc94-83e7-42d6-931f-c8f94b76aa1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:20.783361 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ebc94-83e7-42d6-931f-c8f94b76aa1f service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:20.791955 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0fccf-e5b1-4e77-a17f-cd884b8dea63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:20.793322 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0fccf-e5b1-4e77-a17f-cd884b8dea63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:20.793757 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0fccf-e5b1-4e77-a17f-cd884b8dea63 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:20.794261 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0fccf-e5b1-4e77-a17f-cd884b8dea63 admin admin] PATH_INFO: `/v3/projects/d96a1cc27f9f4d78b698c915f89f7d6d` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:20.796313 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0fccf-e5b1-4e77-a17f-cd884b8dea63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d96a1cc27f9f4d78b698c915f89f7d6d)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:20.824918 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0fccf-e5b1-4e77-a17f-cd884b8dea63 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:20.889430 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-97e0fccf-e5b1-4e77-a17f-cd884b8dea63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd96a1cc27f9f4d78b698c915f89f7d6d', 'request_id': 'req-97e0fccf-e5b1-4e77-a17f-cd884b8dea63'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:20.894585 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-97e0fccf-e5b1-4e77-a17f-cd884b8dea63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd96a1cc27f9f4d78b698c915f89f7d6d', 'request_id': 'req-97e0fccf-e5b1-4e77-a17f-cd884b8dea63'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:20.907421 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-97e0fccf-e5b1-4e77-a17f-cd884b8dea63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd96a1cc27f9f4d78b698c915f89f7d6d', 'request_id': 'req-97e0fccf-e5b1-4e77-a17f-cd884b8dea63'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:20.921565 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-97e0fccf-e5b1-4e77-a17f-cd884b8dea63 admin admin] The token cache is being invalidate because project d96a1cc27f9f4d78b698c915f89f7d6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:06:20.922010 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-97e0fccf-e5b1-4e77-a17f-cd884b8dea63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:20.922762 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-97e0fccf-e5b1-4e77-a17f-cd884b8dea63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:20.924249 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 973/1954] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:06:20 2021] DELETE /identity/v3/projects/d96a1cc27f9f4d78b698c915f89f7d6d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:20.930907 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7ab71-6908-4e88-9d3b-da699be0a2ce None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:20.932379 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7ab71-6908-4e88-9d3b-da699be0a2ce None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:20.933302 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7ab71-6908-4e88-9d3b-da699be0a2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:20.970232 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-36c7ab71-6908-4e88-9d3b-da699be0a2ce None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:20.971648 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-36c7ab71-6908-4e88-9d3b-da699be0a2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:21.062267 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 982/1955] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:21.071488 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efce740-27a9-43be-9862-51d519c5c3a1 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:21.071864 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efce740-27a9-43be-9862-51d519c5c3a1 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:21.072225 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efce740-27a9-43be-9862-51d519c5c3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:21.109597 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-8efce740-27a9-43be-9862-51d519c5c3a1 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:21.110989 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-8efce740-27a9-43be-9862-51d519c5c3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:21.120764 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 974/1956] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:21.124577 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7ab71-6908-4e88-9d3b-da699be0a2ce None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:21.135214 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7ab71-6908-4e88-9d3b-da699be0a2ce None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:21.146530 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11788b8f-38c4-4b02-8fd9-a3e58c430390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:21.147150 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11788b8f-38c4-4b02-8fd9-a3e58c430390 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:21.147454 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11788b8f-38c4-4b02-8fd9-a3e58c430390 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:21.147928 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11788b8f-38c4-4b02-8fd9-a3e58c430390 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:21.148637 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11788b8f-38c4-4b02-8fd9-a3e58c430390 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:06:21.148938 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11788b8f-38c4-4b02-8fd9-a3e58c430390 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:21.207075 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11788b8f-38c4-4b02-8fd9-a3e58c430390 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:21.226885 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 983/1957] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:06:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:06:21.231530 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efce740-27a9-43be-9862-51d519c5c3a1 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:21.243606 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efce740-27a9-43be-9862-51d519c5c3a1 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:21.259912 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532e561-b9b4-4fc1-885d-ac62fde8356f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:21.260922 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532e561-b9b4-4fc1-885d-ac62fde8356f admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:21.261387 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532e561-b9b4-4fc1-885d-ac62fde8356f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:21.261872 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532e561-b9b4-4fc1-885d-ac62fde8356f admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:21.262671 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532e561-b9b4-4fc1-885d-ac62fde8356f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:21.341738 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532e561-b9b4-4fc1-885d-ac62fde8356f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:21.410751 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 975/1958] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:06:21 2021] POST /identity/v3/projects => generated 369 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:21.416526 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11788b8f-38c4-4b02-8fd9-a3e58c430390 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:21.428353 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11788b8f-38c4-4b02-8fd9-a3e58c430390 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:21.606619 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f798b-d9cc-431e-99fd-3d0936e4e5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:21.607960 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f798b-d9cc-431e-99fd-3d0936e4e5f3 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:21.608920 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f798b-d9cc-431e-99fd-3d0936e4e5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:21.609354 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f798b-d9cc-431e-99fd-3d0936e4e5f3 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:21.611132 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f798b-d9cc-431e-99fd-3d0936e4e5f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:21.651490 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f798b-d9cc-431e-99fd-3d0936e4e5f3 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:21.708288 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532e561-b9b4-4fc1-885d-ac62fde8356f admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:21.709200 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 984/1959] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:06:21 2021] POST /identity/v3/users => generated 285 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:21.729915 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532e561-b9b4-4fc1-885d-ac62fde8356f admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:21.735243 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d028a3-ef98-4395-a4e6-de24bb008a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:21.736492 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d028a3-ef98-4395-a4e6-de24bb008a2e admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:21.736927 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d028a3-ef98-4395-a4e6-de24bb008a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:21.737408 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d028a3-ef98-4395-a4e6-de24bb008a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:21.738402 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d028a3-ef98-4395-a4e6-de24bb008a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:21.770017 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d028a3-ef98-4395-a4e6-de24bb008a2e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:21.785590 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 976/1960] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:21 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:06:21.790285 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f798b-d9cc-431e-99fd-3d0936e4e5f3 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:21.806980 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f798b-d9cc-431e-99fd-3d0936e4e5f3 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:21.833870 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953ad72-99fb-4157-a75e-7c754b27ea97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:21.834955 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953ad72-99fb-4157-a75e-7c754b27ea97 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:21.835389 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953ad72-99fb-4157-a75e-7c754b27ea97 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:21.835849 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0953ad72-99fb-4157-a75e-7c754b27ea97 admin admin] PATH_INFO: `/v3/projects/73dc3b6d023a405287d6118b3a605dfd/users/5b2d9c357adf4d70b4d980d716f7a56e/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:21.876130 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953ad72-99fb-4157-a75e-7c754b27ea97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73dc3b6d023a405287d6118b3a605dfd, user_id=5b2d9c357adf4d70b4d980d716f7a56e, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:21.923320 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0953ad72-99fb-4157-a75e-7c754b27ea97 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:21.943280 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 985/1961] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:21 2021] PUT /identity/v3/projects/73dc3b6d023a405287d6118b3a605dfd/users/5b2d9c357adf4d70b4d980d716f7a56e/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:21.954687 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e74c6-5dcf-493b-97e6-f61973d571da None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:21.955207 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e74c6-5dcf-493b-97e6-f61973d571da None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:21.955479 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e74c6-5dcf-493b-97e6-f61973d571da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:22.012627 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-ff2e74c6-5dcf-493b-97e6-f61973d571da None None] MFA Rules not processed for user `5b2d9c357adf4d70b4d980d716f7a56e`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:22.013939 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-ff2e74c6-5dcf-493b-97e6-f61973d571da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:22.129293 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 977/1962] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:21 2021] POST /identity/v3/auth/tokens => generated 3676 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:22.141347 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953ad72-99fb-4157-a75e-7c754b27ea97 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:22.143092 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-0953ad72-99fb-4157-a75e-7c754b27ea97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:22.241517 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0953ad72-99fb-4157-a75e-7c754b27ea97 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:22.247403 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f3cab-8465-4138-a458-e0e606a48603 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c345fc642242469346303afbeda2f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:22.248857 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f3cab-8465-4138-a458-e0e606a48603 service glance] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:22.249475 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f3cab-8465-4138-a458-e0e606a48603 service glance] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:22.249921 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f3cab-8465-4138-a458-e0e606a48603 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:22.262037 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f3cab-8465-4138-a458-e0e606a48603 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:22.308889 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f3cab-8465-4138-a458-e0e606a48603 service glance] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:22.319420 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 986/1963] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:06:22 2021] GET /identity/v3/auth/tokens => generated 3676 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:06:26.640184 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e74c6-5dcf-493b-97e6-f61973d571da None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:26.641753 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-ff2e74c6-5dcf-493b-97e6-f61973d571da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:26.715896 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e74c6-5dcf-493b-97e6-f61973d571da None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:26.720515 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a36559-be13-4815-9f32-81de93d513e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:26.721115 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a36559-be13-4815-9f32-81de93d513e9 service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:26.721400 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a36559-be13-4815-9f32-81de93d513e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:26.721678 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a36559-be13-4815-9f32-81de93d513e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:26.723672 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-e7a36559-be13-4815-9f32-81de93d513e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:26.805281 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a36559-be13-4815-9f32-81de93d513e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:26.840169 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a36559-be13-4815-9f32-81de93d513e9 service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:26.850612 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 978/1964] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:06:26 2021] GET /identity/v3/auth/tokens => generated 3751 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:06:27.612921 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f3cab-8465-4138-a458-e0e606a48603 service glance] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:27.614406 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-1a7f3cab-8465-4138-a458-e0e606a48603 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:27.636579 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a36559-be13-4815-9f32-81de93d513e9 service cinder] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:27.636579 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-e7a36559-be13-4815-9f32-81de93d513e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:27.799723 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a36559-be13-4815-9f32-81de93d513e9 service cinder] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:27.806227 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d3d64-daf5-478d-9251-c6aa4402da0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:27.807241 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d3d64-daf5-478d-9251-c6aa4402da0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:27.807744 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d3d64-daf5-478d-9251-c6aa4402da0e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:27.808462 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d3d64-daf5-478d-9251-c6aa4402da0e admin admin] PATH_INFO: `/v3/users/884a643ed3f049e9878c9580ba540d7d` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:27.808766 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f3cab-8465-4138-a458-e0e606a48603 service glance] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:27.810134 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d3d64-daf5-478d-9251-c6aa4402da0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=884a643ed3f049e9878c9580ba540d7d)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:27.829652 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c2d4d-3bb0-41b7-97fe-13a668ed208d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:27.830726 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c2d4d-3bb0-41b7-97fe-13a668ed208d admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:27.831234 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c2d4d-3bb0-41b7-97fe-13a668ed208d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:27.831741 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c2d4d-3bb0-41b7-97fe-13a668ed208d admin admin] PATH_INFO: `/v3/users/f791235ef392464486ff71b1ca9d8f24` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:27.833105 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c2d4d-3bb0-41b7-97fe-13a668ed208d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f791235ef392464486ff71b1ca9d8f24)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:27.843094 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d3d64-daf5-478d-9251-c6aa4402da0e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:27.881756 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c2d4d-3bb0-41b7-97fe-13a668ed208d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:27.933124 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-660d3d64-daf5-478d-9251-c6aa4402da0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '884a643ed3f049e9878c9580ba540d7d'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:27.948961 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-660d3d64-daf5-478d-9251-c6aa4402da0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '884a643ed3f049e9878c9580ba540d7d'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:27.949737 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-660d3d64-daf5-478d-9251-c6aa4402da0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '884a643ed3f049e9878c9580ba540d7d'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:27.958587 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-660d3d64-daf5-478d-9251-c6aa4402da0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '884a643ed3f049e9878c9580ba540d7d'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:27.970116 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-660d3d64-daf5-478d-9251-c6aa4402da0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '884a643ed3f049e9878c9580ba540d7d'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:27.972660 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-6b3c2d4d-3bb0-41b7-97fe-13a668ed208d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f791235ef392464486ff71b1ca9d8f24'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:27.973418 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-6b3c2d4d-3bb0-41b7-97fe-13a668ed208d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f791235ef392464486ff71b1ca9d8f24'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:27.977790 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 979/1965] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:06:27 2021] DELETE /identity/v3/users/884a643ed3f049e9878c9580ba540d7d => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:06:27.982731 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671945c-2385-4dbc-a84d-1a42cca503e3 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:27.983101 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671945c-2385-4dbc-a84d-1a42cca503e3 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:27.983470 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671945c-2385-4dbc-a84d-1a42cca503e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:27.988876 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-6b3c2d4d-3bb0-41b7-97fe-13a668ed208d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f791235ef392464486ff71b1ca9d8f24'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:27.997705 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-6b3c2d4d-3bb0-41b7-97fe-13a668ed208d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f791235ef392464486ff71b1ca9d8f24'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:28.008150 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-6b3c2d4d-3bb0-41b7-97fe-13a668ed208d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f791235ef392464486ff71b1ca9d8f24'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:28.010409 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-9671945c-2385-4dbc-a84d-1a42cca503e3 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:28.013110 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-9671945c-2385-4dbc-a84d-1a42cca503e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:28.016447 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 987/1966] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:06:27 2021] DELETE /identity/v3/users/f791235ef392464486ff71b1ca9d8f24 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:28.021153 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2464d-04d3-4a3c-9dd1-b9f7a4a0e37a None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:28.021598 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2464d-04d3-4a3c-9dd1-b9f7a4a0e37a None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:28.022659 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2464d-04d3-4a3c-9dd1-b9f7a4a0e37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:28.048262 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-16f2464d-04d3-4a3c-9dd1-b9f7a4a0e37a None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:28.050009 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-16f2464d-04d3-4a3c-9dd1-b9f7a4a0e37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:28.126590 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 980/1967] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:27 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:28.157087 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671945c-2385-4dbc-a84d-1a42cca503e3 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:28.158276 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-9671945c-2385-4dbc-a84d-1a42cca503e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:28.163224 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 988/1968] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:28 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:06:28.175702 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2464d-04d3-4a3c-9dd1-b9f7a4a0e37a None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:28.177602 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-16f2464d-04d3-4a3c-9dd1-b9f7a4a0e37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:28.252084 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671945c-2385-4dbc-a84d-1a42cca503e3 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:28.323915 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2464d-04d3-4a3c-9dd1-b9f7a4a0e37a None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:28.332096 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe6c61-2c7a-40ae-a012-954c768a13d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:28.333115 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe6c61-2c7a-40ae-a012-954c768a13d8 service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:28.338219 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe6c61-2c7a-40ae-a012-954c768a13d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:28.338997 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe6c61-2c7a-40ae-a012-954c768a13d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:28.354290 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f5f5e-029c-4a43-bbde-e67ed837bc80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:28.354892 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f5f5e-029c-4a43-bbde-e67ed837bc80 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:28.355027 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe6c61-2c7a-40ae-a012-954c768a13d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:28.355193 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f5f5e-029c-4a43-bbde-e67ed837bc80 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:28.355473 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f5f5e-029c-4a43-bbde-e67ed837bc80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:28.365678 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f5f5e-029c-4a43-bbde-e67ed837bc80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:28.387090 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe6c61-2c7a-40ae-a012-954c768a13d8 service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:28.398048 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 989/1969] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:06:28 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:06:28.399902 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f5f5e-029c-4a43-bbde-e67ed837bc80 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:28.413576 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 981/1970] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:06:28 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:06:29.015651 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe6c61-2c7a-40ae-a012-954c768a13d8 service neutron] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:29.017430 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-3abe6c61-2c7a-40ae-a012-954c768a13d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:29.021900 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f5f5e-029c-4a43-bbde-e67ed837bc80 service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:29.023194 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-d27f5f5e-029c-4a43-bbde-e67ed837bc80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:29.033488 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe6c61-2c7a-40ae-a012-954c768a13d8 service neutron] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:29.039379 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbce29-1e4a-4dce-82cc-94470bba1c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:29.040262 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbce29-1e4a-4dce-82cc-94470bba1c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:29.040553 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbce29-1e4a-4dce-82cc-94470bba1c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:29.041408 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bbce29-1e4a-4dce-82cc-94470bba1c93 admin admin] PATH_INFO: `/v3/projects/bbdbc71608614965a6f962cf977a08a1` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:29.043504 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bbce29-1e4a-4dce-82cc-94470bba1c93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbdbc71608614965a6f962cf977a08a1)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:29.056176 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f5f5e-029c-4a43-bbde-e67ed837bc80 service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:29.061843 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac1dd5-aada-49a6-97b8-ce1329db8794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:29.061843 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac1dd5-aada-49a6-97b8-ce1329db8794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:29.061843 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac1dd5-aada-49a6-97b8-ce1329db8794 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:29.062134 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac1dd5-aada-49a6-97b8-ce1329db8794 admin admin] PATH_INFO: `/v3/projects/c9d4d6a0ecba4290b590a12a4051a90d` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:29.063249 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac1dd5-aada-49a6-97b8-ce1329db8794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9d4d6a0ecba4290b590a12a4051a90d)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:29.071077 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bbce29-1e4a-4dce-82cc-94470bba1c93 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:29.094182 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac1dd5-aada-49a6-97b8-ce1329db8794 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:29.125731 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-26bbce29-1e4a-4dce-82cc-94470bba1c93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbdbc71608614965a6f962cf977a08a1', 'request_id': 'req-26bbce29-1e4a-4dce-82cc-94470bba1c93'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:29.132229 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-26bbce29-1e4a-4dce-82cc-94470bba1c93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbdbc71608614965a6f962cf977a08a1', 'request_id': 'req-26bbce29-1e4a-4dce-82cc-94470bba1c93'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:29.143100 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-26bbce29-1e4a-4dce-82cc-94470bba1c93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbdbc71608614965a6f962cf977a08a1', 'request_id': 'req-26bbce29-1e4a-4dce-82cc-94470bba1c93'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:29.147206 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-83ac1dd5-aada-49a6-97b8-ce1329db8794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9d4d6a0ecba4290b590a12a4051a90d', 'request_id': 'req-83ac1dd5-aada-49a6-97b8-ce1329db8794'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:29.154026 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-83ac1dd5-aada-49a6-97b8-ce1329db8794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9d4d6a0ecba4290b590a12a4051a90d', 'request_id': 'req-83ac1dd5-aada-49a6-97b8-ce1329db8794'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:29.157695 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-26bbce29-1e4a-4dce-82cc-94470bba1c93 admin admin] The token cache is being invalidate because project bbdbc71608614965a6f962cf977a08a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:06:29.158056 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-26bbce29-1e4a-4dce-82cc-94470bba1c93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:29.158656 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-26bbce29-1e4a-4dce-82cc-94470bba1c93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:29.160119 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 990/1971] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:06:29 2021] DELETE /identity/v3/projects/bbdbc71608614965a6f962cf977a08a1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:29.164008 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbce29-1e4a-4dce-82cc-94470bba1c93 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:29.165249 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-26bbce29-1e4a-4dce-82cc-94470bba1c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:29.165376 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-83ac1dd5-aada-49a6-97b8-ce1329db8794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9d4d6a0ecba4290b590a12a4051a90d', 'request_id': 'req-83ac1dd5-aada-49a6-97b8-ce1329db8794'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:29.179073 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-83ac1dd5-aada-49a6-97b8-ce1329db8794 admin admin] The token cache is being invalidate because project c9d4d6a0ecba4290b590a12a4051a90d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:06:29.179471 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-83ac1dd5-aada-49a6-97b8-ce1329db8794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:29.180158 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-83ac1dd5-aada-49a6-97b8-ce1329db8794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:29.181690 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 982/1972] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:06:29 2021] DELETE /identity/v3/projects/c9d4d6a0ecba4290b590a12a4051a90d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:29.188085 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a16191-ee8e-4624-8cc2-b4ca195d8749 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:29.188377 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a16191-ee8e-4624-8cc2-b4ca195d8749 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:29.188654 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a16191-ee8e-4624-8cc2-b4ca195d8749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:29.211282 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-14a16191-ee8e-4624-8cc2-b4ca195d8749 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:29.212469 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-14a16191-ee8e-4624-8cc2-b4ca195d8749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:29.239474 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bbce29-1e4a-4dce-82cc-94470bba1c93 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:29.287343 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 983/1973] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:06:29.295578 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd56266-b3d5-449d-ab8d-846a6a4eea94 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:29.296492 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd56266-b3d5-449d-ab8d-846a6a4eea94 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:29.296962 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd56266-b3d5-449d-ab8d-846a6a4eea94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:29.311432 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed65a37-a17b-40ee-8279-b66ff3364515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:29.312376 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed65a37-a17b-40ee-8279-b66ff3364515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:29.312671 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed65a37-a17b-40ee-8279-b66ff3364515 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:29.312975 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed65a37-a17b-40ee-8279-b66ff3364515 admin admin] PATH_INFO: `/v3/users/ee7c7ee9073c44f0b3ed7a2e14d7a725` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:29.314137 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed65a37-a17b-40ee-8279-b66ff3364515 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee7c7ee9073c44f0b3ed7a2e14d7a725)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:29.321028 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-bfd56266-b3d5-449d-ab8d-846a6a4eea94 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:29.322190 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-bfd56266-b3d5-449d-ab8d-846a6a4eea94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:29.330225 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 984/1974] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:29.334557 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd56266-b3d5-449d-ab8d-846a6a4eea94 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:29.341671 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed65a37-a17b-40ee-8279-b66ff3364515 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:29.344395 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd56266-b3d5-449d-ab8d-846a6a4eea94 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:29.348788 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f78ba-a97f-467c-81d9-b614023c226f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:29.349373 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f78ba-a97f-467c-81d9-b614023c226f admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:29.349655 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f78ba-a97f-467c-81d9-b614023c226f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:29.349928 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f78ba-a97f-467c-81d9-b614023c226f admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:29.350607 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f78ba-a97f-467c-81d9-b614023c226f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:06:29.350901 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f78ba-a97f-467c-81d9-b614023c226f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:29.377603 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f78ba-a97f-467c-81d9-b614023c226f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:29.396285 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 985/1975] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:06:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 15:06:29.397304 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f78ba-a97f-467c-81d9-b614023c226f admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:29.402680 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-3ed65a37-a17b-40ee-8279-b66ff3364515 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee7c7ee9073c44f0b3ed7a2e14d7a725'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:29.403514 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-3ed65a37-a17b-40ee-8279-b66ff3364515 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee7c7ee9073c44f0b3ed7a2e14d7a725'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:29.408186 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f78ba-a97f-467c-81d9-b614023c226f admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:29.412421 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f6afa-c4b2-432b-8622-bf4268c23dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:29.413004 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f6afa-c4b2-432b-8622-bf4268c23dce admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:29.413290 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f6afa-c4b2-432b-8622-bf4268c23dce admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:29.413567 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f6afa-c4b2-432b-8622-bf4268c23dce admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:29.414325 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f6afa-c4b2-432b-8622-bf4268c23dce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:29.416170 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-3ed65a37-a17b-40ee-8279-b66ff3364515 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee7c7ee9073c44f0b3ed7a2e14d7a725'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:29.424824 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-3ed65a37-a17b-40ee-8279-b66ff3364515 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee7c7ee9073c44f0b3ed7a2e14d7a725'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:29.432926 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-3ed65a37-a17b-40ee-8279-b66ff3364515 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee7c7ee9073c44f0b3ed7a2e14d7a725'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:29.438969 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 991/1976] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:06:29 2021] DELETE /identity/v3/users/ee7c7ee9073c44f0b3ed7a2e14d7a725 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:29.443348 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f6afa-c4b2-432b-8622-bf4268c23dce admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:29.475154 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 986/1977] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:06:29 2021] POST /identity/v3/projects => generated 375 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:29.476368 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed65a37-a17b-40ee-8279-b66ff3364515 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:29.477689 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-3ed65a37-a17b-40ee-8279-b66ff3364515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:29.555357 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed65a37-a17b-40ee-8279-b66ff3364515 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:29.628009 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5ae2a-c2d3-4627-8a59-ded8cb2857cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:29.628636 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5ae2a-c2d3-4627-8a59-ded8cb2857cd admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:29.628929 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5ae2a-c2d3-4627-8a59-ded8cb2857cd admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:29.629211 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b5ae2a-c2d3-4627-8a59-ded8cb2857cd admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:29.629851 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5ae2a-c2d3-4627-8a59-ded8cb2857cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:29.657505 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b5ae2a-c2d3-4627-8a59-ded8cb2857cd admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:29.679779 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 992/1978] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:06:29 2021] POST /identity/v3/users => generated 288 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:29.683801 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f6afa-c4b2-432b-8622-bf4268c23dce admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:29.695069 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f6afa-c4b2-432b-8622-bf4268c23dce admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:29.700997 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64616912-6d98-4932-a751-76ded77ac436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:29.701611 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64616912-6d98-4932-a751-76ded77ac436 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:29.701901 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64616912-6d98-4932-a751-76ded77ac436 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:29.702183 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64616912-6d98-4932-a751-76ded77ac436 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:29.702898 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64616912-6d98-4932-a751-76ded77ac436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:29.729105 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64616912-6d98-4932-a751-76ded77ac436 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:29.740160 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 987/1979] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:29 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:06:29.744537 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5ae2a-c2d3-4627-8a59-ded8cb2857cd admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:29.754845 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b5ae2a-c2d3-4627-8a59-ded8cb2857cd admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:29.759069 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab44df-1d23-4d85-8257-5d587ae96bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:29.759918 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab44df-1d23-4d85-8257-5d587ae96bd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:29.760205 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab44df-1d23-4d85-8257-5d587ae96bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:29.760636 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab44df-1d23-4d85-8257-5d587ae96bd0 admin admin] PATH_INFO: `/v3/projects/01e55eab4a3c4752abc452cba0b4b93d/users/418c203199cc4d85a5d0ac5668e38810/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:29.781107 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab44df-1d23-4d85-8257-5d587ae96bd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01e55eab4a3c4752abc452cba0b4b93d, user_id=418c203199cc4d85a5d0ac5668e38810, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:29.808897 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab44df-1d23-4d85-8257-5d587ae96bd0 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:29.823804 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 993/1980] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:29 2021] PUT /identity/v3/projects/01e55eab4a3c4752abc452cba0b4b93d/users/418c203199cc4d85a5d0ac5668e38810/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:29.833967 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4a9e8-cdc9-43d9-9040-bc396ac5b602 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:29.834287 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4a9e8-cdc9-43d9-9040-bc396ac5b602 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:29.834585 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4a9e8-cdc9-43d9-9040-bc396ac5b602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:29.887908 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-7ee4a9e8-cdc9-43d9-9040-bc396ac5b602 None None] MFA Rules not processed for user `418c203199cc4d85a5d0ac5668e38810`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:29.889483 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-7ee4a9e8-cdc9-43d9-9040-bc396ac5b602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:29.957190 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab44df-1d23-4d85-8257-5d587ae96bd0 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:29.960916 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-90ab44df-1d23-4d85-8257-5d587ae96bd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:30.004765 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 988/1981] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:29 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:06:30.008303 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4a9e8-cdc9-43d9-9040-bc396ac5b602 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:30.047985 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab44df-1d23-4d85-8257-5d587ae96bd0 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:30.053248 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c1964-72f1-4091-8b31-7f762e2e0099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:30.054456 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c1964-72f1-4091-8b31-7f762e2e0099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:30.054819 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c1964-72f1-4091-8b31-7f762e2e0099 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:30.055171 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c1964-72f1-4091-8b31-7f762e2e0099 admin admin] PATH_INFO: `/v3/projects/6d93142dee4f43de9f0d05ca23a7ad2e` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:30.056519 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c1964-72f1-4091-8b31-7f762e2e0099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d93142dee4f43de9f0d05ca23a7ad2e)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:30.085558 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c1964-72f1-4091-8b31-7f762e2e0099 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:30.085774 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4a9e8-cdc9-43d9-9040-bc396ac5b602 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:30.090574 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d909c85-7cb1-4850-aac9-7a5fbc919dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:30.091715 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d909c85-7cb1-4850-aac9-7a5fbc919dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:30.091715 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d909c85-7cb1-4850-aac9-7a5fbc919dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:30.091966 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d909c85-7cb1-4850-aac9-7a5fbc919dd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:30.092515 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d909c85-7cb1-4850-aac9-7a5fbc919dd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:30.120871 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d909c85-7cb1-4850-aac9-7a5fbc919dd4 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:30.145018 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-2a9c1964-72f1-4091-8b31-7f762e2e0099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d93142dee4f43de9f0d05ca23a7ad2e', 'request_id': 'req-2a9c1964-72f1-4091-8b31-7f762e2e0099'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:30.152253 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-2a9c1964-72f1-4091-8b31-7f762e2e0099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d93142dee4f43de9f0d05ca23a7ad2e', 'request_id': 'req-2a9c1964-72f1-4091-8b31-7f762e2e0099'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:30.155140 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 989/1982] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:06:30 2021] POST /identity/v3/projects => generated 375 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:30.160456 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d909c85-7cb1-4850-aac9-7a5fbc919dd4 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:30.164717 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-2a9c1964-72f1-4091-8b31-7f762e2e0099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d93142dee4f43de9f0d05ca23a7ad2e', 'request_id': 'req-2a9c1964-72f1-4091-8b31-7f762e2e0099'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:30.180755 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-2a9c1964-72f1-4091-8b31-7f762e2e0099 admin admin] The token cache is being invalidate because project 6d93142dee4f43de9f0d05ca23a7ad2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:06:30.181167 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-2a9c1964-72f1-4091-8b31-7f762e2e0099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:30.181904 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-2a9c1964-72f1-4091-8b31-7f762e2e0099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:30.184639 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 994/1983] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:06:29 2021] DELETE /identity/v3/projects/6d93142dee4f43de9f0d05ca23a7ad2e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:30.191993 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18411d0-4d38-4719-ba2b-aa80ca5e690f None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:30.192289 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18411d0-4d38-4719-ba2b-aa80ca5e690f None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:30.192572 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18411d0-4d38-4719-ba2b-aa80ca5e690f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:30.216053 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-a18411d0-4d38-4719-ba2b-aa80ca5e690f None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:30.222430 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-a18411d0-4d38-4719-ba2b-aa80ca5e690f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:30.244547 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d909c85-7cb1-4850-aac9-7a5fbc919dd4 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:30.250901 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881db2d-dd66-4042-b016-e8f6dd3705d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:30.251550 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881db2d-dd66-4042-b016-e8f6dd3705d7 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:30.251966 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881db2d-dd66-4042-b016-e8f6dd3705d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:30.252254 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881db2d-dd66-4042-b016-e8f6dd3705d7 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:30.252901 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a881db2d-dd66-4042-b016-e8f6dd3705d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:30.280315 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a881db2d-dd66-4042-b016-e8f6dd3705d7 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:30.295956 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 995/1984] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:06:30.306707 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ea42f-1d2d-419d-8f98-56ce1fe16d59 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:30.307361 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ea42f-1d2d-419d-8f98-56ce1fe16d59 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:30.308131 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3ea42f-1d2d-419d-8f98-56ce1fe16d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:30.312260 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 990/1985] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:06:30 2021] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:30.315634 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881db2d-dd66-4042-b016-e8f6dd3705d7 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:30.317731 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-a881db2d-dd66-4042-b016-e8f6dd3705d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:30.331007 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881db2d-dd66-4042-b016-e8f6dd3705d7 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:30.335318 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-2a3ea42f-1d2d-419d-8f98-56ce1fe16d59 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:30.336576 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-2a3ea42f-1d2d-419d-8f98-56ce1fe16d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:30.337048 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24fea1-ccea-42bf-8175-01e0e7d99f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:30.337854 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24fea1-ccea-42bf-8175-01e0e7d99f11 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:30.338228 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24fea1-ccea-42bf-8175-01e0e7d99f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:30.338593 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24fea1-ccea-42bf-8175-01e0e7d99f11 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:30.339490 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24fea1-ccea-42bf-8175-01e0e7d99f11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:30.345249 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 996/1986] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:30.349227 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ea42f-1d2d-419d-8f98-56ce1fe16d59 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:30.357839 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3ea42f-1d2d-419d-8f98-56ce1fe16d59 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:30.366202 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24fea1-ccea-42bf-8175-01e0e7d99f11 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:30.367892 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db06b4-7e91-4417-b046-42e19d7c390d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:30.368891 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db06b4-7e91-4417-b046-42e19d7c390d admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:30.369230 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db06b4-7e91-4417-b046-42e19d7c390d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:30.369575 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74db06b4-7e91-4417-b046-42e19d7c390d admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:30.370323 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db06b4-7e91-4417-b046-42e19d7c390d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:06:30.373178 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db06b4-7e91-4417-b046-42e19d7c390d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:30.380889 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 991/1987] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:30 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:06:30.384734 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24fea1-ccea-42bf-8175-01e0e7d99f11 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:30.394934 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24fea1-ccea-42bf-8175-01e0e7d99f11 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:30.399243 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce9cad-7dfc-4aee-9c24-8d240a1d02f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:30.400106 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce9cad-7dfc-4aee-9c24-8d240a1d02f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:30.400395 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce9cad-7dfc-4aee-9c24-8d240a1d02f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:30.400673 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce9cad-7dfc-4aee-9c24-8d240a1d02f3 admin admin] PATH_INFO: `/v3/projects/d1567a279cf94da688000a332d4b58da/users/19d51b6ba3b94f4abff29496a989a128/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:30.403639 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74db06b4-7e91-4417-b046-42e19d7c390d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:30.419328 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 997/1988] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:06:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 15:06:30.423953 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db06b4-7e91-4417-b046-42e19d7c390d admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:30.425552 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce9cad-7dfc-4aee-9c24-8d240a1d02f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1567a279cf94da688000a332d4b58da, user_id=19d51b6ba3b94f4abff29496a989a128, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:30.435479 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74db06b4-7e91-4417-b046-42e19d7c390d admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:30.439687 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e38de-b841-4bba-8c77-e2ceaa3374ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:30.440624 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e38de-b841-4bba-8c77-e2ceaa3374ce admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:30.440928 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e38de-b841-4bba-8c77-e2ceaa3374ce admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:30.441293 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336e38de-b841-4bba-8c77-e2ceaa3374ce admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:30.442004 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e38de-b841-4bba-8c77-e2ceaa3374ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:30.454401 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce9cad-7dfc-4aee-9c24-8d240a1d02f3 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:30.468932 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336e38de-b841-4bba-8c77-e2ceaa3374ce admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:30.469122 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 992/1989] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:30 2021] PUT /identity/v3/projects/d1567a279cf94da688000a332d4b58da/users/19d51b6ba3b94f4abff29496a989a128/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:06:30.480036 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e788b-0657-41f1-a2bd-513cdc1fd0b9 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:30.480333 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e788b-0657-41f1-a2bd-513cdc1fd0b9 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:30.480628 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e788b-0657-41f1-a2bd-513cdc1fd0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:30.507497 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 998/1990] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:06:30 2021] POST /identity/v3/projects => generated 363 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:06:30.508700 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e38de-b841-4bba-8c77-e2ceaa3374ce admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:30.526255 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-a80e788b-0657-41f1-a2bd-513cdc1fd0b9 None None] MFA Rules not processed for user `19d51b6ba3b94f4abff29496a989a128`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:30.528241 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-a80e788b-0657-41f1-a2bd-513cdc1fd0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:30.604819 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336e38de-b841-4bba-8c77-e2ceaa3374ce admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:30.610633 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd025bb2-31aa-4cad-81a9-f5603de7a32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:30.611694 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd025bb2-31aa-4cad-81a9-f5603de7a32f admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:30.612121 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd025bb2-31aa-4cad-81a9-f5603de7a32f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:30.612217 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd025bb2-31aa-4cad-81a9-f5603de7a32f admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:30.612970 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd025bb2-31aa-4cad-81a9-f5603de7a32f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:30.619587 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 993/1991] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:30 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:06:30.625432 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e788b-0657-41f1-a2bd-513cdc1fd0b9 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:30.639993 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e788b-0657-41f1-a2bd-513cdc1fd0b9 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:30.645029 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd025bb2-31aa-4cad-81a9-f5603de7a32f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:30.645159 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7eaeb-2503-4005-b7c9-5917c92d3c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:30.645954 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7eaeb-2503-4005-b7c9-5917c92d3c62 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:30.646371 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7eaeb-2503-4005-b7c9-5917c92d3c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:30.646747 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7eaeb-2503-4005-b7c9-5917c92d3c62 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:30.647519 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7eaeb-2503-4005-b7c9-5917c92d3c62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:30.677385 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b7eaeb-2503-4005-b7c9-5917c92d3c62 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:30.686315 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 999/1992] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:06:30 2021] POST /identity/v3/users => generated 282 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:30.689659 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd025bb2-31aa-4cad-81a9-f5603de7a32f admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:30.702909 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd025bb2-31aa-4cad-81a9-f5603de7a32f admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:30.707652 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd0b41-533a-4441-aef8-42625b24a9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:30.708370 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd0b41-533a-4441-aef8-42625b24a9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:30.708701 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd0b41-533a-4441-aef8-42625b24a9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:30.709141 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd0b41-533a-4441-aef8-42625b24a9f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:30.709841 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd0b41-533a-4441-aef8-42625b24a9f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:30.719541 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 994/1993] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:06:30 2021] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:30.720501 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7eaeb-2503-4005-b7c9-5917c92d3c62 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:30.735674 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd0b41-533a-4441-aef8-42625b24a9f3 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:30.762387 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1000/1994] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:30 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:06:30.768789 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd0b41-533a-4441-aef8-42625b24a9f3 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:30.778685 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd0b41-533a-4441-aef8-42625b24a9f3 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:30.808543 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7eaeb-2503-4005-b7c9-5917c92d3c62 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:30.813462 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d585e20-5e0b-4279-85c9-1917ecac8a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:30.814066 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d585e20-5e0b-4279-85c9-1917ecac8a61 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:30.814348 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d585e20-5e0b-4279-85c9-1917ecac8a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:30.814622 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d585e20-5e0b-4279-85c9-1917ecac8a61 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:30.815258 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d585e20-5e0b-4279-85c9-1917ecac8a61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:30.841528 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d585e20-5e0b-4279-85c9-1917ecac8a61 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:30.848183 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458d0b3-8a3a-40e6-af61-b2b87a517bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:30.849010 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458d0b3-8a3a-40e6-af61-b2b87a517bde admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:30.849301 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458d0b3-8a3a-40e6-af61-b2b87a517bde admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:30.849584 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458d0b3-8a3a-40e6-af61-b2b87a517bde admin admin] PATH_INFO: `/v3/projects/191c3f8e83074cc4abd2f23a9152a908/users/7c6578de087b4b4eb75da0aa3f7bc974/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:30.863713 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 995/1995] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:06:30 2021] POST /identity/v3/users => generated 295 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:30.867904 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d585e20-5e0b-4279-85c9-1917ecac8a61 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:30.871778 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458d0b3-8a3a-40e6-af61-b2b87a517bde admin admin] RBAC: Authorizing `identity:create_grant(project_id=191c3f8e83074cc4abd2f23a9152a908, user_id=7c6578de087b4b4eb75da0aa3f7bc974, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:30.883672 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d585e20-5e0b-4279-85c9-1917ecac8a61 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:30.888783 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ca671-3bee-499a-93b9-237465cea585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:30.889390 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ca671-3bee-499a-93b9-237465cea585 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:30.889676 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ca671-3bee-499a-93b9-237465cea585 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:30.889954 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ca671-3bee-499a-93b9-237465cea585 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:30.890823 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ca671-3bee-499a-93b9-237465cea585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:30.899188 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7458d0b3-8a3a-40e6-af61-b2b87a517bde admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:30.912760 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1001/1996] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:30 2021] PUT /identity/v3/projects/191c3f8e83074cc4abd2f23a9152a908/users/7c6578de087b4b4eb75da0aa3f7bc974/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:06:30.922263 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8ca671-3bee-499a-93b9-237465cea585 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:30.927077 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722990c-c750-49f0-97bf-69ecd226a1ca None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:30.927372 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722990c-c750-49f0-97bf-69ecd226a1ca None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:30.927693 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722990c-c750-49f0-97bf-69ecd226a1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:30.935477 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 996/1997] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:30 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:06:30.940093 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ca671-3bee-499a-93b9-237465cea585 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:30.955142 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ca671-3bee-499a-93b9-237465cea585 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:30.975589 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-6722990c-c750-49f0-97bf-69ecd226a1ca None None] MFA Rules not processed for user `7c6578de087b4b4eb75da0aa3f7bc974`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:30.976786 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-6722990c-c750-49f0-97bf-69ecd226a1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:31.046997 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35772af-884b-49ce-aecc-952693bd9dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:31.047878 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35772af-884b-49ce-aecc-952693bd9dfd admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:31.048171 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35772af-884b-49ce-aecc-952693bd9dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:31.048472 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35772af-884b-49ce-aecc-952693bd9dfd admin admin] PATH_INFO: `/v3/projects/70403f62501244a59f4ca35c7c6fd0a4/users/c6cd1a6b93034906b315065f09fef50c/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:31.069041 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1002/1998] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:30 2021] POST /identity/v3/auth/tokens => generated 3670 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:31.074153 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35772af-884b-49ce-aecc-952693bd9dfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=70403f62501244a59f4ca35c7c6fd0a4, user_id=c6cd1a6b93034906b315065f09fef50c, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:31.079554 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722990c-c750-49f0-97bf-69ecd226a1ca None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:31.081058 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-6722990c-c750-49f0-97bf-69ecd226a1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:31.108677 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35772af-884b-49ce-aecc-952693bd9dfd admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:31.123839 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 997/1999] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:30 2021] PUT /identity/v3/projects/70403f62501244a59f4ca35c7c6fd0a4/users/c6cd1a6b93034906b315065f09fef50c/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:06:31.128244 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35772af-884b-49ce-aecc-952693bd9dfd admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:31.163746 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722990c-c750-49f0-97bf-69ecd226a1ca None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:31.205623 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35772af-884b-49ce-aecc-952693bd9dfd admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:31.209995 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182dbeda-cf1a-49bb-a4e1-f6bff89cb46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:31.210590 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182dbeda-cf1a-49bb-a4e1-f6bff89cb46e admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:31.210875 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182dbeda-cf1a-49bb-a4e1-f6bff89cb46e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:31.211153 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182dbeda-cf1a-49bb-a4e1-f6bff89cb46e admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:31.211895 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182dbeda-cf1a-49bb-a4e1-f6bff89cb46e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:31.227288 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65c9c1-28b3-416e-a243-2707c46e819c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:31.228167 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65c9c1-28b3-416e-a243-2707c46e819c service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:31.228538 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65c9c1-28b3-416e-a243-2707c46e819c service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:31.228984 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a65c9c1-28b3-416e-a243-2707c46e819c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:31.239203 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182dbeda-cf1a-49bb-a4e1-f6bff89cb46e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:31.250799 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 998/2000] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:31 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:06:31.255140 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182dbeda-cf1a-49bb-a4e1-f6bff89cb46e admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:31.264780 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182dbeda-cf1a-49bb-a4e1-f6bff89cb46e admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:31.269969 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871325b9-a8f2-4943-9d1b-5d4236bc9269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:31.270781 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871325b9-a8f2-4943-9d1b-5d4236bc9269 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:31.271063 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871325b9-a8f2-4943-9d1b-5d4236bc9269 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:31.271342 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871325b9-a8f2-4943-9d1b-5d4236bc9269 admin admin] PATH_INFO: `/v3/projects/70403f62501244a59f4ca35c7c6fd0a4/users/c6cd1a6b93034906b315065f09fef50c/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:31.273140 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871325b9-a8f2-4943-9d1b-5d4236bc9269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70403f62501244a59f4ca35c7c6fd0a4, user_id=c6cd1a6b93034906b315065f09fef50c, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:31.303217 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871325b9-a8f2-4943-9d1b-5d4236bc9269 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:31.307310 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65c9c1-28b3-416e-a243-2707c46e819c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:31.313908 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 999/2001] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:31 2021] PUT /identity/v3/projects/70403f62501244a59f4ca35c7c6fd0a4/users/c6cd1a6b93034906b315065f09fef50c/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:06:31.317672 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871325b9-a8f2-4943-9d1b-5d4236bc9269 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:31.332699 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a65c9c1-28b3-416e-a243-2707c46e819c service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:31.345300 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1003/2002] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:06:31 2021] GET /identity/v3/auth/tokens => generated 3670 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:06:31.388151 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871325b9-a8f2-4943-9d1b-5d4236bc9269 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:31.392687 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc7cba-9573-4da9-8823-b9c3d746f402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:31.393659 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc7cba-9573-4da9-8823-b9c3d746f402 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:31.394295 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc7cba-9573-4da9-8823-b9c3d746f402 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:31.394421 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc7cba-9573-4da9-8823-b9c3d746f402 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:31.395261 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc7cba-9573-4da9-8823-b9c3d746f402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:31.422429 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc7cba-9573-4da9-8823-b9c3d746f402 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:31.436677 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1000/2003] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:31 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:06:31.437511 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65c9c1-28b3-416e-a243-2707c46e819c service cinder] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:31.448103 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a65c9c1-28b3-416e-a243-2707c46e819c service cinder] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:31.453318 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70132d-ea40-40cd-9f4b-189cfc60e00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:31.454129 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70132d-ea40-40cd-9f4b-189cfc60e00a admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:31.454413 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70132d-ea40-40cd-9f4b-189cfc60e00a admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:31.454837 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e70132d-ea40-40cd-9f4b-189cfc60e00a admin admin] PATH_INFO: `/v3/projects/70403f62501244a59f4ca35c7c6fd0a4/users/c6cd1a6b93034906b315065f09fef50c/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:31.456824 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e70132d-ea40-40cd-9f4b-189cfc60e00a admin admin] RBAC: Authorizing `identity:create_grant(project_id=70403f62501244a59f4ca35c7c6fd0a4, user_id=c6cd1a6b93034906b315065f09fef50c, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:31.484190 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e70132d-ea40-40cd-9f4b-189cfc60e00a admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:31.498591 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1004/2004] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:31 2021] PUT /identity/v3/projects/70403f62501244a59f4ca35c7c6fd0a4/users/c6cd1a6b93034906b315065f09fef50c/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:06:31.508789 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c726e0-7440-4933-aa95-e668cf798fe4 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:31.509089 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c726e0-7440-4933-aa95-e668cf798fe4 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:31.509374 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c726e0-7440-4933-aa95-e668cf798fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:31.555413 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-28c726e0-7440-4933-aa95-e668cf798fe4 None None] MFA Rules not processed for user `c6cd1a6b93034906b315065f09fef50c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:31.556683 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-28c726e0-7440-4933-aa95-e668cf798fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:31.670186 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1001/2005] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:31 2021] POST /identity/v3/auth/tokens => generated 3751 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:06:31.678230 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70132d-ea40-40cd-9f4b-189cfc60e00a admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:31.679905 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-9e70132d-ea40-40cd-9f4b-189cfc60e00a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:31.767235 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e70132d-ea40-40cd-9f4b-189cfc60e00a admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:31.771869 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d48ee-456b-4283-956e-cf46e11dec8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:31.772867 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d48ee-456b-4283-956e-cf46e11dec8c service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:31.773480 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d48ee-456b-4283-956e-cf46e11dec8c service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:31.774041 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3d48ee-456b-4283-956e-cf46e11dec8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:31.776932 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-4d3d48ee-456b-4283-956e-cf46e11dec8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:31.875934 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d48ee-456b-4283-956e-cf46e11dec8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:31.906038 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3d48ee-456b-4283-956e-cf46e11dec8c service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:31.919801 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1005/2006] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:06:31 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:06:33.787821 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c726e0-7440-4933-aa95-e668cf798fe4 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:33.798684 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c726e0-7440-4933-aa95-e668cf798fe4 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:33.803336 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26325d6-29a6-485a-8299-6d9d1d0e89b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:33.804362 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26325d6-29a6-485a-8299-6d9d1d0e89b7 service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:33.804683 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26325d6-29a6-485a-8299-6d9d1d0e89b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:33.805358 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26325d6-29a6-485a-8299-6d9d1d0e89b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:33.893510 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26325d6-29a6-485a-8299-6d9d1d0e89b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:33.934857 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26325d6-29a6-485a-8299-6d9d1d0e89b7 service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:33.951816 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1002/2007] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:06:33 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:06:34.758140 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d48ee-456b-4283-956e-cf46e11dec8c service cinder] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:34.767830 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3d48ee-456b-4283-956e-cf46e11dec8c service cinder] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:34.772512 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a1341-aebe-4c39-b6ff-c199b3427322 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:34.774536 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a1341-aebe-4c39-b6ff-c199b3427322 service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:34.774536 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a1341-aebe-4c39-b6ff-c199b3427322 service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:34.774536 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a1341-aebe-4c39-b6ff-c199b3427322 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:34.786294 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a1341-aebe-4c39-b6ff-c199b3427322 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:34.821416 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a1341-aebe-4c39-b6ff-c199b3427322 service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:34.837437 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1006/2008] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:06:34 2021] GET /identity/v3/auth/tokens => generated 3751 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:06:44.089262 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26325d6-29a6-485a-8299-6d9d1d0e89b7 service cinder] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:44.090649 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-c26325d6-29a6-485a-8299-6d9d1d0e89b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:44.170988 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26325d6-29a6-485a-8299-6d9d1d0e89b7 service cinder] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:44.175105 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f6859-2b81-4898-b47b-2d396e7f89e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:44.175946 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f6859-2b81-4898-b47b-2d396e7f89e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:44.176237 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f6859-2b81-4898-b47b-2d396e7f89e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:44.176518 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f6859-2b81-4898-b47b-2d396e7f89e4 admin admin] PATH_INFO: `/v3/users/ab3f55859b1145fea22fe89a83c366e5` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:44.177615 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f6859-2b81-4898-b47b-2d396e7f89e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab3f55859b1145fea22fe89a83c366e5)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:44.203134 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f6859-2b81-4898-b47b-2d396e7f89e4 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:44.258272 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-509f6859-2b81-4898-b47b-2d396e7f89e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab3f55859b1145fea22fe89a83c366e5'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:44.269729 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-509f6859-2b81-4898-b47b-2d396e7f89e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab3f55859b1145fea22fe89a83c366e5'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:44.270379 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-509f6859-2b81-4898-b47b-2d396e7f89e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab3f55859b1145fea22fe89a83c366e5'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:44.277725 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-509f6859-2b81-4898-b47b-2d396e7f89e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab3f55859b1145fea22fe89a83c366e5'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:44.287976 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-509f6859-2b81-4898-b47b-2d396e7f89e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab3f55859b1145fea22fe89a83c366e5'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:44.294668 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1003/2009] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:06:44 2021] DELETE /identity/v3/users/ab3f55859b1145fea22fe89a83c366e5 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:44.534957 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a1341-aebe-4c39-b6ff-c199b3427322 service cinder] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:44.545660 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a1341-aebe-4c39-b6ff-c199b3427322 service cinder] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:44.607235 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d73ed9-d70d-40a5-a1bf-50a3df5657c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:44.608282 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d73ed9-d70d-40a5-a1bf-50a3df5657c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:44.608471 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d73ed9-d70d-40a5-a1bf-50a3df5657c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:44.608889 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d73ed9-d70d-40a5-a1bf-50a3df5657c0 admin admin] PATH_INFO: `/v3/projects/69b9e8ac7b5a4c9493a116af78daf977` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:44.609824 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d73ed9-d70d-40a5-a1bf-50a3df5657c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69b9e8ac7b5a4c9493a116af78daf977)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:44.635982 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d73ed9-d70d-40a5-a1bf-50a3df5657c0 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:44.691666 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-63d73ed9-d70d-40a5-a1bf-50a3df5657c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69b9e8ac7b5a4c9493a116af78daf977', 'request_id': 'req-63d73ed9-d70d-40a5-a1bf-50a3df5657c0'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:44.696785 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-63d73ed9-d70d-40a5-a1bf-50a3df5657c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69b9e8ac7b5a4c9493a116af78daf977', 'request_id': 'req-63d73ed9-d70d-40a5-a1bf-50a3df5657c0'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:44.708209 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-63d73ed9-d70d-40a5-a1bf-50a3df5657c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69b9e8ac7b5a4c9493a116af78daf977', 'request_id': 'req-63d73ed9-d70d-40a5-a1bf-50a3df5657c0'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:44.720372 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-63d73ed9-d70d-40a5-a1bf-50a3df5657c0 admin admin] The token cache is being invalidate because project 69b9e8ac7b5a4c9493a116af78daf977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:06:44.720651 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-63d73ed9-d70d-40a5-a1bf-50a3df5657c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:44.721225 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-63d73ed9-d70d-40a5-a1bf-50a3df5657c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:44.722722 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1007/2010] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:06:44 2021] DELETE /identity/v3/projects/69b9e8ac7b5a4c9493a116af78daf977 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:44.728368 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e5b43-9357-419e-ac47-caf0ed89347d None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:44.728757 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e5b43-9357-419e-ac47-caf0ed89347d None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:44.729544 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05e5b43-9357-419e-ac47-caf0ed89347d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:44.751521 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-e05e5b43-9357-419e-ac47-caf0ed89347d None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:44.752678 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-e05e5b43-9357-419e-ac47-caf0ed89347d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:44.818539 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1004/2011] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:44.826837 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4b011-46c1-44c9-9fd8-da5ad88c0ea3 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:44.827136 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4b011-46c1-44c9-9fd8-da5ad88c0ea3 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:44.827422 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4b011-46c1-44c9-9fd8-da5ad88c0ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:44.852174 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-a0e4b011-46c1-44c9-9fd8-da5ad88c0ea3 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:44.853587 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-a0e4b011-46c1-44c9-9fd8-da5ad88c0ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:44.861489 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1008/2012] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:44 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:44.865736 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e5b43-9357-419e-ac47-caf0ed89347d None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:44.875219 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05e5b43-9357-419e-ac47-caf0ed89347d None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:44.879408 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51b1cd-8259-41fb-b6d1-492bb5ef790c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:44.880019 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51b1cd-8259-41fb-b6d1-492bb5ef790c admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:44.880301 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51b1cd-8259-41fb-b6d1-492bb5ef790c admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:44.880575 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51b1cd-8259-41fb-b6d1-492bb5ef790c admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:44.881255 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51b1cd-8259-41fb-b6d1-492bb5ef790c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:06:44.881550 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51b1cd-8259-41fb-b6d1-492bb5ef790c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:44.907052 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e51b1cd-8259-41fb-b6d1-492bb5ef790c admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:44.920467 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1005/2013] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:06:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:06:44.924674 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4b011-46c1-44c9-9fd8-da5ad88c0ea3 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:44.933431 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4b011-46c1-44c9-9fd8-da5ad88c0ea3 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:44.937997 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43bb02c-c0db-455b-86bd-0b887a7f726f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:44.938582 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43bb02c-c0db-455b-86bd-0b887a7f726f admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:44.938872 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43bb02c-c0db-455b-86bd-0b887a7f726f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:44.939153 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43bb02c-c0db-455b-86bd-0b887a7f726f admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:44.939829 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43bb02c-c0db-455b-86bd-0b887a7f726f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:44.965896 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43bb02c-c0db-455b-86bd-0b887a7f726f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:44.992872 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1009/2014] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:06:44 2021] POST /identity/v3/projects => generated 403 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:44.996966 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51b1cd-8259-41fb-b6d1-492bb5ef790c admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:45.006281 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e51b1cd-8259-41fb-b6d1-492bb5ef790c admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:45.072989 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061b50b-008e-45af-993b-5c961773d185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:45.073622 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061b50b-008e-45af-993b-5c961773d185 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:45.073909 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061b50b-008e-45af-993b-5c961773d185 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:45.074187 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2061b50b-008e-45af-993b-5c961773d185 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:45.074832 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061b50b-008e-45af-993b-5c961773d185 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:45.100724 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2061b50b-008e-45af-993b-5c961773d185 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:45.119948 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1006/2015] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:06:44 2021] POST /identity/v3/users => generated 302 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:06:45.124140 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43bb02c-c0db-455b-86bd-0b887a7f726f admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:45.134089 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43bb02c-c0db-455b-86bd-0b887a7f726f admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:45.139484 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f82e42-ea05-47d3-9871-b12989aee33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:45.140152 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f82e42-ea05-47d3-9871-b12989aee33d admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:45.140501 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f82e42-ea05-47d3-9871-b12989aee33d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:45.140871 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f82e42-ea05-47d3-9871-b12989aee33d admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:45.141658 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f82e42-ea05-47d3-9871-b12989aee33d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:45.167544 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f82e42-ea05-47d3-9871-b12989aee33d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:45.177996 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1010/2016] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:45 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:06:45.182141 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061b50b-008e-45af-993b-5c961773d185 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:45.191678 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2061b50b-008e-45af-993b-5c961773d185 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:45.195896 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91072c79-807c-4d56-8bb1-0a04a050251d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:45.196715 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91072c79-807c-4d56-8bb1-0a04a050251d admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:45.197002 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91072c79-807c-4d56-8bb1-0a04a050251d admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:45.197280 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91072c79-807c-4d56-8bb1-0a04a050251d admin admin] PATH_INFO: `/v3/projects/22ea5e0173e9403c91173f2dba19cb24/users/e2cdd6d33116400581dfd8ce41bfb38f/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:45.219599 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91072c79-807c-4d56-8bb1-0a04a050251d admin admin] RBAC: Authorizing `identity:create_grant(project_id=22ea5e0173e9403c91173f2dba19cb24, user_id=e2cdd6d33116400581dfd8ce41bfb38f, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:45.247934 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91072c79-807c-4d56-8bb1-0a04a050251d admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:45.264340 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1007/2017] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:45 2021] PUT /identity/v3/projects/22ea5e0173e9403c91173f2dba19cb24/users/e2cdd6d33116400581dfd8ce41bfb38f/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:45.269181 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0bf75-0015-4893-a9c9-afcdc711a0ec None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:45.269583 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0bf75-0015-4893-a9c9-afcdc711a0ec None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:45.269992 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0bf75-0015-4893-a9c9-afcdc711a0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:45.298224 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-2bc0bf75-0015-4893-a9c9-afcdc711a0ec None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:45.299547 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-2bc0bf75-0015-4893-a9c9-afcdc711a0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:45.363880 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1011/2018] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:45.374527 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91072c79-807c-4d56-8bb1-0a04a050251d admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:45.376528 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-91072c79-807c-4d56-8bb1-0a04a050251d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:45.441686 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91072c79-807c-4d56-8bb1-0a04a050251d admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:45.445455 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ff096-2f54-4356-898c-e5fe3e2530a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:45.446044 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ff096-2f54-4356-898c-e5fe3e2530a0 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:45.446331 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ff096-2f54-4356-898c-e5fe3e2530a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:45.446609 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0ff096-2f54-4356-898c-e5fe3e2530a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:45.456126 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ff096-2f54-4356-898c-e5fe3e2530a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:45.482268 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0ff096-2f54-4356-898c-e5fe3e2530a0 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:45.493722 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1008/2019] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:06:45 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:06:46.382123 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca72fb-a6d8-4a86-b551-e0feb9c4b910 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:46.382692 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca72fb-a6d8-4a86-b551-e0feb9c4b910 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:46.382692 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca72fb-a6d8-4a86-b551-e0feb9c4b910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:46.419321 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-88ca72fb-a6d8-4a86-b551-e0feb9c4b910 None None] MFA Rules not processed for user `e2cdd6d33116400581dfd8ce41bfb38f`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:46.420496 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-88ca72fb-a6d8-4a86-b551-e0feb9c4b910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:46.509450 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1012/2020] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:46 2021] POST /identity/v3/auth/tokens => generated 3710 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:46.514502 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ff096-2f54-4356-898c-e5fe3e2530a0 service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:46.524361 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0ff096-2f54-4356-898c-e5fe3e2530a0 service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:46.530579 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a93cc-aef4-4692-95e9-007eb2707cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:46.531427 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a93cc-aef4-4692-95e9-007eb2707cac admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:46.531743 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a93cc-aef4-4692-95e9-007eb2707cac admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:46.532021 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a93cc-aef4-4692-95e9-007eb2707cac admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:46.532667 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a93cc-aef4-4692-95e9-007eb2707cac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:46.561646 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12a93cc-aef4-4692-95e9-007eb2707cac admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:46.608165 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1009/2021] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:06:46 2021] POST /identity/v3/projects => generated 405 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:46.612080 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca72fb-a6d8-4a86-b551-e0feb9c4b910 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:46.624135 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca72fb-a6d8-4a86-b551-e0feb9c4b910 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:46.717946 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453fea5a-e621-408f-8243-567c1b8a59c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:46.718593 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fea5a-e621-408f-8243-567c1b8a59c3 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:46.718888 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fea5a-e621-408f-8243-567c1b8a59c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:46.719197 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fea5a-e621-408f-8243-567c1b8a59c3 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:46.719874 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453fea5a-e621-408f-8243-567c1b8a59c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:46.746105 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453fea5a-e621-408f-8243-567c1b8a59c3 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:46.771865 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1013/2022] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:06:46 2021] POST /identity/v3/users => generated 309 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:46.772939 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a93cc-aef4-4692-95e9-007eb2707cac admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:46.783907 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a93cc-aef4-4692-95e9-007eb2707cac admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:46.788484 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176ed78-66eb-40f7-8821-9aa69b61e323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:46.789082 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176ed78-66eb-40f7-8821-9aa69b61e323 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:46.789383 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176ed78-66eb-40f7-8821-9aa69b61e323 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:46.789645 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176ed78-66eb-40f7-8821-9aa69b61e323 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:46.790333 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176ed78-66eb-40f7-8821-9aa69b61e323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:46.815901 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176ed78-66eb-40f7-8821-9aa69b61e323 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:46.827084 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1010/2023] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:46 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:06:46.831380 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453fea5a-e621-408f-8243-567c1b8a59c3 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:46.844061 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453fea5a-e621-408f-8243-567c1b8a59c3 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:46.848582 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df75704-64f6-4db8-8642-827057320670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:46.849559 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df75704-64f6-4db8-8642-827057320670 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:46.849855 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df75704-64f6-4db8-8642-827057320670 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:46.850135 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df75704-64f6-4db8-8642-827057320670 admin admin] PATH_INFO: `/v3/projects/4e5bd2173def4a14aa6ec397354bd42a/users/06fcb289cb584173ab8769c52c7f38fd/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:46.872771 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df75704-64f6-4db8-8642-827057320670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e5bd2173def4a14aa6ec397354bd42a, user_id=06fcb289cb584173ab8769c52c7f38fd, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:46.901379 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df75704-64f6-4db8-8642-827057320670 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:46.914997 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1014/2024] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:46 2021] PUT /identity/v3/projects/4e5bd2173def4a14aa6ec397354bd42a/users/06fcb289cb584173ab8769c52c7f38fd/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:06:46.919546 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176ed78-66eb-40f7-8821-9aa69b61e323 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:46.929056 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176ed78-66eb-40f7-8821-9aa69b61e323 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:46.997176 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b249d-6eda-49c1-bdff-2eac56770724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:46.997819 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b249d-6eda-49c1-bdff-2eac56770724 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:46.998106 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b249d-6eda-49c1-bdff-2eac56770724 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:46.998423 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b249d-6eda-49c1-bdff-2eac56770724 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:46.999257 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b249d-6eda-49c1-bdff-2eac56770724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:47.025440 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b249d-6eda-49c1-bdff-2eac56770724 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:47.038628 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1011/2025] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:46 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:06:47.042836 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df75704-64f6-4db8-8642-827057320670 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:47.053507 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df75704-64f6-4db8-8642-827057320670 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:47.058623 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2ce5f-c225-4259-9244-436cf5caf245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:47.059495 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2ce5f-c225-4259-9244-436cf5caf245 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:47.059793 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2ce5f-c225-4259-9244-436cf5caf245 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:47.060077 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2ce5f-c225-4259-9244-436cf5caf245 admin admin] PATH_INFO: `/v3/projects/4e5bd2173def4a14aa6ec397354bd42a/users/06fcb289cb584173ab8769c52c7f38fd/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:47.062030 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2ce5f-c225-4259-9244-436cf5caf245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e5bd2173def4a14aa6ec397354bd42a, user_id=06fcb289cb584173ab8769c52c7f38fd, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:47.091841 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2ce5f-c225-4259-9244-436cf5caf245 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:47.102675 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1015/2026] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:47 2021] PUT /identity/v3/projects/4e5bd2173def4a14aa6ec397354bd42a/users/06fcb289cb584173ab8769c52c7f38fd/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:06:47.106591 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b249d-6eda-49c1-bdff-2eac56770724 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:47.117172 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b249d-6eda-49c1-bdff-2eac56770724 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:47.181322 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85cbb28-49d1-42d3-a503-470fde9953dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:47.182457 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cbb28-49d1-42d3-a503-470fde9953dd admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:47.182741 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cbb28-49d1-42d3-a503-470fde9953dd admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:47.183022 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85cbb28-49d1-42d3-a503-470fde9953dd admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:47.183744 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85cbb28-49d1-42d3-a503-470fde9953dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:47.210495 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85cbb28-49d1-42d3-a503-470fde9953dd admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:47.234470 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1012/2027] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:47 2021] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:06:47.239019 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2ce5f-c225-4259-9244-436cf5caf245 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:47.253238 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2ce5f-c225-4259-9244-436cf5caf245 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:47.272982 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6752ae-36cc-4b9b-bc7d-b01334e5490a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:47.276187 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6752ae-36cc-4b9b-bc7d-b01334e5490a admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:47.276934 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6752ae-36cc-4b9b-bc7d-b01334e5490a admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:47.276934 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6752ae-36cc-4b9b-bc7d-b01334e5490a admin admin] PATH_INFO: `/v3/projects/4e5bd2173def4a14aa6ec397354bd42a/users/06fcb289cb584173ab8769c52c7f38fd/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:47.279802 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6752ae-36cc-4b9b-bc7d-b01334e5490a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e5bd2173def4a14aa6ec397354bd42a, user_id=06fcb289cb584173ab8769c52c7f38fd, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:47.309852 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6752ae-36cc-4b9b-bc7d-b01334e5490a admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:47.332993 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1016/2028] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:47 2021] PUT /identity/v3/projects/4e5bd2173def4a14aa6ec397354bd42a/users/06fcb289cb584173ab8769c52c7f38fd/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:48.229758 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df46fb2-3112-4cb7-a932-4c91a2e6a83c None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:48.230311 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df46fb2-3112-4cb7-a932-4c91a2e6a83c None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:48.230311 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df46fb2-3112-4cb7-a932-4c91a2e6a83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:48.272281 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-1df46fb2-3112-4cb7-a932-4c91a2e6a83c None None] MFA Rules not processed for user `06fcb289cb584173ab8769c52c7f38fd`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:48.273651 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-1df46fb2-3112-4cb7-a932-4c91a2e6a83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:48.372542 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1013/2029] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:48 2021] POST /identity/v3/auth/tokens => generated 3779 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:49.880040 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6752ae-36cc-4b9b-bc7d-b01334e5490a admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:49.950147 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6752ae-36cc-4b9b-bc7d-b01334e5490a admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:49.955861 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea641fa3-b433-4341-b658-834ad153f742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:49.956663 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea641fa3-b433-4341-b658-834ad153f742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:49.956951 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea641fa3-b433-4341-b658-834ad153f742 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:49.957230 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea641fa3-b433-4341-b658-834ad153f742 admin admin] PATH_INFO: `/v3/users/e2cdd6d33116400581dfd8ce41bfb38f` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:49.958361 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea641fa3-b433-4341-b658-834ad153f742 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2cdd6d33116400581dfd8ce41bfb38f)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:49.984594 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea641fa3-b433-4341-b658-834ad153f742 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:50.037051 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-ea641fa3-b433-4341-b658-834ad153f742 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2cdd6d33116400581dfd8ce41bfb38f'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:50.037653 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-ea641fa3-b433-4341-b658-834ad153f742 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2cdd6d33116400581dfd8ce41bfb38f'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:50.049565 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-ea641fa3-b433-4341-b658-834ad153f742 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2cdd6d33116400581dfd8ce41bfb38f'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:50.056531 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-ea641fa3-b433-4341-b658-834ad153f742 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2cdd6d33116400581dfd8ce41bfb38f'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:50.064706 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-ea641fa3-b433-4341-b658-834ad153f742 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2cdd6d33116400581dfd8ce41bfb38f'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:50.070445 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1017/2030] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:06:49 2021] DELETE /identity/v3/users/e2cdd6d33116400581dfd8ce41bfb38f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:50.293128 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df46fb2-3112-4cb7-a932-4c91a2e6a83c None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:50.303981 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df46fb2-3112-4cb7-a932-4c91a2e6a83c None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:50.366475 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2f3e7-38d8-4a5e-a9ab-c6c8d639b386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:50.367258 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2f3e7-38d8-4a5e-a9ab-c6c8d639b386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:50.367568 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2f3e7-38d8-4a5e-a9ab-c6c8d639b386 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:50.367843 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd2f3e7-38d8-4a5e-a9ab-c6c8d639b386 admin admin] PATH_INFO: `/v3/projects/22ea5e0173e9403c91173f2dba19cb24` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:50.368908 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2f3e7-38d8-4a5e-a9ab-c6c8d639b386 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22ea5e0173e9403c91173f2dba19cb24)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:50.394774 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd2f3e7-38d8-4a5e-a9ab-c6c8d639b386 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:50.443329 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-3bd2f3e7-38d8-4a5e-a9ab-c6c8d639b386 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22ea5e0173e9403c91173f2dba19cb24', 'request_id': 'req-3bd2f3e7-38d8-4a5e-a9ab-c6c8d639b386'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:50.448175 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-3bd2f3e7-38d8-4a5e-a9ab-c6c8d639b386 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22ea5e0173e9403c91173f2dba19cb24', 'request_id': 'req-3bd2f3e7-38d8-4a5e-a9ab-c6c8d639b386'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:50.459138 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-3bd2f3e7-38d8-4a5e-a9ab-c6c8d639b386 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22ea5e0173e9403c91173f2dba19cb24', 'request_id': 'req-3bd2f3e7-38d8-4a5e-a9ab-c6c8d639b386'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:50.470853 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-3bd2f3e7-38d8-4a5e-a9ab-c6c8d639b386 admin admin] The token cache is being invalidate because project 22ea5e0173e9403c91173f2dba19cb24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:06:50.471043 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-3bd2f3e7-38d8-4a5e-a9ab-c6c8d639b386 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:50.471658 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-3bd2f3e7-38d8-4a5e-a9ab-c6c8d639b386 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:50.473061 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1014/2031] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:06:50 2021] DELETE /identity/v3/projects/22ea5e0173e9403c91173f2dba19cb24 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:50.477065 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea641fa3-b433-4341-b658-834ad153f742 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:50.478389 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-ea641fa3-b433-4341-b658-834ad153f742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:50.491230 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea641fa3-b433-4341-b658-834ad153f742 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:50.552702 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219c316-defc-443a-9b65-87570bd249fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:50.553499 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219c316-defc-443a-9b65-87570bd249fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:50.553786 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219c316-defc-443a-9b65-87570bd249fe admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:50.554063 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219c316-defc-443a-9b65-87570bd249fe admin admin] PATH_INFO: `/v3/users/06fcb289cb584173ab8769c52c7f38fd` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:50.555142 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219c316-defc-443a-9b65-87570bd249fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=06fcb289cb584173ab8769c52c7f38fd)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:50.580830 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219c316-defc-443a-9b65-87570bd249fe admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:50.630511 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b219c316-defc-443a-9b65-87570bd249fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06fcb289cb584173ab8769c52c7f38fd'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:50.631244 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b219c316-defc-443a-9b65-87570bd249fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06fcb289cb584173ab8769c52c7f38fd'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:50.643896 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b219c316-defc-443a-9b65-87570bd249fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06fcb289cb584173ab8769c52c7f38fd'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:50.653001 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b219c316-defc-443a-9b65-87570bd249fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06fcb289cb584173ab8769c52c7f38fd'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:50.663948 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b219c316-defc-443a-9b65-87570bd249fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06fcb289cb584173ab8769c52c7f38fd'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:50.671399 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1018/2032] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:06:50 2021] DELETE /identity/v3/users/06fcb289cb584173ab8769c52c7f38fd => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:51.022120 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2f3e7-38d8-4a5e-a9ab-c6c8d639b386 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:51.023582 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-3bd2f3e7-38d8-4a5e-a9ab-c6c8d639b386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:51.052378 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd2f3e7-38d8-4a5e-a9ab-c6c8d639b386 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:51.136657 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ff23aa-9a5f-4f9e-9e55-d65887f4ca2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:51.137646 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff23aa-9a5f-4f9e-9e55-d65887f4ca2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:51.138032 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff23aa-9a5f-4f9e-9e55-d65887f4ca2c admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:51.138411 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ff23aa-9a5f-4f9e-9e55-d65887f4ca2c admin admin] PATH_INFO: `/v3/projects/4e5bd2173def4a14aa6ec397354bd42a` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:51.139776 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff23aa-9a5f-4f9e-9e55-d65887f4ca2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e5bd2173def4a14aa6ec397354bd42a)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:51.166232 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ff23aa-9a5f-4f9e-9e55-d65887f4ca2c admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:51.223597 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-79ff23aa-9a5f-4f9e-9e55-d65887f4ca2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e5bd2173def4a14aa6ec397354bd42a', 'request_id': 'req-79ff23aa-9a5f-4f9e-9e55-d65887f4ca2c'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:51.231888 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-79ff23aa-9a5f-4f9e-9e55-d65887f4ca2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e5bd2173def4a14aa6ec397354bd42a', 'request_id': 'req-79ff23aa-9a5f-4f9e-9e55-d65887f4ca2c'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:51.246368 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-79ff23aa-9a5f-4f9e-9e55-d65887f4ca2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e5bd2173def4a14aa6ec397354bd42a', 'request_id': 'req-79ff23aa-9a5f-4f9e-9e55-d65887f4ca2c'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:51.271084 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-79ff23aa-9a5f-4f9e-9e55-d65887f4ca2c admin admin] The token cache is being invalidate because project 4e5bd2173def4a14aa6ec397354bd42a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:06:51.271760 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-79ff23aa-9a5f-4f9e-9e55-d65887f4ca2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:51.272529 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-79ff23aa-9a5f-4f9e-9e55-d65887f4ca2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:51.274143 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1015/2033] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:06:51 2021] DELETE /identity/v3/projects/4e5bd2173def4a14aa6ec397354bd42a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:51.284474 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c93d6-a8e9-48c4-962f-448e0569d710 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:51.284988 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c93d6-a8e9-48c4-962f-448e0569d710 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:51.285095 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c93d6-a8e9-48c4-962f-448e0569d710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:51.309204 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-c58c93d6-a8e9-48c4-962f-448e0569d710 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:51.310388 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-c58c93d6-a8e9-48c4-962f-448e0569d710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:51.377301 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1019/2034] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:51.385743 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71afc7-115b-497f-b88d-477524fe53ef None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:51.386625 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71afc7-115b-497f-b88d-477524fe53ef None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:51.386625 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c71afc7-115b-497f-b88d-477524fe53ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:51.409312 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-4c71afc7-115b-497f-b88d-477524fe53ef None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:51.410625 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-4c71afc7-115b-497f-b88d-477524fe53ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:51.417832 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1016/2035] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:51.422299 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c93d6-a8e9-48c4-962f-448e0569d710 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:51.433239 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c93d6-a8e9-48c4-962f-448e0569d710 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:51.438955 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715badf9-a034-4bd1-a816-85c065921c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:51.439681 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715badf9-a034-4bd1-a816-85c065921c9a admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:51.439971 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715badf9-a034-4bd1-a816-85c065921c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:51.440273 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715badf9-a034-4bd1-a816-85c065921c9a admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:51.440968 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715badf9-a034-4bd1-a816-85c065921c9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:06:51.441305 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715badf9-a034-4bd1-a816-85c065921c9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:51.475863 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715badf9-a034-4bd1-a816-85c065921c9a admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:51.490849 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1020/2036] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:06:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:06:51.495898 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71afc7-115b-497f-b88d-477524fe53ef None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:51.506303 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c71afc7-115b-497f-b88d-477524fe53ef None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:51.511664 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0239ea7-c966-4302-93c5-4cadf1520729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:51.512253 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0239ea7-c966-4302-93c5-4cadf1520729 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:51.512601 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0239ea7-c966-4302-93c5-4cadf1520729 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:51.513042 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0239ea7-c966-4302-93c5-4cadf1520729 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:51.514077 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0239ea7-c966-4302-93c5-4cadf1520729 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:51.543484 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0239ea7-c966-4302-93c5-4cadf1520729 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:51.578018 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1017/2037] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:06:51 2021] POST /identity/v3/projects => generated 379 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:06:51.579829 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715badf9-a034-4bd1-a816-85c065921c9a admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:51.591113 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715badf9-a034-4bd1-a816-85c065921c9a admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:51.658288 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915d730-d9c2-453d-9192-ab73de224b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:51.658901 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915d730-d9c2-453d-9192-ab73de224b5e admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:51.659189 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915d730-d9c2-453d-9192-ab73de224b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:51.659495 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915d730-d9c2-453d-9192-ab73de224b5e admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:51.660173 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915d730-d9c2-453d-9192-ab73de224b5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:51.685924 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915d730-d9c2-453d-9192-ab73de224b5e admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:51.705988 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1021/2038] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:06:51 2021] POST /identity/v3/users => generated 290 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:51.710201 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0239ea7-c966-4302-93c5-4cadf1520729 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:51.720991 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0239ea7-c966-4302-93c5-4cadf1520729 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:51.726023 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3470330-f9d1-47c7-96ba-665c1ff0de06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:51.729486 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3470330-f9d1-47c7-96ba-665c1ff0de06 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:51.729486 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3470330-f9d1-47c7-96ba-665c1ff0de06 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:51.729486 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3470330-f9d1-47c7-96ba-665c1ff0de06 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:51.729486 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3470330-f9d1-47c7-96ba-665c1ff0de06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:51.755830 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3470330-f9d1-47c7-96ba-665c1ff0de06 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:51.768456 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1018/2039] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:51 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:06:51.772578 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915d730-d9c2-453d-9192-ab73de224b5e admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:51.786762 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915d730-d9c2-453d-9192-ab73de224b5e admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:51.794989 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e73e4-310a-4e9b-bd8c-4519f3b1bb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:51.795955 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e73e4-310a-4e9b-bd8c-4519f3b1bb74 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:51.796289 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e73e4-310a-4e9b-bd8c-4519f3b1bb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:51.796650 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e73e4-310a-4e9b-bd8c-4519f3b1bb74 admin admin] PATH_INFO: `/v3/projects/a9a36c6b557640e2a78ae9e614057f18/users/b25fff2a051a410b84d156304552d68c/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:51.823091 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e73e4-310a-4e9b-bd8c-4519f3b1bb74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a36c6b557640e2a78ae9e614057f18, user_id=b25fff2a051a410b84d156304552d68c, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:51.855311 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e73e4-310a-4e9b-bd8c-4519f3b1bb74 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:51.872062 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1022/2040] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:51 2021] PUT /identity/v3/projects/a9a36c6b557640e2a78ae9e614057f18/users/b25fff2a051a410b84d156304552d68c/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:06:51.884074 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c050f5-08d9-4aef-ba1f-b5466ebb5f2e None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:51.884447 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c050f5-08d9-4aef-ba1f-b5466ebb5f2e None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:51.885063 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c050f5-08d9-4aef-ba1f-b5466ebb5f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:51.898151 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e73e4-310a-4e9b-bd8c-4519f3b1bb74 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:51.900093 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-638e73e4-310a-4e9b-bd8c-4519f3b1bb74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:51.933352 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-c5c050f5-08d9-4aef-ba1f-b5466ebb5f2e None None] MFA Rules not processed for user `b25fff2a051a410b84d156304552d68c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:51.934529 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-c5c050f5-08d9-4aef-ba1f-b5466ebb5f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:51.989541 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e73e4-310a-4e9b-bd8c-4519f3b1bb74 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:51.994990 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70438ab8-4901-4ff0-806f-ad727365e314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:51.995910 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70438ab8-4901-4ff0-806f-ad727365e314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:51.996489 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70438ab8-4901-4ff0-806f-ad727365e314 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:51.996934 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70438ab8-4901-4ff0-806f-ad727365e314 admin admin] PATH_INFO: `/v3/users/418c203199cc4d85a5d0ac5668e38810` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:51.998153 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70438ab8-4901-4ff0-806f-ad727365e314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=418c203199cc4d85a5d0ac5668e38810)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:52.022948 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1019/2041] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:51 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:52.025375 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70438ab8-4901-4ff0-806f-ad727365e314 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:52.028256 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c050f5-08d9-4aef-ba1f-b5466ebb5f2e None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:52.039229 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c050f5-08d9-4aef-ba1f-b5466ebb5f2e None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:52.044784 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cf353-34f0-425e-ba03-bcce48d111f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:52.045441 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cf353-34f0-425e-ba03-bcce48d111f4 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:52.045731 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cf353-34f0-425e-ba03-bcce48d111f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:52.046207 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863cf353-34f0-425e-ba03-bcce48d111f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:52.046844 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863cf353-34f0-425e-ba03-bcce48d111f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:52.075785 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863cf353-34f0-425e-ba03-bcce48d111f4 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:52.088710 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-70438ab8-4901-4ff0-806f-ad727365e314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '418c203199cc4d85a5d0ac5668e38810'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:52.090368 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-70438ab8-4901-4ff0-806f-ad727365e314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '418c203199cc4d85a5d0ac5668e38810'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:52.114847 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-70438ab8-4901-4ff0-806f-ad727365e314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '418c203199cc4d85a5d0ac5668e38810'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:52.123937 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-70438ab8-4901-4ff0-806f-ad727365e314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '418c203199cc4d85a5d0ac5668e38810'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:52.128468 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1020/2042] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:06:52 2021] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:52.129915 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cf353-34f0-425e-ba03-bcce48d111f4 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:52.132559 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-863cf353-34f0-425e-ba03-bcce48d111f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:52.137398 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-70438ab8-4901-4ff0-806f-ad727365e314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '418c203199cc4d85a5d0ac5668e38810'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:52.146795 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1023/2043] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:06:51 2021] DELETE /identity/v3/users/418c203199cc4d85a5d0ac5668e38810 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:52.151396 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa966d-3924-4275-a6e9-34986695f178 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:52.151929 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa966d-3924-4275-a6e9-34986695f178 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:52.152304 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa966d-3924-4275-a6e9-34986695f178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:52.206004 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-6caa966d-3924-4275-a6e9-34986695f178 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:52.207542 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-6caa966d-3924-4275-a6e9-34986695f178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:52.247429 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863cf353-34f0-425e-ba03-bcce48d111f4 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:52.334199 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1024/2044] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:52 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:06:52.345737 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa966d-3924-4275-a6e9-34986695f178 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:52.347103 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-6caa966d-3924-4275-a6e9-34986695f178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:52.438048 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2d4ca-fafb-49cb-8435-728685ef2411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:52.439254 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2d4ca-fafb-49cb-8435-728685ef2411 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:52.439579 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2d4ca-fafb-49cb-8435-728685ef2411 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:52.440067 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2d4ca-fafb-49cb-8435-728685ef2411 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:52.440863 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2d4ca-fafb-49cb-8435-728685ef2411 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:52.466723 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa966d-3924-4275-a6e9-34986695f178 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:52.469104 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2d4ca-fafb-49cb-8435-728685ef2411 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:52.471888 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360322d0-2d89-4d4f-942a-df566e05098d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:52.472599 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360322d0-2d89-4d4f-942a-df566e05098d service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:52.472951 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360322d0-2d89-4d4f-942a-df566e05098d service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:52.473295 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360322d0-2d89-4d4f-942a-df566e05098d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:52.483601 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360322d0-2d89-4d4f-942a-df566e05098d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:52.496603 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1021/2045] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:06:52 2021] POST /identity/v3/users => generated 297 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:06:52.500654 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2d4ca-fafb-49cb-8435-728685ef2411 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:52.510395 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360322d0-2d89-4d4f-942a-df566e05098d service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:52.511314 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2d4ca-fafb-49cb-8435-728685ef2411 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:52.518604 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12e05e-4c5f-403c-aa69-bd0e76e33156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:52.519425 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12e05e-4c5f-403c-aa69-bd0e76e33156 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:52.519923 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12e05e-4c5f-403c-aa69-bd0e76e33156 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:52.520363 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12e05e-4c5f-403c-aa69-bd0e76e33156 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:52.520748 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1025/2046] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:06:52 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:06:52.521454 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12e05e-4c5f-403c-aa69-bd0e76e33156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:52.548560 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12e05e-4c5f-403c-aa69-bd0e76e33156 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:52.561402 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1022/2047] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:52 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:06:52.567531 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360322d0-2d89-4d4f-942a-df566e05098d service neutron] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:52.577104 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360322d0-2d89-4d4f-942a-df566e05098d service neutron] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:52.582295 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2351952-7c7a-4273-ae6e-59df054b0d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:52.583388 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2351952-7c7a-4273-ae6e-59df054b0d7f admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:52.583491 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2351952-7c7a-4273-ae6e-59df054b0d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:52.583854 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2351952-7c7a-4273-ae6e-59df054b0d7f admin admin] PATH_INFO: `/v3/projects/833419f52fd6401ca6d328c154133578/users/6a236bdb33c14daaba1078c22c699da9/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:52.614522 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2351952-7c7a-4273-ae6e-59df054b0d7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=833419f52fd6401ca6d328c154133578, user_id=6a236bdb33c14daaba1078c22c699da9, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:52.654794 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2351952-7c7a-4273-ae6e-59df054b0d7f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:52.671827 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1026/2048] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:52 2021] PUT /identity/v3/projects/833419f52fd6401ca6d328c154133578/users/6a236bdb33c14daaba1078c22c699da9/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:52.676359 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12e05e-4c5f-403c-aa69-bd0e76e33156 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:52.697743 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12e05e-4c5f-403c-aa69-bd0e76e33156 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:52.777719 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c994a1-d3e7-4266-a9c1-eb28bcfc8a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:52.778306 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c994a1-d3e7-4266-a9c1-eb28bcfc8a6c admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:52.778643 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c994a1-d3e7-4266-a9c1-eb28bcfc8a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:52.778856 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c994a1-d3e7-4266-a9c1-eb28bcfc8a6c admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:52.779586 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c994a1-d3e7-4266-a9c1-eb28bcfc8a6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:52.806246 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c994a1-d3e7-4266-a9c1-eb28bcfc8a6c admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:52.820935 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2351952-7c7a-4273-ae6e-59df054b0d7f admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:52.821542 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1023/2049] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:52 2021] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:06:52.833756 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2351952-7c7a-4273-ae6e-59df054b0d7f admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:52.839336 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0d67f-76ab-424c-94b7-8806e82414b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:52.840467 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0d67f-76ab-424c-94b7-8806e82414b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:52.840828 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0d67f-76ab-424c-94b7-8806e82414b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:52.841217 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab0d67f-76ab-424c-94b7-8806e82414b9 admin admin] PATH_INFO: `/v3/projects/833419f52fd6401ca6d328c154133578/users/6a236bdb33c14daaba1078c22c699da9/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:52.843172 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0d67f-76ab-424c-94b7-8806e82414b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=833419f52fd6401ca6d328c154133578, user_id=6a236bdb33c14daaba1078c22c699da9, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:52.872104 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab0d67f-76ab-424c-94b7-8806e82414b9 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:52.890323 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1027/2050] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:52 2021] PUT /identity/v3/projects/833419f52fd6401ca6d328c154133578/users/6a236bdb33c14daaba1078c22c699da9/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:52.892407 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c994a1-d3e7-4266-a9c1-eb28bcfc8a6c admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:52.905042 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c994a1-d3e7-4266-a9c1-eb28bcfc8a6c admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:52.987191 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0d67f-76ab-424c-94b7-8806e82414b9 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:52.988914 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-2ab0d67f-76ab-424c-94b7-8806e82414b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:52.991022 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3c60b-ea75-4f53-8b45-27e5738a3204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:52.991707 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3c60b-ea75-4f53-8b45-27e5738a3204 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:52.992001 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3c60b-ea75-4f53-8b45-27e5738a3204 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:52.992277 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b3c60b-ea75-4f53-8b45-27e5738a3204 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:52.993060 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3c60b-ea75-4f53-8b45-27e5738a3204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:53.014495 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab0d67f-76ab-424c-94b7-8806e82414b9 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:53.019663 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54117972-bfce-4d06-b220-8f4ea88c2b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:53.020527 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54117972-bfce-4d06-b220-8f4ea88c2b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:53.020886 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54117972-bfce-4d06-b220-8f4ea88c2b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:53.021236 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54117972-bfce-4d06-b220-8f4ea88c2b97 admin admin] PATH_INFO: `/v3/projects/01e55eab4a3c4752abc452cba0b4b93d` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:53.022558 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54117972-bfce-4d06-b220-8f4ea88c2b97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01e55eab4a3c4752abc452cba0b4b93d)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:53.027769 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b3c60b-ea75-4f53-8b45-27e5738a3204 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:53.043689 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1024/2051] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:52 2021] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:06:53.048182 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3c60b-ea75-4f53-8b45-27e5738a3204 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:53.059080 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54117972-bfce-4d06-b220-8f4ea88c2b97 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:53.059976 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b3c60b-ea75-4f53-8b45-27e5738a3204 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:53.065236 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60484863-9739-4ef3-8e03-02d05f6e36ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:53.066746 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60484863-9739-4ef3-8e03-02d05f6e36ce admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:53.066746 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60484863-9739-4ef3-8e03-02d05f6e36ce admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:53.066746 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60484863-9739-4ef3-8e03-02d05f6e36ce admin admin] PATH_INFO: `/v3/projects/833419f52fd6401ca6d328c154133578/users/6a236bdb33c14daaba1078c22c699da9/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:53.068498 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60484863-9739-4ef3-8e03-02d05f6e36ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=833419f52fd6401ca6d328c154133578, user_id=6a236bdb33c14daaba1078c22c699da9, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:53.096140 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60484863-9739-4ef3-8e03-02d05f6e36ce admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:53.113555 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1025/2052] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:53 2021] PUT /identity/v3/projects/833419f52fd6401ca6d328c154133578/users/6a236bdb33c14daaba1078c22c699da9/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:53.124472 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7461d-b8b6-4f46-b0fe-29b2a3383e12 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:53.124756 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7461d-b8b6-4f46-b0fe-29b2a3383e12 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:53.125052 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7461d-b8b6-4f46-b0fe-29b2a3383e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:53.131343 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-54117972-bfce-4d06-b220-8f4ea88c2b97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01e55eab4a3c4752abc452cba0b4b93d', 'request_id': 'req-54117972-bfce-4d06-b220-8f4ea88c2b97'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:53.137135 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-54117972-bfce-4d06-b220-8f4ea88c2b97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01e55eab4a3c4752abc452cba0b4b93d', 'request_id': 'req-54117972-bfce-4d06-b220-8f4ea88c2b97'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:53.148278 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-54117972-bfce-4d06-b220-8f4ea88c2b97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01e55eab4a3c4752abc452cba0b4b93d', 'request_id': 'req-54117972-bfce-4d06-b220-8f4ea88c2b97'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:53.163542 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-54117972-bfce-4d06-b220-8f4ea88c2b97 admin admin] The token cache is being invalidate because project 01e55eab4a3c4752abc452cba0b4b93d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:06:53.163828 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-54117972-bfce-4d06-b220-8f4ea88c2b97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:53.164473 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-54117972-bfce-4d06-b220-8f4ea88c2b97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:53.166201 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1028/2053] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:06:52 2021] DELETE /identity/v3/projects/01e55eab4a3c4752abc452cba0b4b93d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:06:53.169855 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-11b7461d-b8b6-4f46-b0fe-29b2a3383e12 None None] MFA Rules not processed for user `6a236bdb33c14daaba1078c22c699da9`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:53.170417 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54117972-bfce-4d06-b220-8f4ea88c2b97 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:53.171012 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-11b7461d-b8b6-4f46-b0fe-29b2a3383e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:53.172397 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-54117972-bfce-4d06-b220-8f4ea88c2b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:53.265132 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54117972-bfce-4d06-b220-8f4ea88c2b97 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:53.270389 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4acaa98-2de2-4ec2-90b1-9d0ca80d083d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:53.271398 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acaa98-2de2-4ec2-90b1-9d0ca80d083d admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:53.272144 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acaa98-2de2-4ec2-90b1-9d0ca80d083d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:53.272528 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acaa98-2de2-4ec2-90b1-9d0ca80d083d admin admin] PATH_INFO: `/v3/users/19d51b6ba3b94f4abff29496a989a128` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:53.273881 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4acaa98-2de2-4ec2-90b1-9d0ca80d083d admin admin] RBAC: Authorizing `identity:delete_user(user_id=19d51b6ba3b94f4abff29496a989a128)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:53.282383 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1026/2054] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:53 2021] POST /identity/v3/auth/tokens => generated 3755 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:53.305276 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4acaa98-2de2-4ec2-90b1-9d0ca80d083d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:53.341215 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7461d-b8b6-4f46-b0fe-29b2a3383e12 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:53.342845 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-11b7461d-b8b6-4f46-b0fe-29b2a3383e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:53.364464 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-d4acaa98-2de2-4ec2-90b1-9d0ca80d083d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19d51b6ba3b94f4abff29496a989a128'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:53.365222 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-d4acaa98-2de2-4ec2-90b1-9d0ca80d083d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19d51b6ba3b94f4abff29496a989a128'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:53.380254 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-d4acaa98-2de2-4ec2-90b1-9d0ca80d083d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19d51b6ba3b94f4abff29496a989a128'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:53.388595 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-d4acaa98-2de2-4ec2-90b1-9d0ca80d083d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19d51b6ba3b94f4abff29496a989a128'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:53.397404 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-d4acaa98-2de2-4ec2-90b1-9d0ca80d083d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19d51b6ba3b94f4abff29496a989a128'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:53.404558 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1029/2055] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:06:53 2021] DELETE /identity/v3/users/19d51b6ba3b94f4abff29496a989a128 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:06:53.414244 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7461d-b8b6-4f46-b0fe-29b2a3383e12 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:53.474306 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a1a8b-3076-4ebc-8709-169371150dc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:53.474974 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a1a8b-3076-4ebc-8709-169371150dc5 service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:53.475399 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a1a8b-3076-4ebc-8709-169371150dc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:53.475782 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a1a8b-3076-4ebc-8709-169371150dc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:53.478392 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-9d7a1a8b-3076-4ebc-8709-169371150dc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:53.560193 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a1a8b-3076-4ebc-8709-169371150dc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:53.586246 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a1a8b-3076-4ebc-8709-169371150dc5 service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:53.596932 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1027/2056] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:06:53 2021] GET /identity/v3/auth/tokens => generated 3755 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:06:53.863736 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4acaa98-2de2-4ec2-90b1-9d0ca80d083d admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:53.865039 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-d4acaa98-2de2-4ec2-90b1-9d0ca80d083d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:53.943517 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4acaa98-2de2-4ec2-90b1-9d0ca80d083d admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:53.945939 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fc4b4-c84a-4b9c-a070-0b49d0ecf9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:53.947016 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fc4b4-c84a-4b9c-a070-0b49d0ecf9cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:53.947342 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fc4b4-c84a-4b9c-a070-0b49d0ecf9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:53.947662 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fc4b4-c84a-4b9c-a070-0b49d0ecf9cb admin admin] PATH_INFO: `/v3/projects/d1567a279cf94da688000a332d4b58da` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:53.948746 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854fc4b4-c84a-4b9c-a070-0b49d0ecf9cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1567a279cf94da688000a332d4b58da)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:53.975327 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854fc4b4-c84a-4b9c-a070-0b49d0ecf9cb admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:54.030977 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-854fc4b4-c84a-4b9c-a070-0b49d0ecf9cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1567a279cf94da688000a332d4b58da', 'request_id': 'req-854fc4b4-c84a-4b9c-a070-0b49d0ecf9cb'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:54.036378 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-854fc4b4-c84a-4b9c-a070-0b49d0ecf9cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1567a279cf94da688000a332d4b58da', 'request_id': 'req-854fc4b4-c84a-4b9c-a070-0b49d0ecf9cb'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:54.050766 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-854fc4b4-c84a-4b9c-a070-0b49d0ecf9cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1567a279cf94da688000a332d4b58da', 'request_id': 'req-854fc4b4-c84a-4b9c-a070-0b49d0ecf9cb'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:54.064942 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-854fc4b4-c84a-4b9c-a070-0b49d0ecf9cb admin admin] The token cache is being invalidate because project d1567a279cf94da688000a332d4b58da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:06:54.065234 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-854fc4b4-c84a-4b9c-a070-0b49d0ecf9cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:54.066089 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-854fc4b4-c84a-4b9c-a070-0b49d0ecf9cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:54.067469 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1030/2057] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:06:53 2021] DELETE /identity/v3/projects/d1567a279cf94da688000a332d4b58da => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:54.071383 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a1a8b-3076-4ebc-8709-169371150dc5 service cinder] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:54.081905 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a1a8b-3076-4ebc-8709-169371150dc5 service cinder] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:54.145076 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f1faf0-b3ca-4411-ab81-c32eecefd366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:54.145883 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1faf0-b3ca-4411-ab81-c32eecefd366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:54.146168 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1faf0-b3ca-4411-ab81-c32eecefd366 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:54.146441 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f1faf0-b3ca-4411-ab81-c32eecefd366 admin admin] PATH_INFO: `/v3/users/c6cd1a6b93034906b315065f09fef50c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:54.147749 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f1faf0-b3ca-4411-ab81-c32eecefd366 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6cd1a6b93034906b315065f09fef50c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:54.174267 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f1faf0-b3ca-4411-ab81-c32eecefd366 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:54.226230 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-39f1faf0-b3ca-4411-ab81-c32eecefd366 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6cd1a6b93034906b315065f09fef50c'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:54.239625 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-39f1faf0-b3ca-4411-ab81-c32eecefd366 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6cd1a6b93034906b315065f09fef50c'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:54.240292 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-39f1faf0-b3ca-4411-ab81-c32eecefd366 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6cd1a6b93034906b315065f09fef50c'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:54.247968 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-39f1faf0-b3ca-4411-ab81-c32eecefd366 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6cd1a6b93034906b315065f09fef50c'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:54.257467 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-39f1faf0-b3ca-4411-ab81-c32eecefd366 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6cd1a6b93034906b315065f09fef50c'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:54.269876 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1028/2058] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:06:54 2021] DELETE /identity/v3/users/c6cd1a6b93034906b315065f09fef50c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:06:54.372978 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fc4b4-c84a-4b9c-a070-0b49d0ecf9cb admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:54.375095 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-854fc4b4-c84a-4b9c-a070-0b49d0ecf9cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:54.396311 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fc4b4-c84a-4b9c-a070-0b49d0ecf9cb admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:54.487071 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb1908-dde2-41c4-a2c1-99a62dee0f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:54.488065 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb1908-dde2-41c4-a2c1-99a62dee0f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:54.488416 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb1908-dde2-41c4-a2c1-99a62dee0f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:54.488702 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb1908-dde2-41c4-a2c1-99a62dee0f51 admin admin] PATH_INFO: `/v3/users/b25fff2a051a410b84d156304552d68c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:54.489839 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb1908-dde2-41c4-a2c1-99a62dee0f51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b25fff2a051a410b84d156304552d68c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:54.517319 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb1908-dde2-41c4-a2c1-99a62dee0f51 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:54.569693 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b5cb1908-dde2-41c4-a2c1-99a62dee0f51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b25fff2a051a410b84d156304552d68c'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:54.570380 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b5cb1908-dde2-41c4-a2c1-99a62dee0f51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b25fff2a051a410b84d156304552d68c'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:54.583076 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b5cb1908-dde2-41c4-a2c1-99a62dee0f51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b25fff2a051a410b84d156304552d68c'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:54.590519 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b5cb1908-dde2-41c4-a2c1-99a62dee0f51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b25fff2a051a410b84d156304552d68c'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:54.598713 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b5cb1908-dde2-41c4-a2c1-99a62dee0f51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b25fff2a051a410b84d156304552d68c'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:54.606089 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1031/2059] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:06:54 2021] DELETE /identity/v3/users/b25fff2a051a410b84d156304552d68c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:54.610701 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba0c61-8bb3-45b9-bb04-66b7622e1163 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:54.611209 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba0c61-8bb3-45b9-bb04-66b7622e1163 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:54.611379 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba0c61-8bb3-45b9-bb04-66b7622e1163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:54.658269 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb1908-dde2-41c4-a2c1-99a62dee0f51 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:54.659673 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-b5cb1908-dde2-41c4-a2c1-99a62dee0f51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:54.719383 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-34ba0c61-8bb3-45b9-bb04-66b7622e1163 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:54.720597 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-34ba0c61-8bb3-45b9-bb04-66b7622e1163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:54.737297 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb1908-dde2-41c4-a2c1-99a62dee0f51 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:54.743156 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5232a34f-a44c-48ba-9eb0-7ed83c61e649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:54.745068 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232a34f-a44c-48ba-9eb0-7ed83c61e649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:54.745853 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232a34f-a44c-48ba-9eb0-7ed83c61e649 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:54.746447 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5232a34f-a44c-48ba-9eb0-7ed83c61e649 admin admin] PATH_INFO: `/v3/projects/70403f62501244a59f4ca35c7c6fd0a4` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:54.748050 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232a34f-a44c-48ba-9eb0-7ed83c61e649 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70403f62501244a59f4ca35c7c6fd0a4)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:54.775884 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5232a34f-a44c-48ba-9eb0-7ed83c61e649 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:54.800826 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1029/2060] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:54.809063 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba0c61-8bb3-45b9-bb04-66b7622e1163 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:54.811952 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-34ba0c61-8bb3-45b9-bb04-66b7622e1163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:54.842674 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-5232a34f-a44c-48ba-9eb0-7ed83c61e649 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70403f62501244a59f4ca35c7c6fd0a4', 'request_id': 'req-5232a34f-a44c-48ba-9eb0-7ed83c61e649'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:54.852308 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-5232a34f-a44c-48ba-9eb0-7ed83c61e649 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70403f62501244a59f4ca35c7c6fd0a4', 'request_id': 'req-5232a34f-a44c-48ba-9eb0-7ed83c61e649'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:54.867403 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-5232a34f-a44c-48ba-9eb0-7ed83c61e649 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70403f62501244a59f4ca35c7c6fd0a4', 'request_id': 'req-5232a34f-a44c-48ba-9eb0-7ed83c61e649'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:54.884986 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-5232a34f-a44c-48ba-9eb0-7ed83c61e649 admin admin] The token cache is being invalidate because project 70403f62501244a59f4ca35c7c6fd0a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:06:54.885348 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-5232a34f-a44c-48ba-9eb0-7ed83c61e649 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:54.886085 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-5232a34f-a44c-48ba-9eb0-7ed83c61e649 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:54.887594 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1032/2061] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:06:54 2021] DELETE /identity/v3/projects/70403f62501244a59f4ca35c7c6fd0a4 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:06:54.896254 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b0991-67b1-40d2-872e-a651e1ebfc5c None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:54.896865 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b0991-67b1-40d2-872e-a651e1ebfc5c None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:54.897397 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b0991-67b1-40d2-872e-a651e1ebfc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:54.898583 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba0c61-8bb3-45b9-bb04-66b7622e1163 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:54.924244 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-114b0991-67b1-40d2-872e-a651e1ebfc5c None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:54.925736 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-114b0991-67b1-40d2-872e-a651e1ebfc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:54.973960 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492442a1-6644-4c55-ba40-159b4308c0fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:54.974876 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492442a1-6644-4c55-ba40-159b4308c0fd service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:54.975319 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492442a1-6644-4c55-ba40-159b4308c0fd service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:54.975795 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492442a1-6644-4c55-ba40-159b4308c0fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:54.980356 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-492442a1-6644-4c55-ba40-159b4308c0fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:55.009359 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1033/2062] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:55.017815 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91831f3-da43-4b92-bfc5-e5f41f450a2b None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:55.018108 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91831f3-da43-4b92-bfc5-e5f41f450a2b None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:55.018797 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91831f3-da43-4b92-bfc5-e5f41f450a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:55.043686 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-c91831f3-da43-4b92-bfc5-e5f41f450a2b None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:55.044889 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-c91831f3-da43-4b92-bfc5-e5f41f450a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:55.052693 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1034/2063] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:55 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:06:55.060301 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91831f3-da43-4b92-bfc5-e5f41f450a2b None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:55.067133 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492442a1-6644-4c55-ba40-159b4308c0fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:55.069130 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91831f3-da43-4b92-bfc5-e5f41f450a2b None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:55.073641 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd8e3a4-28f2-4149-b656-5e62fea7a398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:55.074303 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8e3a4-28f2-4149-b656-5e62fea7a398 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:55.074652 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8e3a4-28f2-4149-b656-5e62fea7a398 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:55.074993 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd8e3a4-28f2-4149-b656-5e62fea7a398 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:55.075842 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd8e3a4-28f2-4149-b656-5e62fea7a398 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:06:55.076393 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd8e3a4-28f2-4149-b656-5e62fea7a398 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:55.093363 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492442a1-6644-4c55-ba40-159b4308c0fd service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:55.102625 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd8e3a4-28f2-4149-b656-5e62fea7a398 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:55.104120 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1030/2064] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:06:54 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:06:55.118467 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1035/2065] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:06:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:06:55.123784 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492442a1-6644-4c55-ba40-159b4308c0fd service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:55.133986 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492442a1-6644-4c55-ba40-159b4308c0fd service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:55.138546 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5a0ba-f856-484d-97dd-f59e234afb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:55.139610 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5a0ba-f856-484d-97dd-f59e234afb6e admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:55.139935 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5a0ba-f856-484d-97dd-f59e234afb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:55.140587 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5a0ba-f856-484d-97dd-f59e234afb6e admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:55.140985 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5a0ba-f856-484d-97dd-f59e234afb6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:55.169642 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5a0ba-f856-484d-97dd-f59e234afb6e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:55.211610 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1031/2066] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:06:55 2021] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:55.213901 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd8e3a4-28f2-4149-b656-5e62fea7a398 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:55.226814 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd8e3a4-28f2-4149-b656-5e62fea7a398 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:55.307697 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc441e4d-a548-4795-a680-dcb192cb1cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:55.308325 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc441e4d-a548-4795-a680-dcb192cb1cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:55.308614 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc441e4d-a548-4795-a680-dcb192cb1cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:55.309329 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc441e4d-a548-4795-a680-dcb192cb1cf2 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:55.309678 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc441e4d-a548-4795-a680-dcb192cb1cf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:55.336829 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc441e4d-a548-4795-a680-dcb192cb1cf2 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:55.359545 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1036/2067] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:06:55 2021] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:55.363561 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5a0ba-f856-484d-97dd-f59e234afb6e admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:55.373768 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5a0ba-f856-484d-97dd-f59e234afb6e admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:55.378167 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fcfe68-541d-4749-8695-2b21a1e82fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:55.378786 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcfe68-541d-4749-8695-2b21a1e82fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:55.379074 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcfe68-541d-4749-8695-2b21a1e82fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:55.379355 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fcfe68-541d-4749-8695-2b21a1e82fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:55.380096 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcfe68-541d-4749-8695-2b21a1e82fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:55.406148 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fcfe68-541d-4749-8695-2b21a1e82fa6 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:55.418013 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1032/2068] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:55 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:06:55.422020 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc441e4d-a548-4795-a680-dcb192cb1cf2 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:55.432166 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc441e4d-a548-4795-a680-dcb192cb1cf2 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:55.436681 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab731f9d-cdf4-4795-91fd-a206c4b3cda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:55.437531 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab731f9d-cdf4-4795-91fd-a206c4b3cda4 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:55.437821 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab731f9d-cdf4-4795-91fd-a206c4b3cda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:55.438097 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab731f9d-cdf4-4795-91fd-a206c4b3cda4 admin admin] PATH_INFO: `/v3/projects/149d1f8afde44baea4fb13ed38e37a6a/users/f5549a62218f4a3bb089fe6f9bb9d6de/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:55.458208 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab731f9d-cdf4-4795-91fd-a206c4b3cda4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=149d1f8afde44baea4fb13ed38e37a6a, user_id=f5549a62218f4a3bb089fe6f9bb9d6de, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:55.485633 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab731f9d-cdf4-4795-91fd-a206c4b3cda4 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:55.499645 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1037/2069] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:55 2021] PUT /identity/v3/projects/149d1f8afde44baea4fb13ed38e37a6a/users/f5549a62218f4a3bb089fe6f9bb9d6de/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:55.510089 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0660e39-9d4e-4f5f-82f0-0d4d27d40c4c None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:55.510388 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0660e39-9d4e-4f5f-82f0-0d4d27d40c4c None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:55.510669 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0660e39-9d4e-4f5f-82f0-0d4d27d40c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:55.520488 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab731f9d-cdf4-4795-91fd-a206c4b3cda4 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:55.522216 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-ab731f9d-cdf4-4795-91fd-a206c4b3cda4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:55.552876 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-b0660e39-9d4e-4f5f-82f0-0d4d27d40c4c None None] MFA Rules not processed for user `f5549a62218f4a3bb089fe6f9bb9d6de`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:55.554066 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-b0660e39-9d4e-4f5f-82f0-0d4d27d40c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:55.602387 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab731f9d-cdf4-4795-91fd-a206c4b3cda4 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:55.606920 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1e44d-7c50-4fdd-ba48-77e83adfccf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:55.607754 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1e44d-7c50-4fdd-ba48-77e83adfccf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:55.608041 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1e44d-7c50-4fdd-ba48-77e83adfccf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:55.608319 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1e44d-7c50-4fdd-ba48-77e83adfccf7 admin admin] PATH_INFO: `/v3/projects/a9a36c6b557640e2a78ae9e614057f18` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:55.609447 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1e44d-7c50-4fdd-ba48-77e83adfccf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9a36c6b557640e2a78ae9e614057f18)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:55.632255 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1033/2070] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:55 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:55.635544 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1e44d-7c50-4fdd-ba48-77e83adfccf7 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:55.637123 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0660e39-9d4e-4f5f-82f0-0d4d27d40c4c None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:55.647236 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0660e39-9d4e-4f5f-82f0-0d4d27d40c4c None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:55.652294 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc17bcd-2323-44f2-a48c-806703c79319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:55.652905 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc17bcd-2323-44f2-a48c-806703c79319 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:55.653196 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc17bcd-2323-44f2-a48c-806703c79319 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:55.653474 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc17bcd-2323-44f2-a48c-806703c79319 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:55.654128 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc17bcd-2323-44f2-a48c-806703c79319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:55.680457 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc17bcd-2323-44f2-a48c-806703c79319 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:55.716973 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1034/2071] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:06:55 2021] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:06:55.718209 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc17bcd-2323-44f2-a48c-806703c79319 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:55.772707 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-88a1e44d-7c50-4fdd-ba48-77e83adfccf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9a36c6b557640e2a78ae9e614057f18', 'request_id': 'req-88a1e44d-7c50-4fdd-ba48-77e83adfccf7'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:55.778880 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-88a1e44d-7c50-4fdd-ba48-77e83adfccf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9a36c6b557640e2a78ae9e614057f18', 'request_id': 'req-88a1e44d-7c50-4fdd-ba48-77e83adfccf7'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:55.791235 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-88a1e44d-7c50-4fdd-ba48-77e83adfccf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9a36c6b557640e2a78ae9e614057f18', 'request_id': 'req-88a1e44d-7c50-4fdd-ba48-77e83adfccf7'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:55.794264 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc17bcd-2323-44f2-a48c-806703c79319 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:55.804712 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-88a1e44d-7c50-4fdd-ba48-77e83adfccf7 admin admin] The token cache is being invalidate because project a9a36c6b557640e2a78ae9e614057f18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:06:55.805009 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-88a1e44d-7c50-4fdd-ba48-77e83adfccf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:55.805631 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-88a1e44d-7c50-4fdd-ba48-77e83adfccf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:55.807111 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1038/2072] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:06:55 2021] DELETE /identity/v3/projects/a9a36c6b557640e2a78ae9e614057f18 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:55.811183 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1e44d-7c50-4fdd-ba48-77e83adfccf7 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:55.812513 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-88a1e44d-7c50-4fdd-ba48-77e83adfccf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:55.863021 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a950f5-506b-42a5-8a7b-8ec3b5143158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:55.863219 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a950f5-506b-42a5-8a7b-8ec3b5143158 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:55.863523 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a950f5-506b-42a5-8a7b-8ec3b5143158 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:55.863802 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a950f5-506b-42a5-8a7b-8ec3b5143158 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:55.864447 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a950f5-506b-42a5-8a7b-8ec3b5143158 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:55.888677 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1e44d-7c50-4fdd-ba48-77e83adfccf7 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:55.890833 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a950f5-506b-42a5-8a7b-8ec3b5143158 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:55.897143 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c8381-2495-4c06-9e04-4d326e0c019d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:55.897953 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c8381-2495-4c06-9e04-4d326e0c019d admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:55.898237 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c8381-2495-4c06-9e04-4d326e0c019d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:55.898519 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c8381-2495-4c06-9e04-4d326e0c019d admin admin] PATH_INFO: `/v3/users/6a236bdb33c14daaba1078c22c699da9` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:55.899674 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c8381-2495-4c06-9e04-4d326e0c019d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a236bdb33c14daaba1078c22c699da9)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:55.913013 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1035/2073] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:06:55 2021] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:06:55.917083 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a950f5-506b-42a5-8a7b-8ec3b5143158 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:55.919155 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-95a950f5-506b-42a5-8a7b-8ec3b5143158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:55.927570 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c8381-2495-4c06-9e04-4d326e0c019d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:55.931037 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a950f5-506b-42a5-8a7b-8ec3b5143158 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:55.935868 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d320c-ecfe-49db-b5e0-5922bc7276c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:55.936354 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d320c-ecfe-49db-b5e0-5922bc7276c4 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:55.936644 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d320c-ecfe-49db-b5e0-5922bc7276c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:55.936922 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d320c-ecfe-49db-b5e0-5922bc7276c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:55.937964 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d320c-ecfe-49db-b5e0-5922bc7276c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:55.966195 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d320c-ecfe-49db-b5e0-5922bc7276c4 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:55.981282 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1036/2074] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:55 2021] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:06:55.985670 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d320c-ecfe-49db-b5e0-5922bc7276c4 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:55.992676 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-1f9c8381-2495-4c06-9e04-4d326e0c019d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a236bdb33c14daaba1078c22c699da9'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:55.993436 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-1f9c8381-2495-4c06-9e04-4d326e0c019d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a236bdb33c14daaba1078c22c699da9'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:55.996433 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d320c-ecfe-49db-b5e0-5922bc7276c4 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:56.001529 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bc8c5-80fe-4a7b-aee4-c46540f213d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:56.002366 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bc8c5-80fe-4a7b-aee4-c46540f213d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:56.002798 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bc8c5-80fe-4a7b-aee4-c46540f213d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:56.003082 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bc8c5-80fe-4a7b-aee4-c46540f213d9 admin admin] PATH_INFO: `/v3/projects/e3e73b931f2d489d86746d049d21004e/users/e3362a89e6e24829b415073e2e79472a/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:56.008844 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-1f9c8381-2495-4c06-9e04-4d326e0c019d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a236bdb33c14daaba1078c22c699da9'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:56.019340 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-1f9c8381-2495-4c06-9e04-4d326e0c019d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a236bdb33c14daaba1078c22c699da9'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:56.028738 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180bc8c5-80fe-4a7b-aee4-c46540f213d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3e73b931f2d489d86746d049d21004e, user_id=e3362a89e6e24829b415073e2e79472a, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:56.030082 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-1f9c8381-2495-4c06-9e04-4d326e0c019d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a236bdb33c14daaba1078c22c699da9'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:56.037450 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1039/2075] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:06:55 2021] DELETE /identity/v3/users/6a236bdb33c14daaba1078c22c699da9 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:06:56.059626 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180bc8c5-80fe-4a7b-aee4-c46540f213d9 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:56.092003 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1037/2076] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:55 2021] PUT /identity/v3/projects/e3e73b931f2d489d86746d049d21004e/users/e3362a89e6e24829b415073e2e79472a/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:06:56.093791 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b12240-ff26-40ca-925b-b5c71ace2f7b None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:56.094094 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b12240-ff26-40ca-925b-b5c71ace2f7b None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:56.094508 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b12240-ff26-40ca-925b-b5c71ace2f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:56.140330 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-f9b12240-ff26-40ca-925b-b5c71ace2f7b None None] MFA Rules not processed for user `e3362a89e6e24829b415073e2e79472a`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:56.141484 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-f9b12240-ff26-40ca-925b-b5c71ace2f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:56.233257 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bc8c5-80fe-4a7b-aee4-c46540f213d9 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:56.234757 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1040/2077] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:56 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:06:56.235641 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-180bc8c5-80fe-4a7b-aee4-c46540f213d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:56.342994 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bc8c5-80fe-4a7b-aee4-c46540f213d9 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:56.347330 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b28c5-7485-47ff-9c01-7f0e277af77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:56.347962 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b28c5-7485-47ff-9c01-7f0e277af77c admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:56.348251 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b28c5-7485-47ff-9c01-7f0e277af77c admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:56.348531 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b28c5-7485-47ff-9c01-7f0e277af77c admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:56.349170 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b28c5-7485-47ff-9c01-7f0e277af77c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:56.375981 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b28c5-7485-47ff-9c01-7f0e277af77c admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:56.410458 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1038/2078] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:06:56 2021] POST /identity/v3/projects => generated 381 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:06:56.414585 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b12240-ff26-40ca-925b-b5c71ace2f7b None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:56.425676 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b12240-ff26-40ca-925b-b5c71ace2f7b None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:56.493827 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784fee6f-e944-46fe-af83-2bb4b4f9bd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:56.495133 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fee6f-e944-46fe-af83-2bb4b4f9bd1c admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:56.496032 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fee6f-e944-46fe-af83-2bb4b4f9bd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:56.496032 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784fee6f-e944-46fe-af83-2bb4b4f9bd1c admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:56.496718 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784fee6f-e944-46fe-af83-2bb4b4f9bd1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:56.503988 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b28c5-7485-47ff-9c01-7f0e277af77c admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:56.505649 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-617b28c5-7485-47ff-9c01-7f0e277af77c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:56.517678 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b28c5-7485-47ff-9c01-7f0e277af77c admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:56.522307 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd33f9a-a80a-45dc-8102-c0f9a62b8235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:56.523195 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd33f9a-a80a-45dc-8102-c0f9a62b8235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:56.523406 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd33f9a-a80a-45dc-8102-c0f9a62b8235 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:56.523684 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd33f9a-a80a-45dc-8102-c0f9a62b8235 admin admin] PATH_INFO: `/v3/projects/833419f52fd6401ca6d328c154133578` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:56.524845 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd33f9a-a80a-45dc-8102-c0f9a62b8235 admin admin] RBAC: Authorizing `identity:delete_project(project_id=833419f52fd6401ca6d328c154133578)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:56.526057 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784fee6f-e944-46fe-af83-2bb4b4f9bd1c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:56.554181 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1041/2079] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:06:56 2021] POST /identity/v3/users => generated 297 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:56.554404 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd33f9a-a80a-45dc-8102-c0f9a62b8235 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:56.555643 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784fee6f-e944-46fe-af83-2bb4b4f9bd1c admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:56.567361 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784fee6f-e944-46fe-af83-2bb4b4f9bd1c admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:56.571777 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d50d5c-1486-4dc1-944a-0a611adc66fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:56.572392 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d50d5c-1486-4dc1-944a-0a611adc66fb admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:56.572685 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d50d5c-1486-4dc1-944a-0a611adc66fb admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:56.572967 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d50d5c-1486-4dc1-944a-0a611adc66fb admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:56.573705 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d50d5c-1486-4dc1-944a-0a611adc66fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:56.599823 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d50d5c-1486-4dc1-944a-0a611adc66fb admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:56.611890 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1042/2080] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:56 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:06:56.612264 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-8bd33f9a-a80a-45dc-8102-c0f9a62b8235 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '833419f52fd6401ca6d328c154133578', 'request_id': 'req-8bd33f9a-a80a-45dc-8102-c0f9a62b8235'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:56.616250 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d50d5c-1486-4dc1-944a-0a611adc66fb admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:56.617915 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-8bd33f9a-a80a-45dc-8102-c0f9a62b8235 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '833419f52fd6401ca6d328c154133578', 'request_id': 'req-8bd33f9a-a80a-45dc-8102-c0f9a62b8235'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:56.627055 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d50d5c-1486-4dc1-944a-0a611adc66fb admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:56.632103 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-8bd33f9a-a80a-45dc-8102-c0f9a62b8235 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '833419f52fd6401ca6d328c154133578', 'request_id': 'req-8bd33f9a-a80a-45dc-8102-c0f9a62b8235'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:56.645335 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-8bd33f9a-a80a-45dc-8102-c0f9a62b8235 admin admin] The token cache is being invalidate because project 833419f52fd6401ca6d328c154133578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:06:56.646000 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-8bd33f9a-a80a-45dc-8102-c0f9a62b8235 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:56.646566 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-8bd33f9a-a80a-45dc-8102-c0f9a62b8235 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:06:56.648109 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1039/2081] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:06:56 2021] DELETE /identity/v3/projects/833419f52fd6401ca6d328c154133578 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:06:56.653722 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d593fda-4c1a-448b-a35b-367955cf7b01 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:56.654164 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d593fda-4c1a-448b-a35b-367955cf7b01 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:56.654588 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d593fda-4c1a-448b-a35b-367955cf7b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:56.679604 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-5d593fda-4c1a-448b-a35b-367955cf7b01 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:56.680769 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-5d593fda-4c1a-448b-a35b-367955cf7b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:56.698108 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd160e-631d-412e-8849-79cf25a5a811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:56.698933 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd160e-631d-412e-8849-79cf25a5a811 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:56.699218 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd160e-631d-412e-8849-79cf25a5a811 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:56.699532 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd160e-631d-412e-8849-79cf25a5a811 admin admin] PATH_INFO: `/v3/projects/34238b838472447a9c05bcec058f6cbc/users/d749a637c4f54c8e8753e99578473192/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:56.720061 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd160e-631d-412e-8849-79cf25a5a811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34238b838472447a9c05bcec058f6cbc, user_id=d749a637c4f54c8e8753e99578473192, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:56.746933 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd160e-631d-412e-8849-79cf25a5a811 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:56.748463 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1040/2082] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:06:56.757383 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a26a1a-6f16-4678-a6ce-8d5ab464a942 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:56.757662 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a26a1a-6f16-4678-a6ce-8d5ab464a942 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:56.757941 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a26a1a-6f16-4678-a6ce-8d5ab464a942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:56.760506 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1043/2083] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:56 2021] PUT /identity/v3/projects/34238b838472447a9c05bcec058f6cbc/users/d749a637c4f54c8e8753e99578473192/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:56.765085 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd160e-631d-412e-8849-79cf25a5a811 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:56.766830 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-31cd160e-631d-412e-8849-79cf25a5a811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:56.780640 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-74a26a1a-6f16-4678-a6ce-8d5ab464a942 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:56.782019 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-74a26a1a-6f16-4678-a6ce-8d5ab464a942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:56.839708 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd160e-631d-412e-8849-79cf25a5a811 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:56.847957 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6e6f3-1639-4995-a470-daaf0a117c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:56.848609 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6e6f3-1639-4995-a470-daaf0a117c49 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:56.848899 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6e6f3-1639-4995-a470-daaf0a117c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:56.849184 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6e6f3-1639-4995-a470-daaf0a117c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:56.850135 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6e6f3-1639-4995-a470-daaf0a117c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:56.850264 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1041/2084] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:06:56.855697 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a26a1a-6f16-4678-a6ce-8d5ab464a942 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:56.864643 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a26a1a-6f16-4678-a6ce-8d5ab464a942 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:56.869758 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61981325-a6ba-4f21-8fdf-e3c6b1908b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:56.870386 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61981325-a6ba-4f21-8fdf-e3c6b1908b5e admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:56.870632 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61981325-a6ba-4f21-8fdf-e3c6b1908b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:56.870901 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61981325-a6ba-4f21-8fdf-e3c6b1908b5e admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:56.871822 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61981325-a6ba-4f21-8fdf-e3c6b1908b5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:06:56.872008 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61981325-a6ba-4f21-8fdf-e3c6b1908b5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:56.882363 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6e6f3-1639-4995-a470-daaf0a117c49 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:56.896800 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1044/2085] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:56 2021] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:06:56.899355 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6e6f3-1639-4995-a470-daaf0a117c49 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:56.902176 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61981325-a6ba-4f21-8fdf-e3c6b1908b5e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:56.911479 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6e6f3-1639-4995-a470-daaf0a117c49 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:56.918336 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a97a87-3327-4e4e-9617-eac3cf21d07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:56.919286 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a97a87-3327-4e4e-9617-eac3cf21d07c admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:56.919697 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a97a87-3327-4e4e-9617-eac3cf21d07c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:56.920347 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a97a87-3327-4e4e-9617-eac3cf21d07c admin admin] PATH_INFO: `/v3/projects/34238b838472447a9c05bcec058f6cbc/users/d749a637c4f54c8e8753e99578473192/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:56.920645 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1042/2086] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:06:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 15:06:56.921542 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61981325-a6ba-4f21-8fdf-e3c6b1908b5e admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:56.922512 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a97a87-3327-4e4e-9617-eac3cf21d07c admin admin] RBAC: Authorizing `identity:create_grant(project_id=34238b838472447a9c05bcec058f6cbc, user_id=d749a637c4f54c8e8753e99578473192, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:56.933377 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61981325-a6ba-4f21-8fdf-e3c6b1908b5e admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:56.940174 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1112b8-a3e5-4896-aea8-886e02ec6dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:56.941400 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1112b8-a3e5-4896-aea8-886e02ec6dbe admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:56.941706 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1112b8-a3e5-4896-aea8-886e02ec6dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:56.941995 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1112b8-a3e5-4896-aea8-886e02ec6dbe admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:56.942779 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1112b8-a3e5-4896-aea8-886e02ec6dbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:56.958304 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a97a87-3327-4e4e-9617-eac3cf21d07c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:56.970148 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1045/2087] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:56 2021] PUT /identity/v3/projects/34238b838472447a9c05bcec058f6cbc/users/d749a637c4f54c8e8753e99578473192/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:56.973721 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1112b8-a3e5-4896-aea8-886e02ec6dbe admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:56.973988 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a97a87-3327-4e4e-9617-eac3cf21d07c admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:57.021872 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1043/2088] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:06:56 2021] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:57.022946 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1112b8-a3e5-4896-aea8-886e02ec6dbe admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:57.077065 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a97a87-3327-4e4e-9617-eac3cf21d07c admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:57.135788 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1112b8-a3e5-4896-aea8-886e02ec6dbe admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:57.148322 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1e9f8-2397-477a-a1f0-c52e33c0bf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:57.148957 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1e9f8-2397-477a-a1f0-c52e33c0bf7a admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:57.149404 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1e9f8-2397-477a-a1f0-c52e33c0bf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:57.149699 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1e9f8-2397-477a-a1f0-c52e33c0bf7a admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:57.152495 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1e9f8-2397-477a-a1f0-c52e33c0bf7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:57.164242 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decaa5e-9972-4ea7-8968-1151e2e3298b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:57.165054 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decaa5e-9972-4ea7-8968-1151e2e3298b admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:57.165938 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decaa5e-9972-4ea7-8968-1151e2e3298b admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:57.166410 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1decaa5e-9972-4ea7-8968-1151e2e3298b admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:57.167634 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decaa5e-9972-4ea7-8968-1151e2e3298b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:57.187161 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e1e9f8-2397-477a-a1f0-c52e33c0bf7a admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:57.207234 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1decaa5e-9972-4ea7-8968-1151e2e3298b admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:57.214956 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1044/2089] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:06:57 2021] POST /identity/v3/users => generated 286 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:06:57.223493 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1046/2090] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:56 2021] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:06:57.224804 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1e9f8-2397-477a-a1f0-c52e33c0bf7a admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:57.226221 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decaa5e-9972-4ea7-8968-1151e2e3298b admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:57.245576 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1e9f8-2397-477a-a1f0-c52e33c0bf7a admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:57.245799 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1decaa5e-9972-4ea7-8968-1151e2e3298b admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:57.251417 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e85e5-d50a-4829-a8e0-4439b8cf9d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:57.252146 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712f37d-4e09-4858-8b4d-225ef5f325dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:57.252490 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e85e5-d50a-4829-a8e0-4439b8cf9d81 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:57.252848 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712f37d-4e09-4858-8b4d-225ef5f325dc admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:57.252987 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e85e5-d50a-4829-a8e0-4439b8cf9d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:57.253141 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712f37d-4e09-4858-8b4d-225ef5f325dc admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:57.253340 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e85e5-d50a-4829-a8e0-4439b8cf9d81 admin admin] PATH_INFO: `/v3/projects/34238b838472447a9c05bcec058f6cbc/users/d749a637c4f54c8e8753e99578473192/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:57.253449 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b712f37d-4e09-4858-8b4d-225ef5f325dc admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:57.254117 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b712f37d-4e09-4858-8b4d-225ef5f325dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:57.255451 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e85e5-d50a-4829-a8e0-4439b8cf9d81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34238b838472447a9c05bcec058f6cbc, user_id=d749a637c4f54c8e8753e99578473192, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:57.290118 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b712f37d-4e09-4858-8b4d-225ef5f325dc admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:57.294855 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e85e5-d50a-4829-a8e0-4439b8cf9d81 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:57.306111 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1045/2091] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:57 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:06:57.307378 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712f37d-4e09-4858-8b4d-225ef5f325dc admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:57.332353 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1047/2092] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:57 2021] PUT /identity/v3/projects/34238b838472447a9c05bcec058f6cbc/users/d749a637c4f54c8e8753e99578473192/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:57.332911 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b712f37d-4e09-4858-8b4d-225ef5f325dc admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:57.344669 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f01e0-dc7c-4025-b0d9-c668794f7400 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:57.344971 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f01e0-dc7c-4025-b0d9-c668794f7400 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:57.345295 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5f01e0-dc7c-4025-b0d9-c668794f7400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:57.408912 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-2f5f01e0-dc7c-4025-b0d9-c668794f7400 None None] MFA Rules not processed for user `d749a637c4f54c8e8753e99578473192`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:57.410390 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-2f5f01e0-dc7c-4025-b0d9-c668794f7400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:57.443966 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd5da1-d276-4063-8cf5-15ca6f0a2244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:57.444808 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd5da1-d276-4063-8cf5-15ca6f0a2244 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:57.445321 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd5da1-d276-4063-8cf5-15ca6f0a2244 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:57.445610 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd5da1-d276-4063-8cf5-15ca6f0a2244 admin admin] PATH_INFO: `/v3/projects/4734f34852554bd28d358bce0bdc1d13/users/a9cfedf4836f4ad18bdee2fedd12376c/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:57.471995 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd5da1-d276-4063-8cf5-15ca6f0a2244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4734f34852554bd28d358bce0bdc1d13, user_id=a9cfedf4836f4ad18bdee2fedd12376c, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:57.508902 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd5da1-d276-4063-8cf5-15ca6f0a2244 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:57.512153 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1048/2093] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:57 2021] POST /identity/v3/auth/tokens => generated 3755 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:06:57.531982 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1046/2094] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:06:57 2021] PUT /identity/v3/projects/4734f34852554bd28d358bce0bdc1d13/users/a9cfedf4836f4ad18bdee2fedd12376c/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:06:57.537484 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47b7f7-8810-4115-b03b-232f9f905cd4 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:57.537778 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47b7f7-8810-4115-b03b-232f9f905cd4 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:57.538059 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47b7f7-8810-4115-b03b-232f9f905cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:57.563161 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-ea47b7f7-8810-4115-b03b-232f9f905cd4 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:57.564928 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-ea47b7f7-8810-4115-b03b-232f9f905cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:57.595917 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd5da1-d276-4063-8cf5-15ca6f0a2244 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:57.598793 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-9ecd5da1-d276-4063-8cf5-15ca6f0a2244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:57.687045 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd5da1-d276-4063-8cf5-15ca6f0a2244 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:57.690577 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21af809-5e2b-4aa9-a601-421d92734117 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:57.691163 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21af809-5e2b-4aa9-a601-421d92734117 service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:57.691469 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21af809-5e2b-4aa9-a601-421d92734117 service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:57.691751 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21af809-5e2b-4aa9-a601-421d92734117 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:57.693594 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-c21af809-5e2b-4aa9-a601-421d92734117 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:57.699419 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1049/2095] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:57.709331 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10afed8a-8a3d-44e7-8b07-a89874a551f8 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:57.709821 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10afed8a-8a3d-44e7-8b07-a89874a551f8 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:57.710257 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10afed8a-8a3d-44e7-8b07-a89874a551f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:57.740111 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-10afed8a-8a3d-44e7-8b07-a89874a551f8 None None] MFA Rules not processed for user `7a86cdc90706440c8fa6bf9e101573b9`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:57.741770 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-10afed8a-8a3d-44e7-8b07-a89874a551f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:57.799340 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21af809-5e2b-4aa9-a601-421d92734117 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:57.825992 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21af809-5e2b-4aa9-a601-421d92734117 service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:57.828572 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1050/2096] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:57 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:57.829574 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10afed8a-8a3d-44e7-8b07-a89874a551f8 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:57.831011 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-10afed8a-8a3d-44e7-8b07-a89874a551f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:57.836144 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1047/2097] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:06:57 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:06:57.900358 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10afed8a-8a3d-44e7-8b07-a89874a551f8 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:57.904282 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27269414-9e73-4944-a79a-4e9fa388fdb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:57.906028 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27269414-9e73-4944-a79a-4e9fa388fdb5 service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:57.906028 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27269414-9e73-4944-a79a-4e9fa388fdb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:57.906220 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27269414-9e73-4944-a79a-4e9fa388fdb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:57.932489 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27269414-9e73-4944-a79a-4e9fa388fdb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:57.959367 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27269414-9e73-4944-a79a-4e9fa388fdb5 service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:57.968898 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1051/2098] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:06:57 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:06:59.501658 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062391b-1175-42c2-a212-41e13a3d1c2a None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:59.502594 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062391b-1175-42c2-a212-41e13a3d1c2a None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:59.503030 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062391b-1175-42c2-a212-41e13a3d1c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:59.548209 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-b062391b-1175-42c2-a212-41e13a3d1c2a None None] MFA Rules not processed for user `a9cfedf4836f4ad18bdee2fedd12376c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:06:59.549859 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-b062391b-1175-42c2-a212-41e13a3d1c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:59.683419 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1048/2099] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:06:59 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:06:59.684839 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27269414-9e73-4944-a79a-4e9fa388fdb5 service neutron] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:59.699314 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27269414-9e73-4944-a79a-4e9fa388fdb5 service neutron] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:59.705088 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890a98b-dc9e-449f-bba6-7bc55f719099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:59.705680 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890a98b-dc9e-449f-bba6-7bc55f719099 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:59.706305 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890a98b-dc9e-449f-bba6-7bc55f719099 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:59.706585 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890a98b-dc9e-449f-bba6-7bc55f719099 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:59.707216 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890a98b-dc9e-449f-bba6-7bc55f719099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:59.743799 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890a98b-dc9e-449f-bba6-7bc55f719099 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:59.794376 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1052/2100] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:06:59 2021] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:06:59.795419 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062391b-1175-42c2-a212-41e13a3d1c2a None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:59.797528 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890a98b-dc9e-449f-bba6-7bc55f719099 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:06:59.799064 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-3890a98b-dc9e-449f-bba6-7bc55f719099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:59.817984 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062391b-1175-42c2-a212-41e13a3d1c2a None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:59.879144 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890a98b-dc9e-449f-bba6-7bc55f719099 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:06:59.883959 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6ad0b-390a-4322-b04e-82d72d34e525 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:59.884981 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6ad0b-390a-4322-b04e-82d72d34e525 service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:59.885454 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6ad0b-390a-4322-b04e-82d72d34e525 service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:59.885889 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6ad0b-390a-4322-b04e-82d72d34e525 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:59.888233 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-39a6ad0b-390a-4322-b04e-82d72d34e525 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:06:59.940764 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd3b9b-f540-40ec-ac86-4ccf8b637895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:06:59.941377 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd3b9b-f540-40ec-ac86-4ccf8b637895 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:06:59.941661 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd3b9b-f540-40ec-ac86-4ccf8b637895 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:06:59.941940 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd3b9b-f540-40ec-ac86-4ccf8b637895 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:06:59.942574 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd3b9b-f540-40ec-ac86-4ccf8b637895 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:59.971256 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd3b9b-f540-40ec-ac86-4ccf8b637895 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:06:59.979990 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6ad0b-390a-4322-b04e-82d72d34e525 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:06:59.995485 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1049/2101] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:06:59 2021] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:06:59.998946 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd3b9b-f540-40ec-ac86-4ccf8b637895 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:00.009100 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a6ad0b-390a-4322-b04e-82d72d34e525 service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:00.017491 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd3b9b-f540-40ec-ac86-4ccf8b637895 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:00.018946 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1053/2102] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:06:59 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:07:00.025559 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae09da-022e-4284-9d2e-5d5e27579cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:00.026206 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae09da-022e-4284-9d2e-5d5e27579cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:00.026489 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae09da-022e-4284-9d2e-5d5e27579cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:00.026841 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ae09da-022e-4284-9d2e-5d5e27579cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:00.027718 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae09da-022e-4284-9d2e-5d5e27579cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:00.054808 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ae09da-022e-4284-9d2e-5d5e27579cc4 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:00.069960 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1050/2103] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:06:59 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:07:00.071309 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6ad0b-390a-4322-b04e-82d72d34e525 service cinder] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:00.084695 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a6ad0b-390a-4322-b04e-82d72d34e525 service cinder] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:00.089569 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c2d4e-1822-42ae-8e58-b20d51f6e32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:00.090673 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c2d4e-1822-42ae-8e58-b20d51f6e32d admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:00.090971 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c2d4e-1822-42ae-8e58-b20d51f6e32d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:00.091226 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c2d4e-1822-42ae-8e58-b20d51f6e32d admin admin] PATH_INFO: `/v3/projects/b31cfc4952224f229ca70f2dc59e3595/users/1cb0fb00ea2e46a0b266c9ea318d9473/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:00.116604 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c2d4e-1822-42ae-8e58-b20d51f6e32d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b31cfc4952224f229ca70f2dc59e3595, user_id=1cb0fb00ea2e46a0b266c9ea318d9473, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:00.145989 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c2d4e-1822-42ae-8e58-b20d51f6e32d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:00.163966 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1054/2104] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:07:00 2021] PUT /identity/v3/projects/b31cfc4952224f229ca70f2dc59e3595/users/1cb0fb00ea2e46a0b266c9ea318d9473/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:00.167862 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae09da-022e-4284-9d2e-5d5e27579cc4 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:00.178555 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ae09da-022e-4284-9d2e-5d5e27579cc4 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:00.294145 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e8678-41f3-4537-a521-d9cb7e705b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:00.294889 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e8678-41f3-4537-a521-d9cb7e705b50 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:00.295184 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e8678-41f3-4537-a521-d9cb7e705b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:00.295460 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e8678-41f3-4537-a521-d9cb7e705b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:00.296175 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e8678-41f3-4537-a521-d9cb7e705b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:00.330484 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871e8678-41f3-4537-a521-d9cb7e705b50 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:00.347095 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1051/2105] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:07:00 2021] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:07:00.347927 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c2d4e-1822-42ae-8e58-b20d51f6e32d admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:00.366092 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c2d4e-1822-42ae-8e58-b20d51f6e32d admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:00.373696 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48057f3-d766-47d4-a02b-d4b9c50f2ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:00.374660 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48057f3-d766-47d4-a02b-d4b9c50f2ece admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:00.375392 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48057f3-d766-47d4-a02b-d4b9c50f2ece admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:00.375705 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48057f3-d766-47d4-a02b-d4b9c50f2ece admin admin] PATH_INFO: `/v3/projects/b31cfc4952224f229ca70f2dc59e3595/users/1cb0fb00ea2e46a0b266c9ea318d9473/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:00.378312 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48057f3-d766-47d4-a02b-d4b9c50f2ece admin admin] RBAC: Authorizing `identity:create_grant(project_id=b31cfc4952224f229ca70f2dc59e3595, user_id=1cb0fb00ea2e46a0b266c9ea318d9473, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:00.414673 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48057f3-d766-47d4-a02b-d4b9c50f2ece admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:00.464136 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1055/2106] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:07:00 2021] PUT /identity/v3/projects/b31cfc4952224f229ca70f2dc59e3595/users/1cb0fb00ea2e46a0b266c9ea318d9473/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:00.468921 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e8678-41f3-4537-a521-d9cb7e705b50 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:00.482815 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e8678-41f3-4537-a521-d9cb7e705b50 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:00.587083 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc090a97-26e4-43a6-8597-8f5b5cd47751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:00.588056 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc090a97-26e4-43a6-8597-8f5b5cd47751 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:00.588482 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc090a97-26e4-43a6-8597-8f5b5cd47751 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:00.588767 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc090a97-26e4-43a6-8597-8f5b5cd47751 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:00.589516 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc090a97-26e4-43a6-8597-8f5b5cd47751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:00.636011 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc090a97-26e4-43a6-8597-8f5b5cd47751 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:00.651115 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1052/2107] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:07:00 2021] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:07:00.652400 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48057f3-d766-47d4-a02b-d4b9c50f2ece admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:00.669400 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48057f3-d766-47d4-a02b-d4b9c50f2ece admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:00.676946 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e7421-05ab-43ae-a3d2-5a6509466071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:00.677875 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e7421-05ab-43ae-a3d2-5a6509466071 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:00.678211 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e7421-05ab-43ae-a3d2-5a6509466071 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:00.678545 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e7421-05ab-43ae-a3d2-5a6509466071 admin admin] PATH_INFO: `/v3/projects/b31cfc4952224f229ca70f2dc59e3595/users/1cb0fb00ea2e46a0b266c9ea318d9473/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:00.682329 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e7421-05ab-43ae-a3d2-5a6509466071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b31cfc4952224f229ca70f2dc59e3595, user_id=1cb0fb00ea2e46a0b266c9ea318d9473, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:00.742103 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e7421-05ab-43ae-a3d2-5a6509466071 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:00.768521 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1056/2108] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:07:00 2021] PUT /identity/v3/projects/b31cfc4952224f229ca70f2dc59e3595/users/1cb0fb00ea2e46a0b266c9ea318d9473/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:01.464723 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc090a97-26e4-43a6-8597-8f5b5cd47751 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:01.577619 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc090a97-26e4-43a6-8597-8f5b5cd47751 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:01.671100 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105f9c1-6d6d-42bf-9ea0-84b5f71cff8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:01.671807 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105f9c1-6d6d-42bf-9ea0-84b5f71cff8c service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:01.672012 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105f9c1-6d6d-42bf-9ea0-84b5f71cff8c service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:01.672485 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105f9c1-6d6d-42bf-9ea0-84b5f71cff8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:01.773602 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d105f9c1-6d6d-42bf-9ea0-84b5f71cff8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:01.819559 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d105f9c1-6d6d-42bf-9ea0-84b5f71cff8c service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:01.834610 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1053/2109] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:07:01 2021] GET /identity/v3/auth/tokens => generated 3755 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:07:02.074500 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7cd8d-4345-407e-8a0c-b5c9b4d7540b None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:02.075067 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7cd8d-4345-407e-8a0c-b5c9b4d7540b None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:02.075317 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7cd8d-4345-407e-8a0c-b5c9b4d7540b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:02.157848 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-19c7cd8d-4345-407e-8a0c-b5c9b4d7540b None None] MFA Rules not processed for user `1cb0fb00ea2e46a0b266c9ea318d9473`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:02.159234 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-19c7cd8d-4345-407e-8a0c-b5c9b4d7540b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:02.287171 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1057/2110] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:02 2021] POST /identity/v3/auth/tokens => generated 3747 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:02.294587 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105f9c1-6d6d-42bf-9ea0-84b5f71cff8c service cinder] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:02.305148 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105f9c1-6d6d-42bf-9ea0-84b5f71cff8c service cinder] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:02.313779 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a0b1b-e19e-4353-b281-2709cc3e72bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:02.314379 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a0b1b-e19e-4353-b281-2709cc3e72bf service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:02.314671 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a0b1b-e19e-4353-b281-2709cc3e72bf service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:02.314991 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a0b1b-e19e-4353-b281-2709cc3e72bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:02.436865 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a0b1b-e19e-4353-b281-2709cc3e72bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:02.466456 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30a0b1b-e19e-4353-b281-2709cc3e72bf service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:02.476945 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1054/2111] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:07:02 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:07:02.651479 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7cd8d-4345-407e-8a0c-b5c9b4d7540b None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:02.657060 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-19c7cd8d-4345-407e-8a0c-b5c9b4d7540b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:02.732454 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7cd8d-4345-407e-8a0c-b5c9b4d7540b None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:02.739683 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ced06-42c1-4b2f-8c88-d290230ff312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:02.740619 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ced06-42c1-4b2f-8c88-d290230ff312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:02.740991 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ced06-42c1-4b2f-8c88-d290230ff312 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:02.741404 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ced06-42c1-4b2f-8c88-d290230ff312 admin admin] PATH_INFO: `/v3/users/7eca2e2a1c00459ba91ab7b1c3e26939` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:02.743577 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ced06-42c1-4b2f-8c88-d290230ff312 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eca2e2a1c00459ba91ab7b1c3e26939)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:02.780165 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ced06-42c1-4b2f-8c88-d290230ff312 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:02.907905 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-0a1ced06-42c1-4b2f-8c88-d290230ff312 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eca2e2a1c00459ba91ab7b1c3e26939'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:02.908794 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-0a1ced06-42c1-4b2f-8c88-d290230ff312 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eca2e2a1c00459ba91ab7b1c3e26939'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:02.922576 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-0a1ced06-42c1-4b2f-8c88-d290230ff312 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eca2e2a1c00459ba91ab7b1c3e26939'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:02.932303 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-0a1ced06-42c1-4b2f-8c88-d290230ff312 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eca2e2a1c00459ba91ab7b1c3e26939'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:02.942857 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-0a1ced06-42c1-4b2f-8c88-d290230ff312 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eca2e2a1c00459ba91ab7b1c3e26939'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:02.952360 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1058/2112] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:07:02 2021] DELETE /identity/v3/users/7eca2e2a1c00459ba91ab7b1c3e26939 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:02.960359 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9560e87-a596-46b8-a494-a58f61b554fd None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:02.960936 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9560e87-a596-46b8-a494-a58f61b554fd None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:02.960936 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9560e87-a596-46b8-a494-a58f61b554fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:02.987334 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-f9560e87-a596-46b8-a494-a58f61b554fd None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:02.988956 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-f9560e87-a596-46b8-a494-a58f61b554fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:03.092040 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1055/2113] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:03.093061 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ced06-42c1-4b2f-8c88-d290230ff312 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:03.094768 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-0a1ced06-42c1-4b2f-8c88-d290230ff312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:03.201901 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ced06-42c1-4b2f-8c88-d290230ff312 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:03.206920 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b5178-134f-45e7-85d0-5199af8322ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:03.207957 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b5178-134f-45e7-85d0-5199af8322ac service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:03.208454 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b5178-134f-45e7-85d0-5199af8322ac service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:03.208848 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b5178-134f-45e7-85d0-5199af8322ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:03.224962 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b5178-134f-45e7-85d0-5199af8322ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:03.259884 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b5178-134f-45e7-85d0-5199af8322ac service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:03.278936 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1059/2114] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:07:03 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:07:03.926730 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9560e87-a596-46b8-a494-a58f61b554fd None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:03.928136 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-f9560e87-a596-46b8-a494-a58f61b554fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:03.944055 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9560e87-a596-46b8-a494-a58f61b554fd None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:03.950645 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0c7f1-659e-4a2d-96d9-74e4f33b9379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:03.952117 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0c7f1-659e-4a2d-96d9-74e4f33b9379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:03.952693 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0c7f1-659e-4a2d-96d9-74e4f33b9379 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:03.953080 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0c7f1-659e-4a2d-96d9-74e4f33b9379 admin admin] PATH_INFO: `/v3/projects/010b0163e9ee4b699b90288f9970fec3` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:03.954165 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0c7f1-659e-4a2d-96d9-74e4f33b9379 admin admin] RBAC: Authorizing `identity:delete_project(project_id=010b0163e9ee4b699b90288f9970fec3)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:03.982329 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0c7f1-659e-4a2d-96d9-74e4f33b9379 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:04.046486 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-b1f0c7f1-659e-4a2d-96d9-74e4f33b9379 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '010b0163e9ee4b699b90288f9970fec3', 'request_id': 'req-b1f0c7f1-659e-4a2d-96d9-74e4f33b9379'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:04.051940 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-b1f0c7f1-659e-4a2d-96d9-74e4f33b9379 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '010b0163e9ee4b699b90288f9970fec3', 'request_id': 'req-b1f0c7f1-659e-4a2d-96d9-74e4f33b9379'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:04.063081 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-b1f0c7f1-659e-4a2d-96d9-74e4f33b9379 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '010b0163e9ee4b699b90288f9970fec3', 'request_id': 'req-b1f0c7f1-659e-4a2d-96d9-74e4f33b9379'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:04.076335 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-b1f0c7f1-659e-4a2d-96d9-74e4f33b9379 admin admin] The token cache is being invalidate because project 010b0163e9ee4b699b90288f9970fec3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:07:04.076618 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-b1f0c7f1-659e-4a2d-96d9-74e4f33b9379 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:04.077211 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-b1f0c7f1-659e-4a2d-96d9-74e4f33b9379 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:04.078849 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1056/2115] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:07:03 2021] DELETE /identity/v3/projects/010b0163e9ee4b699b90288f9970fec3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:04.082815 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b5178-134f-45e7-85d0-5199af8322ac service neutron] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:04.092919 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b5178-134f-45e7-85d0-5199af8322ac service neutron] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:04.156675 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009073b-fd2c-4eb2-aa6d-55a046fdd263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:04.157501 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009073b-fd2c-4eb2-aa6d-55a046fdd263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:04.157742 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009073b-fd2c-4eb2-aa6d-55a046fdd263 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:04.158033 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009073b-fd2c-4eb2-aa6d-55a046fdd263 admin admin] PATH_INFO: `/v3/users/3269e4d8333f446ba9344018f22a85bc` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:04.159264 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009073b-fd2c-4eb2-aa6d-55a046fdd263 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3269e4d8333f446ba9344018f22a85bc)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:04.185659 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009073b-fd2c-4eb2-aa6d-55a046fdd263 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:04.244849 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-8009073b-fd2c-4eb2-aa6d-55a046fdd263 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3269e4d8333f446ba9344018f22a85bc'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:04.245471 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-8009073b-fd2c-4eb2-aa6d-55a046fdd263 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3269e4d8333f446ba9344018f22a85bc'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:04.263453 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-8009073b-fd2c-4eb2-aa6d-55a046fdd263 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3269e4d8333f446ba9344018f22a85bc'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:04.270759 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0c7f1-659e-4a2d-96d9-74e4f33b9379 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:04.272331 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-b1f0c7f1-659e-4a2d-96d9-74e4f33b9379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:04.275085 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-8009073b-fd2c-4eb2-aa6d-55a046fdd263 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3269e4d8333f446ba9344018f22a85bc'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:04.285399 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-8009073b-fd2c-4eb2-aa6d-55a046fdd263 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3269e4d8333f446ba9344018f22a85bc'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:04.293787 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1060/2116] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:07:04 2021] DELETE /identity/v3/users/3269e4d8333f446ba9344018f22a85bc => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:04.394047 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0c7f1-659e-4a2d-96d9-74e4f33b9379 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:04.464260 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8fec8-7eee-4c04-9c87-9f0cf34da6dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:04.465548 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8fec8-7eee-4c04-9c87-9f0cf34da6dc service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:04.465983 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8fec8-7eee-4c04-9c87-9f0cf34da6dc service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:04.466344 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8fec8-7eee-4c04-9c87-9f0cf34da6dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:04.472327 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-56b8fec8-7eee-4c04-9c87-9f0cf34da6dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:04.590120 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8fec8-7eee-4c04-9c87-9f0cf34da6dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:04.681486 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b8fec8-7eee-4c04-9c87-9f0cf34da6dc service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:04.698448 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1057/2117] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:07:04 2021] GET /identity/v3/auth/tokens => generated 3747 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:07:05.130374 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009073b-fd2c-4eb2-aa6d-55a046fdd263 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:05.131951 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-8009073b-fd2c-4eb2-aa6d-55a046fdd263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:05.246720 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009073b-fd2c-4eb2-aa6d-55a046fdd263 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:05.252443 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9d396-d27f-4d3a-b312-8574833e8997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:05.253293 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9d396-d27f-4d3a-b312-8574833e8997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:05.253758 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9d396-d27f-4d3a-b312-8574833e8997 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:05.254230 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9d396-d27f-4d3a-b312-8574833e8997 admin admin] PATH_INFO: `/v3/projects/9ad3c953de67450b96b7f9df354ee36d` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:05.255553 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a9d396-d27f-4d3a-b312-8574833e8997 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ad3c953de67450b96b7f9df354ee36d)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:05.303275 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a9d396-d27f-4d3a-b312-8574833e8997 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:05.383144 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b7a9d396-d27f-4d3a-b312-8574833e8997 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ad3c953de67450b96b7f9df354ee36d', 'request_id': 'req-b7a9d396-d27f-4d3a-b312-8574833e8997'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:05.395233 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b7a9d396-d27f-4d3a-b312-8574833e8997 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ad3c953de67450b96b7f9df354ee36d', 'request_id': 'req-b7a9d396-d27f-4d3a-b312-8574833e8997'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:05.416798 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b7a9d396-d27f-4d3a-b312-8574833e8997 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ad3c953de67450b96b7f9df354ee36d', 'request_id': 'req-b7a9d396-d27f-4d3a-b312-8574833e8997'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:05.438219 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b7a9d396-d27f-4d3a-b312-8574833e8997 admin admin] The token cache is being invalidate because project 9ad3c953de67450b96b7f9df354ee36d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:07:05.438494 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b7a9d396-d27f-4d3a-b312-8574833e8997 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:05.439332 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b7a9d396-d27f-4d3a-b312-8574833e8997 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:05.443678 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1061/2118] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:07:05 2021] DELETE /identity/v3/projects/9ad3c953de67450b96b7f9df354ee36d => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:05.462754 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacf7c2-36a7-467d-8fa3-ba544834cc54 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:05.463282 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacf7c2-36a7-467d-8fa3-ba544834cc54 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:05.463378 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacf7c2-36a7-467d-8fa3-ba544834cc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:05.490394 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-2bacf7c2-36a7-467d-8fa3-ba544834cc54 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:05.491682 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-2bacf7c2-36a7-467d-8fa3-ba544834cc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:05.582835 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1058/2119] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:07:05.590444 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fee95f-7b72-452d-bf26-e2d81288bfbf None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:05.590690 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fee95f-7b72-452d-bf26-e2d81288bfbf None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:05.591019 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fee95f-7b72-452d-bf26-e2d81288bfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:05.616650 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-b9fee95f-7b72-452d-bf26-e2d81288bfbf None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:05.617801 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-b9fee95f-7b72-452d-bf26-e2d81288bfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:05.627058 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1062/2120] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:05 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:07:05.631570 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacf7c2-36a7-467d-8fa3-ba544834cc54 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:05.641509 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacf7c2-36a7-467d-8fa3-ba544834cc54 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:05.646270 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdc603-e0af-4079-931f-6dcb3f0f1f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:05.647048 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdc603-e0af-4079-931f-6dcb3f0f1f8c admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:05.647468 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdc603-e0af-4079-931f-6dcb3f0f1f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:05.648178 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbdc603-e0af-4079-931f-6dcb3f0f1f8c admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:05.648702 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbdc603-e0af-4079-931f-6dcb3f0f1f8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:07:05.649008 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbdc603-e0af-4079-931f-6dcb3f0f1f8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:05.676294 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbdc603-e0af-4079-931f-6dcb3f0f1f8c admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:05.695851 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1059/2121] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:07:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 15:07:05.700317 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fee95f-7b72-452d-bf26-e2d81288bfbf None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:05.711366 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fee95f-7b72-452d-bf26-e2d81288bfbf None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:05.717257 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca3dc7-4a8d-4466-ad24-88c8f517b75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:05.718256 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca3dc7-4a8d-4466-ad24-88c8f517b75f admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:05.718645 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca3dc7-4a8d-4466-ad24-88c8f517b75f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:05.719151 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca3dc7-4a8d-4466-ad24-88c8f517b75f admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:05.719988 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca3dc7-4a8d-4466-ad24-88c8f517b75f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:05.750817 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca3dc7-4a8d-4466-ad24-88c8f517b75f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:05.792784 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1063/2122] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:07:05 2021] POST /identity/v3/projects => generated 401 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:07:05.797654 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdc603-e0af-4079-931f-6dcb3f0f1f8c admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:05.809062 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbdc603-e0af-4079-931f-6dcb3f0f1f8c admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:05.939544 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed33f7e-838a-431f-92db-618422323b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:05.940169 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed33f7e-838a-431f-92db-618422323b10 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:05.940452 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed33f7e-838a-431f-92db-618422323b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:05.940725 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed33f7e-838a-431f-92db-618422323b10 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:05.941371 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed33f7e-838a-431f-92db-618422323b10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:05.993484 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed33f7e-838a-431f-92db-618422323b10 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:06.038179 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1060/2123] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:07:05 2021] POST /identity/v3/users => generated 301 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:07:06.049107 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca3dc7-4a8d-4466-ad24-88c8f517b75f admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:06.059296 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca3dc7-4a8d-4466-ad24-88c8f517b75f admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:06.070833 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4610823-6226-4b14-8211-eec02677c6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:06.071449 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4610823-6226-4b14-8211-eec02677c6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:06.072264 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4610823-6226-4b14-8211-eec02677c6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:06.072543 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4610823-6226-4b14-8211-eec02677c6d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:06.073239 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4610823-6226-4b14-8211-eec02677c6d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:06.098771 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4610823-6226-4b14-8211-eec02677c6d4 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:06.109479 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1064/2124] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:07:06 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:07:06.113646 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed33f7e-838a-431f-92db-618422323b10 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:06.123635 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed33f7e-838a-431f-92db-618422323b10 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:06.127940 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af595fd5-eb79-46f7-b235-a56783a0d47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:06.128760 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af595fd5-eb79-46f7-b235-a56783a0d47e admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:06.129074 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af595fd5-eb79-46f7-b235-a56783a0d47e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:06.129423 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af595fd5-eb79-46f7-b235-a56783a0d47e admin admin] PATH_INFO: `/v3/projects/b96be6bd42e54b69badfaa3b05b6fd94/users/18e70d7ac5204084a1001675d3f3974f/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:06.152253 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af595fd5-eb79-46f7-b235-a56783a0d47e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b96be6bd42e54b69badfaa3b05b6fd94, user_id=18e70d7ac5204084a1001675d3f3974f, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:06.179752 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af595fd5-eb79-46f7-b235-a56783a0d47e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:06.192288 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1061/2125] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:07:06 2021] PUT /identity/v3/projects/b96be6bd42e54b69badfaa3b05b6fd94/users/18e70d7ac5204084a1001675d3f3974f/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:07:06.203035 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2407d-678d-469c-b907-4bba68ebc915 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:06.203327 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2407d-678d-469c-b907-4bba68ebc915 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:06.203657 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2407d-678d-469c-b907-4bba68ebc915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:06.242278 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-cfd2407d-678d-469c-b907-4bba68ebc915 None None] MFA Rules not processed for user `18e70d7ac5204084a1001675d3f3974f`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:06.243407 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-cfd2407d-678d-469c-b907-4bba68ebc915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:06.319791 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1065/2126] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:06 2021] POST /identity/v3/auth/tokens => generated 3708 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:06.325436 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af595fd5-eb79-46f7-b235-a56783a0d47e admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:06.401901 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af595fd5-eb79-46f7-b235-a56783a0d47e admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:06.408102 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca3115-a943-4b2c-9250-c35373f3849e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:06.408678 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca3115-a943-4b2c-9250-c35373f3849e admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:06.408966 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca3115-a943-4b2c-9250-c35373f3849e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:06.409251 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca3115-a943-4b2c-9250-c35373f3849e admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:06.409904 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca3115-a943-4b2c-9250-c35373f3849e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:06.438838 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca3115-a943-4b2c-9250-c35373f3849e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:06.469943 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1062/2127] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:07:06 2021] POST /identity/v3/projects => generated 401 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:07:06.473863 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2407d-678d-469c-b907-4bba68ebc915 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:06.488049 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2407d-678d-469c-b907-4bba68ebc915 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:06.575759 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c68ca-91b3-4509-b60f-9ba449c71b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:06.576468 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c68ca-91b3-4509-b60f-9ba449c71b1e admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:06.576979 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c68ca-91b3-4509-b60f-9ba449c71b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:06.577449 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c68ca-91b3-4509-b60f-9ba449c71b1e admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:06.578268 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c68ca-91b3-4509-b60f-9ba449c71b1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:06.605156 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c68ca-91b3-4509-b60f-9ba449c71b1e admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:06.638927 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1066/2128] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:07:06 2021] POST /identity/v3/users => generated 307 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:07:06.643265 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca3115-a943-4b2c-9250-c35373f3849e admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:06.656515 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca3115-a943-4b2c-9250-c35373f3849e admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:06.661060 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441977e-ee87-4e12-851a-b22910c198aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:06.661717 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441977e-ee87-4e12-851a-b22910c198aa admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:06.662250 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441977e-ee87-4e12-851a-b22910c198aa admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:06.662534 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441977e-ee87-4e12-851a-b22910c198aa admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:06.663259 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441977e-ee87-4e12-851a-b22910c198aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:06.690563 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441977e-ee87-4e12-851a-b22910c198aa admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:06.703833 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1063/2129] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:07:06 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:07:06.708323 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c68ca-91b3-4509-b60f-9ba449c71b1e admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:06.722722 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c68ca-91b3-4509-b60f-9ba449c71b1e admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:06.743193 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d95f07-2a3a-455a-b1c7-3cc48c1df21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:06.744729 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d95f07-2a3a-455a-b1c7-3cc48c1df21f admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:06.745024 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d95f07-2a3a-455a-b1c7-3cc48c1df21f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:06.745306 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d95f07-2a3a-455a-b1c7-3cc48c1df21f admin admin] PATH_INFO: `/v3/projects/549af3795b974e598295d4d69988c080/users/17bcf6d2613f4036aa503528ab6c7481/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:06.768315 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d95f07-2a3a-455a-b1c7-3cc48c1df21f admin admin] RBAC: Authorizing `identity:create_grant(project_id=549af3795b974e598295d4d69988c080, user_id=17bcf6d2613f4036aa503528ab6c7481, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:06.796640 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d95f07-2a3a-455a-b1c7-3cc48c1df21f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:06.813221 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1067/2130] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:07:06 2021] PUT /identity/v3/projects/549af3795b974e598295d4d69988c080/users/17bcf6d2613f4036aa503528ab6c7481/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:06.817528 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441977e-ee87-4e12-851a-b22910c198aa admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:06.828091 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441977e-ee87-4e12-851a-b22910c198aa admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:06.897047 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6b347-657f-45fe-addc-575091f40591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:06.897688 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6b347-657f-45fe-addc-575091f40591 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:06.897975 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6b347-657f-45fe-addc-575091f40591 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:06.898254 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc6b347-657f-45fe-addc-575091f40591 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:06.898981 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6b347-657f-45fe-addc-575091f40591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:06.924805 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc6b347-657f-45fe-addc-575091f40591 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:06.936875 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1064/2131] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:07:06 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:07:06.941161 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d95f07-2a3a-455a-b1c7-3cc48c1df21f admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:06.951140 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d95f07-2a3a-455a-b1c7-3cc48c1df21f admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:06.955361 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16800585-6b0c-4f1a-be4e-082b7945f4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:06.956215 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16800585-6b0c-4f1a-be4e-082b7945f4f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:06.956519 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16800585-6b0c-4f1a-be4e-082b7945f4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:06.956779 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16800585-6b0c-4f1a-be4e-082b7945f4f8 admin admin] PATH_INFO: `/v3/projects/549af3795b974e598295d4d69988c080/users/17bcf6d2613f4036aa503528ab6c7481/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:06.958516 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16800585-6b0c-4f1a-be4e-082b7945f4f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=549af3795b974e598295d4d69988c080, user_id=17bcf6d2613f4036aa503528ab6c7481, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:06.985716 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16800585-6b0c-4f1a-be4e-082b7945f4f8 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:07.004259 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1068/2132] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:07:06 2021] PUT /identity/v3/projects/549af3795b974e598295d4d69988c080/users/17bcf6d2613f4036aa503528ab6c7481/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:07.008102 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6b347-657f-45fe-addc-575091f40591 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:07.017782 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc6b347-657f-45fe-addc-575091f40591 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:07.113423 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde3628-194d-4db8-993c-9142d60d0743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:07.114591 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde3628-194d-4db8-993c-9142d60d0743 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:07.114840 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde3628-194d-4db8-993c-9142d60d0743 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:07.115267 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde3628-194d-4db8-993c-9142d60d0743 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:07.116411 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde3628-194d-4db8-993c-9142d60d0743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:07.144223 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde3628-194d-4db8-993c-9142d60d0743 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:07.156007 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1065/2133] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:07:07 2021] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:07:07.160445 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16800585-6b0c-4f1a-be4e-082b7945f4f8 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:07.176646 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16800585-6b0c-4f1a-be4e-082b7945f4f8 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:07.200012 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b060f24-a283-49ef-8fd8-30e28ca66a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:07.201246 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b060f24-a283-49ef-8fd8-30e28ca66a09 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:07.201748 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b060f24-a283-49ef-8fd8-30e28ca66a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:07.202265 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b060f24-a283-49ef-8fd8-30e28ca66a09 admin admin] PATH_INFO: `/v3/projects/549af3795b974e598295d4d69988c080/users/17bcf6d2613f4036aa503528ab6c7481/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:07.207091 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b060f24-a283-49ef-8fd8-30e28ca66a09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=549af3795b974e598295d4d69988c080, user_id=17bcf6d2613f4036aa503528ab6c7481, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:07.268682 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b060f24-a283-49ef-8fd8-30e28ca66a09 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:07.309392 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1069/2134] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:07:07 2021] PUT /identity/v3/projects/549af3795b974e598295d4d69988c080/users/17bcf6d2613f4036aa503528ab6c7481/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:07.324619 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf1efc-04f4-409e-b60d-7a2d688a7ac6 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:07.324619 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf1efc-04f4-409e-b60d-7a2d688a7ac6 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:07.333417 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf1efc-04f4-409e-b60d-7a2d688a7ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:07.414078 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b060f24-a283-49ef-8fd8-30e28ca66a09 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:07.417371 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-9b060f24-a283-49ef-8fd8-30e28ca66a09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:07.444502 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-82bf1efc-04f4-409e-b60d-7a2d688a7ac6 None None] MFA Rules not processed for user `17bcf6d2613f4036aa503528ab6c7481`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:07.445744 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-82bf1efc-04f4-409e-b60d-7a2d688a7ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:07.511052 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b060f24-a283-49ef-8fd8-30e28ca66a09 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:07.515457 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95d353-fcfe-4f49-b00f-4a2fcc0d82d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:07.516270 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95d353-fcfe-4f49-b00f-4a2fcc0d82d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:07.516696 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95d353-fcfe-4f49-b00f-4a2fcc0d82d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:07.517037 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95d353-fcfe-4f49-b00f-4a2fcc0d82d0 admin admin] PATH_INFO: `/v3/users/f5549a62218f4a3bb089fe6f9bb9d6de` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:07.518178 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95d353-fcfe-4f49-b00f-4a2fcc0d82d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5549a62218f4a3bb089fe6f9bb9d6de)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:07.535930 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1066/2135] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:07 2021] POST /identity/v3/auth/tokens => generated 3775 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:07.545938 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95d353-fcfe-4f49-b00f-4a2fcc0d82d0 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:07.546137 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf1efc-04f4-409e-b60d-7a2d688a7ac6 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:07.547352 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-82bf1efc-04f4-409e-b60d-7a2d688a7ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:07.604400 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-3f95d353-fcfe-4f49-b00f-4a2fcc0d82d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5549a62218f4a3bb089fe6f9bb9d6de'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:07.604712 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-3f95d353-fcfe-4f49-b00f-4a2fcc0d82d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5549a62218f4a3bb089fe6f9bb9d6de'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:07.616420 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf1efc-04f4-409e-b60d-7a2d688a7ac6 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:07.616631 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-3f95d353-fcfe-4f49-b00f-4a2fcc0d82d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5549a62218f4a3bb089fe6f9bb9d6de'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:07.620263 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871393b-5f5e-4602-8bbb-ec661037cba9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:07.620934 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871393b-5f5e-4602-8bbb-ec661037cba9 service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:07.621153 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871393b-5f5e-4602-8bbb-ec661037cba9 service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:07.621423 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b871393b-5f5e-4602-8bbb-ec661037cba9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:07.623161 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-b871393b-5f5e-4602-8bbb-ec661037cba9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:07.624829 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-3f95d353-fcfe-4f49-b00f-4a2fcc0d82d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5549a62218f4a3bb089fe6f9bb9d6de'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:07.632702 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-3f95d353-fcfe-4f49-b00f-4a2fcc0d82d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5549a62218f4a3bb089fe6f9bb9d6de'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:07.635039 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b871393b-5f5e-4602-8bbb-ec661037cba9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:07.638962 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1070/2136] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:07:07 2021] DELETE /identity/v3/users/f5549a62218f4a3bb089fe6f9bb9d6de => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:07:07.643370 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15007fd5-b5b4-47a4-ba23-747a74306b04 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:07.643693 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15007fd5-b5b4-47a4-ba23-747a74306b04 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:07.643975 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15007fd5-b5b4-47a4-ba23-747a74306b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:07.663610 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b871393b-5f5e-4602-8bbb-ec661037cba9 service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:07.668611 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-15007fd5-b5b4-47a4-ba23-747a74306b04 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:07.669831 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-15007fd5-b5b4-47a4-ba23-747a74306b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:07.673484 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1067/2137] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:07:07 2021] GET /identity/v3/auth/tokens => generated 3775 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:07:07.740526 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1071/2138] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:07 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:07:07.750530 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871393b-5f5e-4602-8bbb-ec661037cba9 service cinder] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:07.752032 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-b871393b-5f5e-4602-8bbb-ec661037cba9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:07.795463 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15007fd5-b5b4-47a4-ba23-747a74306b04 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:07.800955 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-15007fd5-b5b4-47a4-ba23-747a74306b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:07.835718 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b871393b-5f5e-4602-8bbb-ec661037cba9 service cinder] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:07.877250 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15007fd5-b5b4-47a4-ba23-747a74306b04 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:07.880886 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1db45-fce7-404d-a802-241829370afd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:07.881542 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1db45-fce7-404d-a802-241829370afd service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:07.881829 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1db45-fce7-404d-a802-241829370afd service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:07.882280 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1db45-fce7-404d-a802-241829370afd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:07.886036 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-d0d1db45-fce7-404d-a802-241829370afd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:07.899585 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459e01c-d151-4971-9498-c8cf85a57f7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:07.901657 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459e01c-d151-4971-9498-c8cf85a57f7e service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:07.901958 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459e01c-d151-4971-9498-c8cf85a57f7e service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:07.903147 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459e01c-d151-4971-9498-c8cf85a57f7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:07.916817 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459e01c-d151-4971-9498-c8cf85a57f7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:07.946151 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459e01c-d151-4971-9498-c8cf85a57f7e service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:07.957695 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1068/2139] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:07:07 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:07:07.968473 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1db45-fce7-404d-a802-241829370afd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:07.995813 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d1db45-fce7-404d-a802-241829370afd service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:08.015613 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1072/2140] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:07:07 2021] GET /identity/v3/auth/tokens => generated 3708 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:07:08.497362 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459e01c-d151-4971-9498-c8cf85a57f7e service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:08.500003 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-9459e01c-d151-4971-9498-c8cf85a57f7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:08.537738 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459e01c-d151-4971-9498-c8cf85a57f7e service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:08.554322 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0560ac-d70d-46a7-8852-e9e3b5f060e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:08.555367 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0560ac-d70d-46a7-8852-e9e3b5f060e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:08.555799 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0560ac-d70d-46a7-8852-e9e3b5f060e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:08.555997 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0560ac-d70d-46a7-8852-e9e3b5f060e6 admin admin] PATH_INFO: `/v3/projects/149d1f8afde44baea4fb13ed38e37a6a` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:08.567358 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0560ac-d70d-46a7-8852-e9e3b5f060e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=149d1f8afde44baea4fb13ed38e37a6a)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:08.608686 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0560ac-d70d-46a7-8852-e9e3b5f060e6 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:08.692136 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-8b0560ac-d70d-46a7-8852-e9e3b5f060e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '149d1f8afde44baea4fb13ed38e37a6a', 'request_id': 'req-8b0560ac-d70d-46a7-8852-e9e3b5f060e6'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:08.699349 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-8b0560ac-d70d-46a7-8852-e9e3b5f060e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '149d1f8afde44baea4fb13ed38e37a6a', 'request_id': 'req-8b0560ac-d70d-46a7-8852-e9e3b5f060e6'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:08.713365 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-8b0560ac-d70d-46a7-8852-e9e3b5f060e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '149d1f8afde44baea4fb13ed38e37a6a', 'request_id': 'req-8b0560ac-d70d-46a7-8852-e9e3b5f060e6'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:08.735624 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-8b0560ac-d70d-46a7-8852-e9e3b5f060e6 admin admin] The token cache is being invalidate because project 149d1f8afde44baea4fb13ed38e37a6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:07:08.735913 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-8b0560ac-d70d-46a7-8852-e9e3b5f060e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:08.736958 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-8b0560ac-d70d-46a7-8852-e9e3b5f060e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:08.738596 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1069/2141] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:07:08 2021] DELETE /identity/v3/projects/149d1f8afde44baea4fb13ed38e37a6a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:08.742395 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1db45-fce7-404d-a802-241829370afd service cinder] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:08.753823 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1db45-fce7-404d-a802-241829370afd service cinder] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:08.828585 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff7807-5532-4fd5-ae33-be96bded5e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:08.829416 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff7807-5532-4fd5-ae33-be96bded5e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:08.829760 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff7807-5532-4fd5-ae33-be96bded5e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:08.830431 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff7807-5532-4fd5-ae33-be96bded5e46 admin admin] PATH_INFO: `/v3/users/e3362a89e6e24829b415073e2e79472a` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:08.831099 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff7807-5532-4fd5-ae33-be96bded5e46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3362a89e6e24829b415073e2e79472a)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:08.858221 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff7807-5532-4fd5-ae33-be96bded5e46 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:08.914221 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-66ff7807-5532-4fd5-ae33-be96bded5e46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3362a89e6e24829b415073e2e79472a'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:08.914869 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-66ff7807-5532-4fd5-ae33-be96bded5e46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3362a89e6e24829b415073e2e79472a'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:08.927293 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-66ff7807-5532-4fd5-ae33-be96bded5e46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3362a89e6e24829b415073e2e79472a'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:08.937114 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-66ff7807-5532-4fd5-ae33-be96bded5e46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3362a89e6e24829b415073e2e79472a'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:08.946326 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-66ff7807-5532-4fd5-ae33-be96bded5e46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3362a89e6e24829b415073e2e79472a'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:08.954296 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1073/2142] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:07:08 2021] DELETE /identity/v3/users/e3362a89e6e24829b415073e2e79472a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:09.424706 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0560ac-d70d-46a7-8852-e9e3b5f060e6 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:09.426087 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-8b0560ac-d70d-46a7-8852-e9e3b5f060e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:09.440894 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0560ac-d70d-46a7-8852-e9e3b5f060e6 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:09.507277 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4d873-c4ad-406b-a6d0-96fed2a51150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:09.508143 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4d873-c4ad-406b-a6d0-96fed2a51150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:09.508432 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4d873-c4ad-406b-a6d0-96fed2a51150 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:09.508709 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4d873-c4ad-406b-a6d0-96fed2a51150 admin admin] PATH_INFO: `/v3/projects/e3e73b931f2d489d86746d049d21004e` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:09.509912 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4d873-c4ad-406b-a6d0-96fed2a51150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3e73b931f2d489d86746d049d21004e)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:09.536689 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4d873-c4ad-406b-a6d0-96fed2a51150 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:09.600004 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-7ef4d873-c4ad-406b-a6d0-96fed2a51150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3e73b931f2d489d86746d049d21004e', 'request_id': 'req-7ef4d873-c4ad-406b-a6d0-96fed2a51150'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:09.606069 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-7ef4d873-c4ad-406b-a6d0-96fed2a51150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3e73b931f2d489d86746d049d21004e', 'request_id': 'req-7ef4d873-c4ad-406b-a6d0-96fed2a51150'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:09.623507 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-7ef4d873-c4ad-406b-a6d0-96fed2a51150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3e73b931f2d489d86746d049d21004e', 'request_id': 'req-7ef4d873-c4ad-406b-a6d0-96fed2a51150'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:09.638342 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-7ef4d873-c4ad-406b-a6d0-96fed2a51150 admin admin] The token cache is being invalidate because project e3e73b931f2d489d86746d049d21004e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:07:09.638634 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-7ef4d873-c4ad-406b-a6d0-96fed2a51150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:09.639280 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-7ef4d873-c4ad-406b-a6d0-96fed2a51150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:09.640794 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1070/2143] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:07:09 2021] DELETE /identity/v3/projects/e3e73b931f2d489d86746d049d21004e => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:09.644914 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff7807-5532-4fd5-ae33-be96bded5e46 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:09.646410 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-66ff7807-5532-4fd5-ae33-be96bded5e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:09.659891 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff7807-5532-4fd5-ae33-be96bded5e46 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:09.730010 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca7e97-bdf1-48fd-b6d3-e809f49bbc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:09.730867 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca7e97-bdf1-48fd-b6d3-e809f49bbc2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:09.731152 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca7e97-bdf1-48fd-b6d3-e809f49bbc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:09.731429 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca7e97-bdf1-48fd-b6d3-e809f49bbc2a admin admin] PATH_INFO: `/v3/users/d749a637c4f54c8e8753e99578473192` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:09.732702 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca7e97-bdf1-48fd-b6d3-e809f49bbc2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d749a637c4f54c8e8753e99578473192)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:09.759120 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca7e97-bdf1-48fd-b6d3-e809f49bbc2a admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:09.819168 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-12ca7e97-bdf1-48fd-b6d3-e809f49bbc2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd749a637c4f54c8e8753e99578473192'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:09.820442 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-12ca7e97-bdf1-48fd-b6d3-e809f49bbc2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd749a637c4f54c8e8753e99578473192'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:09.834826 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-12ca7e97-bdf1-48fd-b6d3-e809f49bbc2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd749a637c4f54c8e8753e99578473192'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:09.843505 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-12ca7e97-bdf1-48fd-b6d3-e809f49bbc2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd749a637c4f54c8e8753e99578473192'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:09.852299 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-12ca7e97-bdf1-48fd-b6d3-e809f49bbc2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd749a637c4f54c8e8753e99578473192'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:09.859722 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1074/2144] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:07:09 2021] DELETE /identity/v3/users/d749a637c4f54c8e8753e99578473192 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:10.385897 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4d873-c4ad-406b-a6d0-96fed2a51150 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:10.387583 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-7ef4d873-c4ad-406b-a6d0-96fed2a51150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:10.400544 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4d873-c4ad-406b-a6d0-96fed2a51150 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:10.472017 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975c8da-8b75-4145-b0eb-b7365b292afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:10.472905 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975c8da-8b75-4145-b0eb-b7365b292afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:10.473152 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975c8da-8b75-4145-b0eb-b7365b292afe admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:10.473434 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975c8da-8b75-4145-b0eb-b7365b292afe admin admin] PATH_INFO: `/v3/projects/34238b838472447a9c05bcec058f6cbc` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:10.474643 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975c8da-8b75-4145-b0eb-b7365b292afe admin admin] RBAC: Authorizing `identity:delete_project(project_id=34238b838472447a9c05bcec058f6cbc)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:10.500938 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975c8da-8b75-4145-b0eb-b7365b292afe admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:10.562939 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-9975c8da-8b75-4145-b0eb-b7365b292afe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34238b838472447a9c05bcec058f6cbc', 'request_id': 'req-9975c8da-8b75-4145-b0eb-b7365b292afe'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:10.569122 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-9975c8da-8b75-4145-b0eb-b7365b292afe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34238b838472447a9c05bcec058f6cbc', 'request_id': 'req-9975c8da-8b75-4145-b0eb-b7365b292afe'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:10.581874 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-9975c8da-8b75-4145-b0eb-b7365b292afe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34238b838472447a9c05bcec058f6cbc', 'request_id': 'req-9975c8da-8b75-4145-b0eb-b7365b292afe'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:10.600246 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-9975c8da-8b75-4145-b0eb-b7365b292afe admin admin] The token cache is being invalidate because project 34238b838472447a9c05bcec058f6cbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:07:10.600919 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-9975c8da-8b75-4145-b0eb-b7365b292afe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:10.601896 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-9975c8da-8b75-4145-b0eb-b7365b292afe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:10.604359 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1071/2145] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:07:10 2021] DELETE /identity/v3/projects/34238b838472447a9c05bcec058f6cbc => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:16.169988 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca7e97-bdf1-48fd-b6d3-e809f49bbc2a admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:16.172485 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-12ca7e97-bdf1-48fd-b6d3-e809f49bbc2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:16.191339 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca7e97-bdf1-48fd-b6d3-e809f49bbc2a admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:16.299840 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff88e8-6448-407d-91bf-248852e9c9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:16.303571 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff88e8-6448-407d-91bf-248852e9c9d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:16.304094 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff88e8-6448-407d-91bf-248852e9c9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:16.304592 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff88e8-6448-407d-91bf-248852e9c9d4 admin admin] PATH_INFO: `/v3/users/18e70d7ac5204084a1001675d3f3974f` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:16.307325 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff88e8-6448-407d-91bf-248852e9c9d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18e70d7ac5204084a1001675d3f3974f)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:16.338956 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff88e8-6448-407d-91bf-248852e9c9d4 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:16.394020 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-fbff88e8-6448-407d-91bf-248852e9c9d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18e70d7ac5204084a1001675d3f3974f'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:16.394682 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-fbff88e8-6448-407d-91bf-248852e9c9d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18e70d7ac5204084a1001675d3f3974f'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:16.407913 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-fbff88e8-6448-407d-91bf-248852e9c9d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18e70d7ac5204084a1001675d3f3974f'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:16.415533 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-fbff88e8-6448-407d-91bf-248852e9c9d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18e70d7ac5204084a1001675d3f3974f'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:16.423225 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-fbff88e8-6448-407d-91bf-248852e9c9d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18e70d7ac5204084a1001675d3f3974f'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:16.428927 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1075/2146] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:07:16 2021] DELETE /identity/v3/users/18e70d7ac5204084a1001675d3f3974f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:16.433940 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb71e20-5099-4fec-a7e5-d6d7e6209bf2 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:16.434459 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb71e20-5099-4fec-a7e5-d6d7e6209bf2 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:16.434553 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb71e20-5099-4fec-a7e5-d6d7e6209bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:16.456982 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-fbb71e20-5099-4fec-a7e5-d6d7e6209bf2 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:16.459158 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-fbb71e20-5099-4fec-a7e5-d6d7e6209bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:16.536629 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1072/2147] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:16 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:16.546883 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff88e8-6448-407d-91bf-248852e9c9d4 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:16.548256 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-fbff88e8-6448-407d-91bf-248852e9c9d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:16.613699 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff88e8-6448-407d-91bf-248852e9c9d4 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:16.617043 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d8604-f027-4881-b0cc-702ec8390465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:16.618009 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d8604-f027-4881-b0cc-702ec8390465 service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:16.618009 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d8604-f027-4881-b0cc-702ec8390465 service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:16.618838 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d8604-f027-4881-b0cc-702ec8390465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:16.628555 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d8604-f027-4881-b0cc-702ec8390465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:16.653561 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d8604-f027-4881-b0cc-702ec8390465 service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:16.664010 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1076/2148] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:07:16 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:07:17.081881 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb71e20-5099-4fec-a7e5-d6d7e6209bf2 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:17.083283 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-fbb71e20-5099-4fec-a7e5-d6d7e6209bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:17.095099 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb71e20-5099-4fec-a7e5-d6d7e6209bf2 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:17.100924 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a53cb6-d94a-4bdf-8a16-dd9fce1670e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:17.101852 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a53cb6-d94a-4bdf-8a16-dd9fce1670e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:17.102166 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a53cb6-d94a-4bdf-8a16-dd9fce1670e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:17.102446 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a53cb6-d94a-4bdf-8a16-dd9fce1670e1 admin admin] PATH_INFO: `/v3/projects/b96be6bd42e54b69badfaa3b05b6fd94` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:17.104712 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a53cb6-d94a-4bdf-8a16-dd9fce1670e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b96be6bd42e54b69badfaa3b05b6fd94)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:17.131754 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a53cb6-d94a-4bdf-8a16-dd9fce1670e1 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:17.197893 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-39a53cb6-d94a-4bdf-8a16-dd9fce1670e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b96be6bd42e54b69badfaa3b05b6fd94', 'request_id': 'req-39a53cb6-d94a-4bdf-8a16-dd9fce1670e1'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:17.204518 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-39a53cb6-d94a-4bdf-8a16-dd9fce1670e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b96be6bd42e54b69badfaa3b05b6fd94', 'request_id': 'req-39a53cb6-d94a-4bdf-8a16-dd9fce1670e1'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:17.216179 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d8604-f027-4881-b0cc-702ec8390465 service neutron] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:17.217572 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-8b3d8604-f027-4881-b0cc-702ec8390465 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:17.218281 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-39a53cb6-d94a-4bdf-8a16-dd9fce1670e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b96be6bd42e54b69badfaa3b05b6fd94', 'request_id': 'req-39a53cb6-d94a-4bdf-8a16-dd9fce1670e1'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:17.233582 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d8604-f027-4881-b0cc-702ec8390465 service neutron] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:17.238673 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-39a53cb6-d94a-4bdf-8a16-dd9fce1670e1 admin admin] The token cache is being invalidate because project b96be6bd42e54b69badfaa3b05b6fd94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:07:17.239161 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-39a53cb6-d94a-4bdf-8a16-dd9fce1670e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:17.240307 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-39a53cb6-d94a-4bdf-8a16-dd9fce1670e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:17.242629 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1073/2149] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:07:17 2021] DELETE /identity/v3/projects/b96be6bd42e54b69badfaa3b05b6fd94 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:17.254898 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a53cb6-d94a-4bdf-8a16-dd9fce1670e1 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:17.256638 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-39a53cb6-d94a-4bdf-8a16-dd9fce1670e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:17.324599 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d63f9-9b5f-481d-a67d-f4f8683480fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:17.325441 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d63f9-9b5f-481d-a67d-f4f8683480fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:17.325729 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d63f9-9b5f-481d-a67d-f4f8683480fc admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:17.327578 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d63f9-9b5f-481d-a67d-f4f8683480fc admin admin] PATH_INFO: `/v3/users/5b2d9c357adf4d70b4d980d716f7a56e` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:17.335231 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d63f9-9b5f-481d-a67d-f4f8683480fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b2d9c357adf4d70b4d980d716f7a56e)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:17.396849 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448d63f9-9b5f-481d-a67d-f4f8683480fc admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:17.485756 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a53cb6-d94a-4bdf-8a16-dd9fce1670e1 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:17.502557 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-448d63f9-9b5f-481d-a67d-f4f8683480fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b2d9c357adf4d70b4d980d716f7a56e'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:17.503210 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-448d63f9-9b5f-481d-a67d-f4f8683480fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b2d9c357adf4d70b4d980d716f7a56e'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:17.514459 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096d700-e0fa-4b18-b05f-52d7a56774c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:17.516346 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096d700-e0fa-4b18-b05f-52d7a56774c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:17.518160 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096d700-e0fa-4b18-b05f-52d7a56774c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:17.520353 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096d700-e0fa-4b18-b05f-52d7a56774c4 admin admin] PATH_INFO: `/v3/users/17bcf6d2613f4036aa503528ab6c7481` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:17.524243 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8096d700-e0fa-4b18-b05f-52d7a56774c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17bcf6d2613f4036aa503528ab6c7481)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:17.526833 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-448d63f9-9b5f-481d-a67d-f4f8683480fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b2d9c357adf4d70b4d980d716f7a56e'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:17.547523 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-448d63f9-9b5f-481d-a67d-f4f8683480fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b2d9c357adf4d70b4d980d716f7a56e'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:17.558362 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-448d63f9-9b5f-481d-a67d-f4f8683480fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b2d9c357adf4d70b4d980d716f7a56e'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:17.568306 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8096d700-e0fa-4b18-b05f-52d7a56774c4 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:17.572443 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1077/2150] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:07:17 2021] DELETE /identity/v3/users/5b2d9c357adf4d70b4d980d716f7a56e => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:17.577260 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f35d32-8c67-4eda-a455-049c880a361c None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:17.577556 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f35d32-8c67-4eda-a455-049c880a361c None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:17.577839 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f35d32-8c67-4eda-a455-049c880a361c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:17.626395 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-50f35d32-8c67-4eda-a455-049c880a361c None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:17.628870 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-50f35d32-8c67-4eda-a455-049c880a361c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:17.662913 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-8096d700-e0fa-4b18-b05f-52d7a56774c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17bcf6d2613f4036aa503528ab6c7481'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:17.694054 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-8096d700-e0fa-4b18-b05f-52d7a56774c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17bcf6d2613f4036aa503528ab6c7481'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:17.695508 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-8096d700-e0fa-4b18-b05f-52d7a56774c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17bcf6d2613f4036aa503528ab6c7481'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:17.719715 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-8096d700-e0fa-4b18-b05f-52d7a56774c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17bcf6d2613f4036aa503528ab6c7481'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:17.725250 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-8096d700-e0fa-4b18-b05f-52d7a56774c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17bcf6d2613f4036aa503528ab6c7481'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:17.738387 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1074/2151] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:07:17 2021] DELETE /identity/v3/users/17bcf6d2613f4036aa503528ab6c7481 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:17.765087 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1078/2152] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:17 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:17.774937 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096d700-e0fa-4b18-b05f-52d7a56774c4 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:17.776831 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-8096d700-e0fa-4b18-b05f-52d7a56774c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:17.916742 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096d700-e0fa-4b18-b05f-52d7a56774c4 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:17.921588 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34afab5-9cf2-4e95-b5e2-fe9df0fb58d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:17.922939 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34afab5-9cf2-4e95-b5e2-fe9df0fb58d3 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:17.923400 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34afab5-9cf2-4e95-b5e2-fe9df0fb58d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:17.923879 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34afab5-9cf2-4e95-b5e2-fe9df0fb58d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:18.031575 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34afab5-9cf2-4e95-b5e2-fe9df0fb58d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:18.061137 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34afab5-9cf2-4e95-b5e2-fe9df0fb58d3 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:18.078166 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1075/2153] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:07:17 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:07:18.181803 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f35d32-8c67-4eda-a455-049c880a361c None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:18.183779 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-50f35d32-8c67-4eda-a455-049c880a361c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:18.200816 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f35d32-8c67-4eda-a455-049c880a361c None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:18.205790 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f6980-d9c1-42a0-ac4c-c4bc86bba4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:18.206583 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f6980-d9c1-42a0-ac4c-c4bc86bba4e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:18.206866 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f6980-d9c1-42a0-ac4c-c4bc86bba4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:18.207342 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f6980-d9c1-42a0-ac4c-c4bc86bba4e6 admin admin] PATH_INFO: `/v3/projects/549af3795b974e598295d4d69988c080` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:18.208528 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f6980-d9c1-42a0-ac4c-c4bc86bba4e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=549af3795b974e598295d4d69988c080)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:18.236963 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f6980-d9c1-42a0-ac4c-c4bc86bba4e6 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:18.296812 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-2d8f6980-d9c1-42a0-ac4c-c4bc86bba4e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '549af3795b974e598295d4d69988c080', 'request_id': 'req-2d8f6980-d9c1-42a0-ac4c-c4bc86bba4e6'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:18.304458 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-2d8f6980-d9c1-42a0-ac4c-c4bc86bba4e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '549af3795b974e598295d4d69988c080', 'request_id': 'req-2d8f6980-d9c1-42a0-ac4c-c4bc86bba4e6'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:18.317039 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-2d8f6980-d9c1-42a0-ac4c-c4bc86bba4e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '549af3795b974e598295d4d69988c080', 'request_id': 'req-2d8f6980-d9c1-42a0-ac4c-c4bc86bba4e6'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:18.331311 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-2d8f6980-d9c1-42a0-ac4c-c4bc86bba4e6 admin admin] The token cache is being invalidate because project 549af3795b974e598295d4d69988c080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:07:18.331698 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-2d8f6980-d9c1-42a0-ac4c-c4bc86bba4e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:18.332366 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-2d8f6980-d9c1-42a0-ac4c-c4bc86bba4e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:18.334007 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1079/2154] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:07:18 2021] DELETE /identity/v3/projects/549af3795b974e598295d4d69988c080 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:18.340694 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73d6b4-52d4-4b24-9f2f-7fdfbf1851a7 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:18.341102 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73d6b4-52d4-4b24-9f2f-7fdfbf1851a7 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:18.341421 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d73d6b4-52d4-4b24-9f2f-7fdfbf1851a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:18.367589 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-0d73d6b4-52d4-4b24-9f2f-7fdfbf1851a7 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:18.368771 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-0d73d6b4-52d4-4b24-9f2f-7fdfbf1851a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:18.442213 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1076/2155] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:07:18.451323 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99f002-8ccf-4d51-915d-e643fdc19b53 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:18.451657 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99f002-8ccf-4d51-915d-e643fdc19b53 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:18.451947 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99f002-8ccf-4d51-915d-e643fdc19b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:18.482121 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73d6b4-52d4-4b24-9f2f-7fdfbf1851a7 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:18.482971 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-de99f002-8ccf-4d51-915d-e643fdc19b53 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:18.483749 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-0d73d6b4-52d4-4b24-9f2f-7fdfbf1851a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:18.484162 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-de99f002-8ccf-4d51-915d-e643fdc19b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:18.494255 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1080/2156] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:18.498317 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99f002-8ccf-4d51-915d-e643fdc19b53 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:18.499789 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d73d6b4-52d4-4b24-9f2f-7fdfbf1851a7 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:18.504530 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76938ca5-05f4-4a8c-b46d-8b909ecfe94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:18.505320 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76938ca5-05f4-4a8c-b46d-8b909ecfe94e admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:18.505609 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76938ca5-05f4-4a8c-b46d-8b909ecfe94e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:18.505888 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76938ca5-05f4-4a8c-b46d-8b909ecfe94e admin admin] PATH_INFO: `/v3/projects/73dc3b6d023a405287d6118b3a605dfd` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:18.506960 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76938ca5-05f4-4a8c-b46d-8b909ecfe94e admin admin] RBAC: Authorizing `identity:delete_project(project_id=73dc3b6d023a405287d6118b3a605dfd)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:18.507903 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99f002-8ccf-4d51-915d-e643fdc19b53 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:18.512982 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d75f38-939e-4aec-ae86-be12cda59a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:18.513979 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d75f38-939e-4aec-ae86-be12cda59a28 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:18.514521 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d75f38-939e-4aec-ae86-be12cda59a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:18.514956 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d75f38-939e-4aec-ae86-be12cda59a28 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:18.515713 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d75f38-939e-4aec-ae86-be12cda59a28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:07:18.516178 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d75f38-939e-4aec-ae86-be12cda59a28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:18.533775 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76938ca5-05f4-4a8c-b46d-8b909ecfe94e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:18.549267 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d75f38-939e-4aec-ae86-be12cda59a28 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:18.564198 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1081/2157] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:07:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 15:07:18.568541 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d75f38-939e-4aec-ae86-be12cda59a28 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:18.578584 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d75f38-939e-4aec-ae86-be12cda59a28 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:18.589001 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-76938ca5-05f4-4a8c-b46d-8b909ecfe94e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73dc3b6d023a405287d6118b3a605dfd', 'request_id': 'req-76938ca5-05f4-4a8c-b46d-8b909ecfe94e'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:18.593934 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-76938ca5-05f4-4a8c-b46d-8b909ecfe94e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73dc3b6d023a405287d6118b3a605dfd', 'request_id': 'req-76938ca5-05f4-4a8c-b46d-8b909ecfe94e'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:18.604766 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-76938ca5-05f4-4a8c-b46d-8b909ecfe94e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73dc3b6d023a405287d6118b3a605dfd', 'request_id': 'req-76938ca5-05f4-4a8c-b46d-8b909ecfe94e'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:18.618020 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-76938ca5-05f4-4a8c-b46d-8b909ecfe94e admin admin] The token cache is being invalidate because project 73dc3b6d023a405287d6118b3a605dfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:07:18.619162 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-76938ca5-05f4-4a8c-b46d-8b909ecfe94e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:18.619954 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-76938ca5-05f4-4a8c-b46d-8b909ecfe94e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:18.621658 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1077/2158] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:07:18 2021] DELETE /identity/v3/projects/73dc3b6d023a405287d6118b3a605dfd => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:07:18.627688 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cb3ce-e4a4-4e95-a94d-65e9d6b17a13 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:18.627918 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cb3ce-e4a4-4e95-a94d-65e9d6b17a13 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:18.628201 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cb3ce-e4a4-4e95-a94d-65e9d6b17a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:18.646275 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2d05b-2d3a-4c33-8ec4-c7b6d2f81be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:18.646953 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2d05b-2d3a-4c33-8ec4-c7b6d2f81be4 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:18.647475 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2d05b-2d3a-4c33-8ec4-c7b6d2f81be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:18.647809 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2d05b-2d3a-4c33-8ec4-c7b6d2f81be4 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:18.648506 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2d05b-2d3a-4c33-8ec4-c7b6d2f81be4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:18.650799 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-814cb3ce-e4a4-4e95-a94d-65e9d6b17a13 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:18.652327 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-814cb3ce-e4a4-4e95-a94d-65e9d6b17a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:18.660537 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1078/2159] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:07:18.668420 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245eb541-7f73-49d5-b03c-194637b0e17d None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:18.668756 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245eb541-7f73-49d5-b03c-194637b0e17d None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:18.669040 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245eb541-7f73-49d5-b03c-194637b0e17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:18.676891 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2d05b-2d3a-4c33-8ec4-c7b6d2f81be4 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:18.693735 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-245eb541-7f73-49d5-b03c-194637b0e17d None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:18.694963 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-245eb541-7f73-49d5-b03c-194637b0e17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:18.708828 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1082/2160] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:07:18 2021] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:07:18.709788 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1079/2161] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:07:18.713921 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2d05b-2d3a-4c33-8ec4-c7b6d2f81be4 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:18.714492 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245eb541-7f73-49d5-b03c-194637b0e17d None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:18.715743 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-245eb541-7f73-49d5-b03c-194637b0e17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:18.728405 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245eb541-7f73-49d5-b03c-194637b0e17d None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:18.799738 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2d05b-2d3a-4c33-8ec4-c7b6d2f81be4 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:18.801632 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9626146-e214-426c-9dd6-3859f2bf971f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:18.802244 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9626146-e214-426c-9dd6-3859f2bf971f admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:18.802964 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9626146-e214-426c-9dd6-3859f2bf971f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:18.803256 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9626146-e214-426c-9dd6-3859f2bf971f admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:18.803929 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9626146-e214-426c-9dd6-3859f2bf971f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:18.805217 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb134f-15f5-4600-9ae2-507544366a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:18.806450 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb134f-15f5-4600-9ae2-507544366a84 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:18.806740 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb134f-15f5-4600-9ae2-507544366a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:18.807019 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb134f-15f5-4600-9ae2-507544366a84 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:18.807906 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb134f-15f5-4600-9ae2-507544366a84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:07:18.815503 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb134f-15f5-4600-9ae2-507544366a84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:18.831867 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9626146-e214-426c-9dd6-3859f2bf971f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:18.843283 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb134f-15f5-4600-9ae2-507544366a84 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:18.858664 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1080/2162] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:07:18 2021] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:07:18.858878 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1083/2163] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:07:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 15:07:18.862194 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb134f-15f5-4600-9ae2-507544366a84 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:18.862318 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9626146-e214-426c-9dd6-3859f2bf971f admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:18.873303 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9626146-e214-426c-9dd6-3859f2bf971f admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:18.874102 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb134f-15f5-4600-9ae2-507544366a84 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:18.878864 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9a645-7e15-4875-a531-c199a3c29d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:18.879200 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb6587-80af-4322-a328-985e033de109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:18.879546 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9a645-7e15-4875-a531-c199a3c29d9a admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:18.879840 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9a645-7e15-4875-a531-c199a3c29d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:18.879944 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb6587-80af-4322-a328-985e033de109 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:18.880128 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9a645-7e15-4875-a531-c199a3c29d9a admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:18.880233 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb6587-80af-4322-a328-985e033de109 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:18.880423 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb6587-80af-4322-a328-985e033de109 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:18.880956 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9a645-7e15-4875-a531-c199a3c29d9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:18.881135 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb6587-80af-4322-a328-985e033de109 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:18.907647 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9a645-7e15-4875-a531-c199a3c29d9a admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:18.908543 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb6587-80af-4322-a328-985e033de109 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:18.922117 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1081/2164] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:07:18 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:07:18.923775 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9a645-7e15-4875-a531-c199a3c29d9a admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:18.935080 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9a645-7e15-4875-a531-c199a3c29d9a admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:18.941919 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1084/2165] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:07:18 2021] POST /identity/v3/projects => generated 371 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:07:18.942086 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2b54a-a27a-4df8-8721-08af3faf6b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:18.942086 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2b54a-a27a-4df8-8721-08af3faf6b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:18.942086 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2b54a-a27a-4df8-8721-08af3faf6b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:18.942086 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2b54a-a27a-4df8-8721-08af3faf6b22 admin admin] PATH_INFO: `/v3/projects/2a66628ac7c4418e8e7b509a1624780d/users/01c793d7cc294cbc9faaefca494886f5/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:18.943719 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb6587-80af-4322-a328-985e033de109 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:18.978018 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2b54a-a27a-4df8-8721-08af3faf6b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a66628ac7c4418e8e7b509a1624780d, user_id=01c793d7cc294cbc9faaefca494886f5, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:19.010170 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2b54a-a27a-4df8-8721-08af3faf6b22 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:19.028959 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1082/2166] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:07:18 2021] PUT /identity/v3/projects/2a66628ac7c4418e8e7b509a1624780d/users/01c793d7cc294cbc9faaefca494886f5/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:19.036916 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb6587-80af-4322-a328-985e033de109 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:19.045790 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1a1cf-587c-4959-9b25-0ef974c01070 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:19.046109 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1a1cf-587c-4959-9b25-0ef974c01070 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:19.046363 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1a1cf-587c-4959-9b25-0ef974c01070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:19.089262 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-ecd1a1cf-587c-4959-9b25-0ef974c01070 None None] MFA Rules not processed for user `01c793d7cc294cbc9faaefca494886f5`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:19.090491 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-ecd1a1cf-587c-4959-9b25-0ef974c01070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:19.159144 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f670b69-b318-4307-89ec-39fb54f4a04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:19.159801 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f670b69-b318-4307-89ec-39fb54f4a04e admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:19.160092 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f670b69-b318-4307-89ec-39fb54f4a04e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:19.160682 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f670b69-b318-4307-89ec-39fb54f4a04e admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:19.161346 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f670b69-b318-4307-89ec-39fb54f4a04e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:19.221252 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f670b69-b318-4307-89ec-39fb54f4a04e admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:19.239528 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1083/2167] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:19 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:19.276888 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1085/2168] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:07:18 2021] POST /identity/v3/users => generated 286 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:07:19.278104 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1a1cf-587c-4959-9b25-0ef974c01070 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:19.294009 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1a1cf-587c-4959-9b25-0ef974c01070 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:19.301647 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60922f2b-4ade-4783-8672-73d6537d4224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:19.302417 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60922f2b-4ade-4783-8672-73d6537d4224 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:19.302717 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60922f2b-4ade-4783-8672-73d6537d4224 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:19.303050 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60922f2b-4ade-4783-8672-73d6537d4224 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:19.303795 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60922f2b-4ade-4783-8672-73d6537d4224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:19.325869 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f670b69-b318-4307-89ec-39fb54f4a04e admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:19.328131 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-2f670b69-b318-4307-89ec-39fb54f4a04e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:19.342837 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60922f2b-4ade-4783-8672-73d6537d4224 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:19.355557 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1084/2169] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:07:19 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:07:19.360350 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60922f2b-4ade-4783-8672-73d6537d4224 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:19.394250 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60922f2b-4ade-4783-8672-73d6537d4224 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:19.406217 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b5fbd-0bbd-43fe-afef-8651b2d3d338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:19.407758 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b5fbd-0bbd-43fe-afef-8651b2d3d338 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:19.408078 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b5fbd-0bbd-43fe-afef-8651b2d3d338 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:19.408497 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b5fbd-0bbd-43fe-afef-8651b2d3d338 admin admin] PATH_INFO: `/v3/projects/de7fe9da115c4e0ba96c05a73c57896d/users/b3f40995a6e3462c829f165cae45cb55/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:19.430486 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b5fbd-0bbd-43fe-afef-8651b2d3d338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de7fe9da115c4e0ba96c05a73c57896d, user_id=b3f40995a6e3462c829f165cae45cb55, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:19.435778 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f670b69-b318-4307-89ec-39fb54f4a04e admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:19.439234 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577d99d-8038-409a-8acf-83686841cba4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:19.439938 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577d99d-8038-409a-8acf-83686841cba4 service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:19.440292 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577d99d-8038-409a-8acf-83686841cba4 service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:19.440636 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e577d99d-8038-409a-8acf-83686841cba4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:19.454219 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577d99d-8038-409a-8acf-83686841cba4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:19.458040 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b5fbd-0bbd-43fe-afef-8651b2d3d338 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:19.478972 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1085/2170] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:07:19 2021] PUT /identity/v3/projects/de7fe9da115c4e0ba96c05a73c57896d/users/b3f40995a6e3462c829f165cae45cb55/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:07:19.484382 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e577d99d-8038-409a-8acf-83686841cba4 service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:19.489251 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3c139-a9c1-4020-805d-53141a6256eb None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:19.489539 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3c139-a9c1-4020-805d-53141a6256eb None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:19.489823 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc3c139-a9c1-4020-805d-53141a6256eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:19.494651 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1086/2171] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:07:19 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:07:19.545123 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-fdc3c139-a9c1-4020-805d-53141a6256eb None None] MFA Rules not processed for user `b3f40995a6e3462c829f165cae45cb55`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:19.547073 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-fdc3c139-a9c1-4020-805d-53141a6256eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:19.644826 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1086/2172] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:19 2021] POST /identity/v3/auth/tokens => generated 3678 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:19.807746 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577d99d-8038-409a-8acf-83686841cba4 service cinder] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:19.809219 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-e577d99d-8038-409a-8acf-83686841cba4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:19.820201 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e577d99d-8038-409a-8acf-83686841cba4 service cinder] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:19.903925 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe26fc92-a054-4143-8696-badd8b2c0d36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:19.904540 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26fc92-a054-4143-8696-badd8b2c0d36 service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:19.904832 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26fc92-a054-4143-8696-badd8b2c0d36 service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:19.905686 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe26fc92-a054-4143-8696-badd8b2c0d36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:19.915559 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26fc92-a054-4143-8696-badd8b2c0d36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:19.947794 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe26fc92-a054-4143-8696-badd8b2c0d36 service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:19.960807 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1087/2173] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:07:19 2021] GET /identity/v3/auth/tokens => generated 3678 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:07:19.986251 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3c139-a9c1-4020-805d-53141a6256eb None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:20.076256 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc3c139-a9c1-4020-805d-53141a6256eb None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:20.081159 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7ef3b-9fae-4c5e-a95a-d75c7b8e19d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:20.081974 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7ef3b-9fae-4c5e-a95a-d75c7b8e19d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:20.082255 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7ef3b-9fae-4c5e-a95a-d75c7b8e19d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:20.082527 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7ef3b-9fae-4c5e-a95a-d75c7b8e19d5 admin admin] PATH_INFO: `/v3/users/b3f40995a6e3462c829f165cae45cb55` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:20.083660 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7ef3b-9fae-4c5e-a95a-d75c7b8e19d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3f40995a6e3462c829f165cae45cb55)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:20.112046 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7ef3b-9fae-4c5e-a95a-d75c7b8e19d5 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:20.178945 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-49e7ef3b-9fae-4c5e-a95a-d75c7b8e19d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3f40995a6e3462c829f165cae45cb55'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:20.192472 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-49e7ef3b-9fae-4c5e-a95a-d75c7b8e19d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3f40995a6e3462c829f165cae45cb55'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:20.193235 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-49e7ef3b-9fae-4c5e-a95a-d75c7b8e19d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3f40995a6e3462c829f165cae45cb55'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:20.200860 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-49e7ef3b-9fae-4c5e-a95a-d75c7b8e19d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3f40995a6e3462c829f165cae45cb55'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:20.208642 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-49e7ef3b-9fae-4c5e-a95a-d75c7b8e19d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3f40995a6e3462c829f165cae45cb55'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:20.214623 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1087/2174] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:07:19 2021] DELETE /identity/v3/users/b3f40995a6e3462c829f165cae45cb55 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:20.221268 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72bc12-7373-4768-ac9e-1f2c28919dc8 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:20.221605 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72bc12-7373-4768-ac9e-1f2c28919dc8 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:20.221892 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72bc12-7373-4768-ac9e-1f2c28919dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:20.248308 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-1b72bc12-7373-4768-ac9e-1f2c28919dc8 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:20.249453 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-1b72bc12-7373-4768-ac9e-1f2c28919dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:20.324511 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1088/2175] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:07:20.335159 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7ef3b-9fae-4c5e-a95a-d75c7b8e19d5 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:20.336521 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-49e7ef3b-9fae-4c5e-a95a-d75c7b8e19d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:20.407037 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7ef3b-9fae-4c5e-a95a-d75c7b8e19d5 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:20.410477 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994208e1-3e99-4f55-82a6-7fb6b5122a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:20.411101 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994208e1-3e99-4f55-82a6-7fb6b5122a2f service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:20.412586 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994208e1-3e99-4f55-82a6-7fb6b5122a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:20.412586 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994208e1-3e99-4f55-82a6-7fb6b5122a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:20.422331 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994208e1-3e99-4f55-82a6-7fb6b5122a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:20.447743 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994208e1-3e99-4f55-82a6-7fb6b5122a2f service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:20.458562 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1088/2176] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:07:20 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:07:20.859771 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72bc12-7373-4768-ac9e-1f2c28919dc8 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:20.861106 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-1b72bc12-7373-4768-ac9e-1f2c28919dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:20.872072 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72bc12-7373-4768-ac9e-1f2c28919dc8 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:20.877513 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a057c6-f448-4c15-91ea-7a82658a4bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:20.878297 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a057c6-f448-4c15-91ea-7a82658a4bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:20.878584 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a057c6-f448-4c15-91ea-7a82658a4bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:20.878857 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a057c6-f448-4c15-91ea-7a82658a4bc6 admin admin] PATH_INFO: `/v3/projects/de7fe9da115c4e0ba96c05a73c57896d` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:20.880072 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a057c6-f448-4c15-91ea-7a82658a4bc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de7fe9da115c4e0ba96c05a73c57896d)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:20.908008 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a057c6-f448-4c15-91ea-7a82658a4bc6 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:20.964584 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-99a057c6-f448-4c15-91ea-7a82658a4bc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de7fe9da115c4e0ba96c05a73c57896d', 'request_id': 'req-99a057c6-f448-4c15-91ea-7a82658a4bc6'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:20.972471 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-99a057c6-f448-4c15-91ea-7a82658a4bc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de7fe9da115c4e0ba96c05a73c57896d', 'request_id': 'req-99a057c6-f448-4c15-91ea-7a82658a4bc6'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:20.984379 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-99a057c6-f448-4c15-91ea-7a82658a4bc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de7fe9da115c4e0ba96c05a73c57896d', 'request_id': 'req-99a057c6-f448-4c15-91ea-7a82658a4bc6'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:21.005100 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-99a057c6-f448-4c15-91ea-7a82658a4bc6 admin admin] The token cache is being invalidate because project de7fe9da115c4e0ba96c05a73c57896d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:07:21.005646 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-99a057c6-f448-4c15-91ea-7a82658a4bc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:21.006446 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-99a057c6-f448-4c15-91ea-7a82658a4bc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:21.008412 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1089/2177] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:07:20 2021] DELETE /identity/v3/projects/de7fe9da115c4e0ba96c05a73c57896d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:07:21.014521 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3132976-95b4-4776-af9e-8e3d742a311f None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:21.015032 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3132976-95b4-4776-af9e-8e3d742a311f None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:21.015115 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3132976-95b4-4776-af9e-8e3d742a311f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:21.039542 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-e3132976-95b4-4776-af9e-8e3d742a311f None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:21.040866 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-e3132976-95b4-4776-af9e-8e3d742a311f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:21.132870 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1089/2178] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:21.140994 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54339924-0cd5-406f-9ddb-64adce2564a2 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:21.141436 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54339924-0cd5-406f-9ddb-64adce2564a2 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:21.141719 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54339924-0cd5-406f-9ddb-64adce2564a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:21.166311 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-54339924-0cd5-406f-9ddb-64adce2564a2 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:21.167433 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-54339924-0cd5-406f-9ddb-64adce2564a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:21.182856 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1090/2179] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:21.187987 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3132976-95b4-4776-af9e-8e3d742a311f None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:21.198452 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3132976-95b4-4776-af9e-8e3d742a311f None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:21.202851 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1793101-f8e8-42b0-8323-f61f59257b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:21.203643 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1793101-f8e8-42b0-8323-f61f59257b90 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:21.204071 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1793101-f8e8-42b0-8323-f61f59257b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:21.204514 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1793101-f8e8-42b0-8323-f61f59257b90 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:21.205358 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1793101-f8e8-42b0-8323-f61f59257b90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:07:21.205805 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1793101-f8e8-42b0-8323-f61f59257b90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:21.231999 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1793101-f8e8-42b0-8323-f61f59257b90 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:21.251493 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1090/2180] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:07:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:07:21.252128 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54339924-0cd5-406f-9ddb-64adce2564a2 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:21.261698 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54339924-0cd5-406f-9ddb-64adce2564a2 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:21.266067 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d79d5e-5a10-490b-8c1a-c9c42b1d014f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:21.266658 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d79d5e-5a10-490b-8c1a-c9c42b1d014f admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:21.266942 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d79d5e-5a10-490b-8c1a-c9c42b1d014f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:21.267215 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d79d5e-5a10-490b-8c1a-c9c42b1d014f admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:21.268012 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d79d5e-5a10-490b-8c1a-c9c42b1d014f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:21.296995 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d79d5e-5a10-490b-8c1a-c9c42b1d014f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:21.338986 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1091/2181] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:07:21 2021] POST /identity/v3/projects => generated 391 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:07:21.340989 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1793101-f8e8-42b0-8323-f61f59257b90 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:21.350914 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1793101-f8e8-42b0-8323-f61f59257b90 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:21.425220 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d4ad9-fd27-4c1c-af38-e6b366c78ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:21.426022 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d4ad9-fd27-4c1c-af38-e6b366c78ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:21.426329 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d4ad9-fd27-4c1c-af38-e6b366c78ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:21.426660 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d4ad9-fd27-4c1c-af38-e6b366c78ac2 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:21.427317 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d4ad9-fd27-4c1c-af38-e6b366c78ac2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:21.456967 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d4ad9-fd27-4c1c-af38-e6b366c78ac2 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:21.483534 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1091/2182] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:07:21 2021] POST /identity/v3/users => generated 296 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:07:21.484571 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d79d5e-5a10-490b-8c1a-c9c42b1d014f admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:21.498296 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d79d5e-5a10-490b-8c1a-c9c42b1d014f admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:21.502610 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f323c5d-4219-4476-9ec7-efe6cdf65bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:21.503282 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f323c5d-4219-4476-9ec7-efe6cdf65bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:21.503694 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f323c5d-4219-4476-9ec7-efe6cdf65bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:21.503977 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f323c5d-4219-4476-9ec7-efe6cdf65bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:21.504684 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f323c5d-4219-4476-9ec7-efe6cdf65bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:21.530481 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f323c5d-4219-4476-9ec7-efe6cdf65bd0 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:21.540948 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1092/2183] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:07:21 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:07:21.546895 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d4ad9-fd27-4c1c-af38-e6b366c78ac2 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:21.557526 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d4ad9-fd27-4c1c-af38-e6b366c78ac2 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:21.562555 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a375d-9568-4b49-9fc5-9440f2309397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:21.563386 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a375d-9568-4b49-9fc5-9440f2309397 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:21.563702 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a375d-9568-4b49-9fc5-9440f2309397 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:21.563983 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a375d-9568-4b49-9fc5-9440f2309397 admin admin] PATH_INFO: `/v3/projects/2413768f07b24643aabbc266db7072a5/users/b53dbc10407248f7a6672053ae35c962/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:21.585347 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a375d-9568-4b49-9fc5-9440f2309397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2413768f07b24643aabbc266db7072a5, user_id=b53dbc10407248f7a6672053ae35c962, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:21.612641 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a375d-9568-4b49-9fc5-9440f2309397 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:21.628412 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1092/2184] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:07:21 2021] PUT /identity/v3/projects/2413768f07b24643aabbc266db7072a5/users/b53dbc10407248f7a6672053ae35c962/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:21.639570 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ede18-1ace-42ff-98fa-e96f03e9da94 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:21.640123 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ede18-1ace-42ff-98fa-e96f03e9da94 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:21.640478 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ede18-1ace-42ff-98fa-e96f03e9da94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:21.681568 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-e02ede18-1ace-42ff-98fa-e96f03e9da94 None None] MFA Rules not processed for user `b53dbc10407248f7a6672053ae35c962`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:21.682798 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-e02ede18-1ace-42ff-98fa-e96f03e9da94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:21.788010 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1093/2185] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:21 2021] POST /identity/v3/auth/tokens => generated 3698 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:21.800762 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a375d-9568-4b49-9fc5-9440f2309397 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:21.802369 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-eb0a375d-9568-4b49-9fc5-9440f2309397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:21.867377 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a375d-9568-4b49-9fc5-9440f2309397 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:21.870701 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbf3f6-7d15-4b43-967b-11b29b6ba19d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:21.871282 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbf3f6-7d15-4b43-967b-11b29b6ba19d service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:21.871601 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbf3f6-7d15-4b43-967b-11b29b6ba19d service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:21.871882 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fbf3f6-7d15-4b43-967b-11b29b6ba19d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:21.881272 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fbf3f6-7d15-4b43-967b-11b29b6ba19d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:21.907591 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fbf3f6-7d15-4b43-967b-11b29b6ba19d service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:21.916670 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1093/2186] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:07:21 2021] GET /identity/v3/auth/tokens => generated 3698 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:07:28.510320 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ede18-1ace-42ff-98fa-e96f03e9da94 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:28.511816 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-e02ede18-1ace-42ff-98fa-e96f03e9da94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:28.580694 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ede18-1ace-42ff-98fa-e96f03e9da94 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:28.584779 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c6e76-7e39-484f-850a-0c05ad56430d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:28.585567 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c6e76-7e39-484f-850a-0c05ad56430d admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:28.585851 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c6e76-7e39-484f-850a-0c05ad56430d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:28.586126 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c6e76-7e39-484f-850a-0c05ad56430d admin admin] PATH_INFO: `/v3/users/a9cfedf4836f4ad18bdee2fedd12376c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:28.587191 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c6e76-7e39-484f-850a-0c05ad56430d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9cfedf4836f4ad18bdee2fedd12376c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:28.613090 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c6e76-7e39-484f-850a-0c05ad56430d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:28.660628 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-4f5c6e76-7e39-484f-850a-0c05ad56430d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9cfedf4836f4ad18bdee2fedd12376c'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:28.661250 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-4f5c6e76-7e39-484f-850a-0c05ad56430d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9cfedf4836f4ad18bdee2fedd12376c'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:28.673154 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-4f5c6e76-7e39-484f-850a-0c05ad56430d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9cfedf4836f4ad18bdee2fedd12376c'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:28.680092 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-4f5c6e76-7e39-484f-850a-0c05ad56430d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9cfedf4836f4ad18bdee2fedd12376c'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:28.688266 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-4f5c6e76-7e39-484f-850a-0c05ad56430d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9cfedf4836f4ad18bdee2fedd12376c'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:28.694388 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1094/2187] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:07:28 2021] DELETE /identity/v3/users/a9cfedf4836f4ad18bdee2fedd12376c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:28.916158 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbf3f6-7d15-4b43-967b-11b29b6ba19d service cinder] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:28.926958 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fbf3f6-7d15-4b43-967b-11b29b6ba19d service cinder] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:28.991078 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972d0d4-dd87-44fd-8f9c-d08d0d9008f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:28.991905 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972d0d4-dd87-44fd-8f9c-d08d0d9008f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:28.992191 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972d0d4-dd87-44fd-8f9c-d08d0d9008f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:28.992471 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4972d0d4-dd87-44fd-8f9c-d08d0d9008f3 admin admin] PATH_INFO: `/v3/projects/4734f34852554bd28d358bce0bdc1d13` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:28.993588 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972d0d4-dd87-44fd-8f9c-d08d0d9008f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4734f34852554bd28d358bce0bdc1d13)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:29.019123 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4972d0d4-dd87-44fd-8f9c-d08d0d9008f3 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:29.068306 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-4972d0d4-dd87-44fd-8f9c-d08d0d9008f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4734f34852554bd28d358bce0bdc1d13', 'request_id': 'req-4972d0d4-dd87-44fd-8f9c-d08d0d9008f3'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:29.073977 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-4972d0d4-dd87-44fd-8f9c-d08d0d9008f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4734f34852554bd28d358bce0bdc1d13', 'request_id': 'req-4972d0d4-dd87-44fd-8f9c-d08d0d9008f3'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:29.085224 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-4972d0d4-dd87-44fd-8f9c-d08d0d9008f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4734f34852554bd28d358bce0bdc1d13', 'request_id': 'req-4972d0d4-dd87-44fd-8f9c-d08d0d9008f3'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:29.097870 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-4972d0d4-dd87-44fd-8f9c-d08d0d9008f3 admin admin] The token cache is being invalidate because project 4734f34852554bd28d358bce0bdc1d13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:07:29.098153 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-4972d0d4-dd87-44fd-8f9c-d08d0d9008f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:29.098744 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-4972d0d4-dd87-44fd-8f9c-d08d0d9008f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:29.100198 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1094/2188] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:07:28 2021] DELETE /identity/v3/projects/4734f34852554bd28d358bce0bdc1d13 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:07:29.104939 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c6e76-7e39-484f-850a-0c05ad56430d admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:29.106416 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-4f5c6e76-7e39-484f-850a-0c05ad56430d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:29.119232 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c6e76-7e39-484f-850a-0c05ad56430d admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:29.184758 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa66900-1e45-47d2-bceb-f7a3933edb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:29.185569 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa66900-1e45-47d2-bceb-f7a3933edb44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:29.185863 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa66900-1e45-47d2-bceb-f7a3933edb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:29.186151 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa66900-1e45-47d2-bceb-f7a3933edb44 admin admin] PATH_INFO: `/v3/users/1cb0fb00ea2e46a0b266c9ea318d9473` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:29.187288 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa66900-1e45-47d2-bceb-f7a3933edb44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cb0fb00ea2e46a0b266c9ea318d9473)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:29.213787 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa66900-1e45-47d2-bceb-f7a3933edb44 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:29.266620 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-aaa66900-1e45-47d2-bceb-f7a3933edb44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cb0fb00ea2e46a0b266c9ea318d9473'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:29.267516 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-aaa66900-1e45-47d2-bceb-f7a3933edb44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cb0fb00ea2e46a0b266c9ea318d9473'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:29.281149 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-aaa66900-1e45-47d2-bceb-f7a3933edb44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cb0fb00ea2e46a0b266c9ea318d9473'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:29.290305 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-aaa66900-1e45-47d2-bceb-f7a3933edb44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cb0fb00ea2e46a0b266c9ea318d9473'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:29.301929 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-aaa66900-1e45-47d2-bceb-f7a3933edb44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cb0fb00ea2e46a0b266c9ea318d9473'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:29.308359 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1095/2189] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:07:29 2021] DELETE /identity/v3/users/1cb0fb00ea2e46a0b266c9ea318d9473 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:29.531642 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972d0d4-dd87-44fd-8f9c-d08d0d9008f3 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:29.532942 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-4972d0d4-dd87-44fd-8f9c-d08d0d9008f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:29.544561 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4972d0d4-dd87-44fd-8f9c-d08d0d9008f3 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:29.608174 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e651e-71af-4611-b5c3-6e364b89a18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:29.609174 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e651e-71af-4611-b5c3-6e364b89a18e admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:29.609461 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e651e-71af-4611-b5c3-6e364b89a18e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:29.609739 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e651e-71af-4611-b5c3-6e364b89a18e admin admin] PATH_INFO: `/v3/projects/b31cfc4952224f229ca70f2dc59e3595` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:29.610924 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e651e-71af-4611-b5c3-6e364b89a18e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b31cfc4952224f229ca70f2dc59e3595)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:29.637562 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e651e-71af-4611-b5c3-6e364b89a18e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:29.685957 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-318e651e-71af-4611-b5c3-6e364b89a18e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b31cfc4952224f229ca70f2dc59e3595', 'request_id': 'req-318e651e-71af-4611-b5c3-6e364b89a18e'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:29.691121 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-318e651e-71af-4611-b5c3-6e364b89a18e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b31cfc4952224f229ca70f2dc59e3595', 'request_id': 'req-318e651e-71af-4611-b5c3-6e364b89a18e'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:29.706012 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-318e651e-71af-4611-b5c3-6e364b89a18e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b31cfc4952224f229ca70f2dc59e3595', 'request_id': 'req-318e651e-71af-4611-b5c3-6e364b89a18e'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:29.719232 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-318e651e-71af-4611-b5c3-6e364b89a18e admin admin] The token cache is being invalidate because project b31cfc4952224f229ca70f2dc59e3595 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:07:29.719541 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-318e651e-71af-4611-b5c3-6e364b89a18e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:29.720129 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-318e651e-71af-4611-b5c3-6e364b89a18e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:29.721537 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1095/2190] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:07:29 2021] DELETE /identity/v3/projects/b31cfc4952224f229ca70f2dc59e3595 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:29.727194 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84675294-45bd-4419-9427-f2676df42435 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:29.727705 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84675294-45bd-4419-9427-f2676df42435 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:29.727799 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84675294-45bd-4419-9427-f2676df42435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:29.749790 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-84675294-45bd-4419-9427-f2676df42435 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:29.750928 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-84675294-45bd-4419-9427-f2676df42435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:29.815980 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1096/2191] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:29.824586 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e7ef6-df1e-4341-84c9-ffcd184137fc None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:29.824880 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e7ef6-df1e-4341-84c9-ffcd184137fc None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:29.825183 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1e7ef6-df1e-4341-84c9-ffcd184137fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:29.847721 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-de1e7ef6-df1e-4341-84c9-ffcd184137fc None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:29.848876 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-de1e7ef6-df1e-4341-84c9-ffcd184137fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:29.856022 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1096/2192] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:29.860344 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84675294-45bd-4419-9427-f2676df42435 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:29.870182 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84675294-45bd-4419-9427-f2676df42435 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:29.874323 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d05884-26b5-46f6-ae04-18dcbf9762a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:29.874907 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d05884-26b5-46f6-ae04-18dcbf9762a6 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:29.875193 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d05884-26b5-46f6-ae04-18dcbf9762a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:29.875495 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d05884-26b5-46f6-ae04-18dcbf9762a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:29.876181 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d05884-26b5-46f6-ae04-18dcbf9762a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:07:29.876475 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d05884-26b5-46f6-ae04-18dcbf9762a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:29.902075 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d05884-26b5-46f6-ae04-18dcbf9762a6 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:29.916355 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1097/2193] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:07:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:07:29.920490 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e7ef6-df1e-4341-84c9-ffcd184137fc None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:29.929360 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1e7ef6-df1e-4341-84c9-ffcd184137fc None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:29.935237 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21236c21-65c3-4919-8aeb-51904c594aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:29.935861 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21236c21-65c3-4919-8aeb-51904c594aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:29.936148 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21236c21-65c3-4919-8aeb-51904c594aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:29.936423 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21236c21-65c3-4919-8aeb-51904c594aa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:29.937069 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21236c21-65c3-4919-8aeb-51904c594aa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:29.962888 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21236c21-65c3-4919-8aeb-51904c594aa0 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:29.991847 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1097/2194] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:07:29 2021] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:07:29.996456 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d05884-26b5-46f6-ae04-18dcbf9762a6 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:30.005969 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d05884-26b5-46f6-ae04-18dcbf9762a6 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:30.070576 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b83df6-1f97-4ce5-a9e0-d911ab7e7c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:30.071788 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b83df6-1f97-4ce5-a9e0-d911ab7e7c43 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:30.072066 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b83df6-1f97-4ce5-a9e0-d911ab7e7c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:30.072337 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b83df6-1f97-4ce5-a9e0-d911ab7e7c43 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:30.073042 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b83df6-1f97-4ce5-a9e0-d911ab7e7c43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:30.098026 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b83df6-1f97-4ce5-a9e0-d911ab7e7c43 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:30.121670 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1098/2195] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:07:29 2021] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:07:30.123129 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21236c21-65c3-4919-8aeb-51904c594aa0 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:30.133079 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21236c21-65c3-4919-8aeb-51904c594aa0 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:30.137604 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc215e-1014-48f5-b6ed-72f3423b90c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:30.138229 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc215e-1014-48f5-b6ed-72f3423b90c2 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:30.138513 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc215e-1014-48f5-b6ed-72f3423b90c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:30.138790 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc215e-1014-48f5-b6ed-72f3423b90c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:30.139547 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc215e-1014-48f5-b6ed-72f3423b90c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:30.165107 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc215e-1014-48f5-b6ed-72f3423b90c2 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:30.178987 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1098/2196] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:07:30 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:07:30.180148 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b83df6-1f97-4ce5-a9e0-d911ab7e7c43 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:30.190566 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b83df6-1f97-4ce5-a9e0-d911ab7e7c43 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:30.194821 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0248e-8853-4799-88b1-53604c6f41ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:30.195661 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0248e-8853-4799-88b1-53604c6f41ed admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:30.195991 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0248e-8853-4799-88b1-53604c6f41ed admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:30.196308 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0248e-8853-4799-88b1-53604c6f41ed admin admin] PATH_INFO: `/v3/projects/cfbca892c90e4207963fb5c54c4bb801/users/ba8a0cae19ed497cb2847c74465a460f/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:30.216470 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0248e-8853-4799-88b1-53604c6f41ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfbca892c90e4207963fb5c54c4bb801, user_id=ba8a0cae19ed497cb2847c74465a460f, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:30.243797 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b0248e-8853-4799-88b1-53604c6f41ed admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:30.258088 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1099/2197] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:07:30 2021] PUT /identity/v3/projects/cfbca892c90e4207963fb5c54c4bb801/users/ba8a0cae19ed497cb2847c74465a460f/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:30.268715 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab9dfc-94af-4762-9b8d-ef4794750801 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:30.269004 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab9dfc-94af-4762-9b8d-ef4794750801 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:30.269470 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab9dfc-94af-4762-9b8d-ef4794750801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:30.308626 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-41ab9dfc-94af-4762-9b8d-ef4794750801 None None] MFA Rules not processed for user `ba8a0cae19ed497cb2847c74465a460f`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:30.309787 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-41ab9dfc-94af-4762-9b8d-ef4794750801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:30.384824 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1099/2198] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:30 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:30.396483 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0248e-8853-4799-88b1-53604c6f41ed admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:30.398267 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-81b0248e-8853-4799-88b1-53604c6f41ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:30.478829 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0248e-8853-4799-88b1-53604c6f41ed admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:30.483574 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf5ae74-7f36-4c50-bbd6-63a725f1fe90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:30.484674 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5ae74-7f36-4c50-bbd6-63a725f1fe90 service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:30.485118 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5ae74-7f36-4c50-bbd6-63a725f1fe90 service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:30.485728 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf5ae74-7f36-4c50-bbd6-63a725f1fe90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:30.497152 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf5ae74-7f36-4c50-bbd6-63a725f1fe90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:30.528217 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf5ae74-7f36-4c50-bbd6-63a725f1fe90 service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:30.540339 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1100/2199] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:07:30 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:07:30.567869 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab9dfc-94af-4762-9b8d-ef4794750801 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:30.639159 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab9dfc-94af-4762-9b8d-ef4794750801 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:30.643307 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2cefe-729c-4c8d-beeb-b3dab9fe748d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:30.644143 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2cefe-729c-4c8d-beeb-b3dab9fe748d admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:30.644431 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2cefe-729c-4c8d-beeb-b3dab9fe748d admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:30.644711 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2cefe-729c-4c8d-beeb-b3dab9fe748d admin admin] PATH_INFO: `/v3/users/ba8a0cae19ed497cb2847c74465a460f` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:30.646020 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2cefe-729c-4c8d-beeb-b3dab9fe748d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba8a0cae19ed497cb2847c74465a460f)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:30.673786 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2cefe-729c-4c8d-beeb-b3dab9fe748d admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:30.725490 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-8eb2cefe-729c-4c8d-beeb-b3dab9fe748d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba8a0cae19ed497cb2847c74465a460f'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:30.737894 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-8eb2cefe-729c-4c8d-beeb-b3dab9fe748d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba8a0cae19ed497cb2847c74465a460f'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:30.738523 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-8eb2cefe-729c-4c8d-beeb-b3dab9fe748d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba8a0cae19ed497cb2847c74465a460f'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:30.745696 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-8eb2cefe-729c-4c8d-beeb-b3dab9fe748d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba8a0cae19ed497cb2847c74465a460f'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:30.753529 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-8eb2cefe-729c-4c8d-beeb-b3dab9fe748d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba8a0cae19ed497cb2847c74465a460f'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:30.759319 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1100/2200] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:07:30 2021] DELETE /identity/v3/users/ba8a0cae19ed497cb2847c74465a460f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:30.763779 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4907b9-19c2-46ca-989b-cfa18a5be290 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:30.764294 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4907b9-19c2-46ca-989b-cfa18a5be290 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:30.764388 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4907b9-19c2-46ca-989b-cfa18a5be290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:30.786811 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-ee4907b9-19c2-46ca-989b-cfa18a5be290 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:30.787998 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-ee4907b9-19c2-46ca-989b-cfa18a5be290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:30.854942 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1101/2201] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:30.865817 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2cefe-729c-4c8d-beeb-b3dab9fe748d admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:30.867206 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-8eb2cefe-729c-4c8d-beeb-b3dab9fe748d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:30.933382 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2cefe-729c-4c8d-beeb-b3dab9fe748d admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:30.937382 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe87f90-4c89-46ba-ba52-38ea0e9dd46f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:30.937974 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe87f90-4c89-46ba-ba52-38ea0e9dd46f service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:30.938264 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe87f90-4c89-46ba-ba52-38ea0e9dd46f service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:30.938545 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe87f90-4c89-46ba-ba52-38ea0e9dd46f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:30.948528 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe87f90-4c89-46ba-ba52-38ea0e9dd46f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:30.974624 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe87f90-4c89-46ba-ba52-38ea0e9dd46f service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:30.986267 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1101/2202] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:07:30 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:07:31.053171 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4907b9-19c2-46ca-989b-cfa18a5be290 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:31.055032 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-ee4907b9-19c2-46ca-989b-cfa18a5be290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:31.067986 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4907b9-19c2-46ca-989b-cfa18a5be290 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:31.074117 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce9674-bfd1-4402-8ed9-ff4adc67f3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:31.075327 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce9674-bfd1-4402-8ed9-ff4adc67f3ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:31.075820 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce9674-bfd1-4402-8ed9-ff4adc67f3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:31.076103 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce9674-bfd1-4402-8ed9-ff4adc67f3ea admin admin] PATH_INFO: `/v3/users/01c793d7cc294cbc9faaefca494886f5` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:31.077383 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce9674-bfd1-4402-8ed9-ff4adc67f3ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=01c793d7cc294cbc9faaefca494886f5)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:31.107670 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce9674-bfd1-4402-8ed9-ff4adc67f3ea admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:31.170941 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-79ce9674-bfd1-4402-8ed9-ff4adc67f3ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01c793d7cc294cbc9faaefca494886f5'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:31.171610 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-79ce9674-bfd1-4402-8ed9-ff4adc67f3ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01c793d7cc294cbc9faaefca494886f5'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:31.186903 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-79ce9674-bfd1-4402-8ed9-ff4adc67f3ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01c793d7cc294cbc9faaefca494886f5'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:31.198931 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-79ce9674-bfd1-4402-8ed9-ff4adc67f3ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01c793d7cc294cbc9faaefca494886f5'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:31.216934 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-79ce9674-bfd1-4402-8ed9-ff4adc67f3ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01c793d7cc294cbc9faaefca494886f5'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:31.225994 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1102/2203] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:07:31 2021] DELETE /identity/v3/users/01c793d7cc294cbc9faaefca494886f5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:31.240187 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cc09d-ad2c-48a2-bf06-3c8b3e46e09d None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:31.240477 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cc09d-ad2c-48a2-bf06-3c8b3e46e09d None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:31.240761 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cc09d-ad2c-48a2-bf06-3c8b3e46e09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:31.284408 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-2b4cc09d-ad2c-48a2-bf06-3c8b3e46e09d None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:31.285777 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-2b4cc09d-ad2c-48a2-bf06-3c8b3e46e09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:31.478566 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1102/2204] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:31.481204 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce9674-bfd1-4402-8ed9-ff4adc67f3ea admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:31.482921 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-79ce9674-bfd1-4402-8ed9-ff4adc67f3ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:31.497854 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce9674-bfd1-4402-8ed9-ff4adc67f3ea admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:31.502787 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ecd3f-9817-4571-9142-1346dd8b3b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:31.503763 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ecd3f-9817-4571-9142-1346dd8b3b4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:31.504249 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ecd3f-9817-4571-9142-1346dd8b3b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:31.504626 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ecd3f-9817-4571-9142-1346dd8b3b4f admin admin] PATH_INFO: `/v3/projects/cfbca892c90e4207963fb5c54c4bb801` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:31.506077 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ecd3f-9817-4571-9142-1346dd8b3b4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfbca892c90e4207963fb5c54c4bb801)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:31.507210 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cc09d-ad2c-48a2-bf06-3c8b3e46e09d None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:31.510039 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-2b4cc09d-ad2c-48a2-bf06-3c8b3e46e09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:31.562431 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ecd3f-9817-4571-9142-1346dd8b3b4f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:31.640307 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cc09d-ad2c-48a2-bf06-3c8b3e46e09d None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:31.640516 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-dc8ecd3f-9817-4571-9142-1346dd8b3b4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfbca892c90e4207963fb5c54c4bb801', 'request_id': 'req-dc8ecd3f-9817-4571-9142-1346dd8b3b4f'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:31.646628 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-dc8ecd3f-9817-4571-9142-1346dd8b3b4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfbca892c90e4207963fb5c54c4bb801', 'request_id': 'req-dc8ecd3f-9817-4571-9142-1346dd8b3b4f'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:31.662001 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-dc8ecd3f-9817-4571-9142-1346dd8b3b4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfbca892c90e4207963fb5c54c4bb801', 'request_id': 'req-dc8ecd3f-9817-4571-9142-1346dd8b3b4f'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:31.692468 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-dc8ecd3f-9817-4571-9142-1346dd8b3b4f admin admin] The token cache is being invalidate because project cfbca892c90e4207963fb5c54c4bb801 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:07:31.692818 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-dc8ecd3f-9817-4571-9142-1346dd8b3b4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:31.693432 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-dc8ecd3f-9817-4571-9142-1346dd8b3b4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:31.695269 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1103/2205] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:07:31 2021] DELETE /identity/v3/projects/cfbca892c90e4207963fb5c54c4bb801 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:31.701633 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4e173-a27d-4e19-8a61-809d5b174c32 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:31.701633 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4e173-a27d-4e19-8a61-809d5b174c32 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:31.701917 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4e173-a27d-4e19-8a61-809d5b174c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:31.717188 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c38e0-525e-4d74-b83a-f0d56d669e57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:31.717982 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c38e0-525e-4d74-b83a-f0d56d669e57 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:31.718366 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c38e0-525e-4d74-b83a-f0d56d669e57 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:31.718738 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c38e0-525e-4d74-b83a-f0d56d669e57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:31.720882 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-d93c38e0-525e-4d74-b83a-f0d56d669e57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:31.726545 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-57e4e173-a27d-4e19-8a61-809d5b174c32 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:31.728122 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-57e4e173-a27d-4e19-8a61-809d5b174c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:31.796635 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c38e0-525e-4d74-b83a-f0d56d669e57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:31.802420 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1104/2206] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:31.811889 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997d192-ca26-4016-85bd-b398b807e376 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:31.812223 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997d192-ca26-4016-85bd-b398b807e376 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:31.812527 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997d192-ca26-4016-85bd-b398b807e376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:31.825628 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93c38e0-525e-4d74-b83a-f0d56d669e57 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:31.835641 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1103/2207] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:07:31 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:07:31.835859 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-0997d192-ca26-4016-85bd-b398b807e376 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:31.836759 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-0997d192-ca26-4016-85bd-b398b807e376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:31.845135 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1105/2208] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:31 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:31.849447 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c38e0-525e-4d74-b83a-f0d56d669e57 service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:31.859975 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c38e0-525e-4d74-b83a-f0d56d669e57 service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:31.864479 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bb388-317d-4415-8b8d-c0a2ed63c12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:31.865073 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bb388-317d-4415-8b8d-c0a2ed63c12e admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:31.865364 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bb388-317d-4415-8b8d-c0a2ed63c12e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:31.865644 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bb388-317d-4415-8b8d-c0a2ed63c12e admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:31.866363 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180bb388-317d-4415-8b8d-c0a2ed63c12e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:07:31.866660 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180bb388-317d-4415-8b8d-c0a2ed63c12e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:31.892802 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180bb388-317d-4415-8b8d-c0a2ed63c12e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:31.907111 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1104/2209] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:07:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:07:31.911535 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997d192-ca26-4016-85bd-b398b807e376 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:31.921160 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0997d192-ca26-4016-85bd-b398b807e376 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:31.925818 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b5a88-add7-4ce4-87bf-ee2c64b77ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:31.926826 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b5a88-add7-4ce4-87bf-ee2c64b77ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:31.926826 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b5a88-add7-4ce4-87bf-ee2c64b77ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:31.927036 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b5a88-add7-4ce4-87bf-ee2c64b77ec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:31.927662 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b5a88-add7-4ce4-87bf-ee2c64b77ec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:31.953824 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b5a88-add7-4ce4-87bf-ee2c64b77ec9 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:32.001215 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1106/2210] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:07:31 2021] POST /identity/v3/projects => generated 385 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:07:32.005651 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bb388-317d-4415-8b8d-c0a2ed63c12e admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:32.015555 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bb388-317d-4415-8b8d-c0a2ed63c12e admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:32.084789 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce17a94-bcd7-4c0c-9de4-83856cd2748e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:32.085396 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce17a94-bcd7-4c0c-9de4-83856cd2748e admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:32.085684 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce17a94-bcd7-4c0c-9de4-83856cd2748e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:32.086000 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce17a94-bcd7-4c0c-9de4-83856cd2748e admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:32.087410 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce17a94-bcd7-4c0c-9de4-83856cd2748e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:32.114900 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce17a94-bcd7-4c0c-9de4-83856cd2748e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:32.136171 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1105/2211] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:07:32 2021] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:07:32.140239 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b5a88-add7-4ce4-87bf-ee2c64b77ec9 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:32.150525 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b5a88-add7-4ce4-87bf-ee2c64b77ec9 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:32.154853 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f90bd-fb66-4f36-8401-cd81fd3e3dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:32.155821 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f90bd-fb66-4f36-8401-cd81fd3e3dfe admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:32.156173 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f90bd-fb66-4f36-8401-cd81fd3e3dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:32.156519 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f90bd-fb66-4f36-8401-cd81fd3e3dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:32.157286 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f90bd-fb66-4f36-8401-cd81fd3e3dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:32.182879 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f90bd-fb66-4f36-8401-cd81fd3e3dfe admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:32.193318 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1107/2212] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:07:32 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:07:32.197576 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce17a94-bcd7-4c0c-9de4-83856cd2748e admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:32.207403 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce17a94-bcd7-4c0c-9de4-83856cd2748e admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:32.212798 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97592a8c-52cd-436e-becc-49a92b7d6564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:32.213850 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97592a8c-52cd-436e-becc-49a92b7d6564 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:32.214122 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97592a8c-52cd-436e-becc-49a92b7d6564 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:32.214494 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97592a8c-52cd-436e-becc-49a92b7d6564 admin admin] PATH_INFO: `/v3/projects/7b989ceb09074047aa41c3b1c49595d1/users/2c45a879d9344d33bf2c3cf431a8c84c/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:32.238059 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97592a8c-52cd-436e-becc-49a92b7d6564 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b989ceb09074047aa41c3b1c49595d1, user_id=2c45a879d9344d33bf2c3cf431a8c84c, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:32.266068 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97592a8c-52cd-436e-becc-49a92b7d6564 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:32.273130 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f90bd-fb66-4f36-8401-cd81fd3e3dfe admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:32.275608 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-f62f90bd-fb66-4f36-8401-cd81fd3e3dfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:32.293072 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1106/2213] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:07:32 2021] PUT /identity/v3/projects/7b989ceb09074047aa41c3b1c49595d1/users/2c45a879d9344d33bf2c3cf431a8c84c/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:32.293757 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f90bd-fb66-4f36-8401-cd81fd3e3dfe admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:32.295066 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf2c01-d6d3-4eee-bb76-9dac4c065322 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:32.295426 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf2c01-d6d3-4eee-bb76-9dac4c065322 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:32.295967 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf2c01-d6d3-4eee-bb76-9dac4c065322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:32.334780 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-5aaf2c01-d6d3-4eee-bb76-9dac4c065322 None None] MFA Rules not processed for user `2c45a879d9344d33bf2c3cf431a8c84c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:32.336135 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-5aaf2c01-d6d3-4eee-bb76-9dac4c065322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:32.361231 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28931639-638a-41c6-b0be-7aca1b5249a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:32.362031 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28931639-638a-41c6-b0be-7aca1b5249a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:32.362322 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28931639-638a-41c6-b0be-7aca1b5249a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:32.362595 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28931639-638a-41c6-b0be-7aca1b5249a1 admin admin] PATH_INFO: `/v3/projects/2a66628ac7c4418e8e7b509a1624780d` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:32.363712 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28931639-638a-41c6-b0be-7aca1b5249a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a66628ac7c4418e8e7b509a1624780d)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:32.389786 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28931639-638a-41c6-b0be-7aca1b5249a1 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:32.410662 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1107/2214] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:32 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:32.420680 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf2c01-d6d3-4eee-bb76-9dac4c065322 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:32.422520 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-5aaf2c01-d6d3-4eee-bb76-9dac4c065322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:32.441379 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-28931639-638a-41c6-b0be-7aca1b5249a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a66628ac7c4418e8e7b509a1624780d', 'request_id': 'req-28931639-638a-41c6-b0be-7aca1b5249a1'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:32.446936 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-28931639-638a-41c6-b0be-7aca1b5249a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a66628ac7c4418e8e7b509a1624780d', 'request_id': 'req-28931639-638a-41c6-b0be-7aca1b5249a1'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:32.458189 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-28931639-638a-41c6-b0be-7aca1b5249a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a66628ac7c4418e8e7b509a1624780d', 'request_id': 'req-28931639-638a-41c6-b0be-7aca1b5249a1'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:32.470896 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-28931639-638a-41c6-b0be-7aca1b5249a1 admin admin] The token cache is being invalidate because project 2a66628ac7c4418e8e7b509a1624780d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:07:32.471177 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-28931639-638a-41c6-b0be-7aca1b5249a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:32.471808 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-28931639-638a-41c6-b0be-7aca1b5249a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:32.473518 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1108/2215] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:07:32 2021] DELETE /identity/v3/projects/2a66628ac7c4418e8e7b509a1624780d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:32.480796 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394e12c-8eb2-4973-aea3-be28697907f7 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:32.481079 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394e12c-8eb2-4973-aea3-be28697907f7 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:32.481357 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1394e12c-8eb2-4973-aea3-be28697907f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:32.486854 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf2c01-d6d3-4eee-bb76-9dac4c065322 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:32.503113 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-1394e12c-8eb2-4973-aea3-be28697907f7 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:32.504295 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-1394e12c-8eb2-4973-aea3-be28697907f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:32.542645 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356c626-7852-4ed2-9265-415fd5eba896 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:32.543232 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356c626-7852-4ed2-9265-415fd5eba896 service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:32.543612 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356c626-7852-4ed2-9265-415fd5eba896 service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:32.543888 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356c626-7852-4ed2-9265-415fd5eba896 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:32.545571 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-9356c626-7852-4ed2-9265-415fd5eba896 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:32.568733 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1109/2216] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:32 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:07:32.576410 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deab46c-5e30-43f1-a99c-f7753de0d1bd None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:32.576703 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deab46c-5e30-43f1-a99c-f7753de0d1bd None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:32.576981 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deab46c-5e30-43f1-a99c-f7753de0d1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:32.598700 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-3deab46c-5e30-43f1-a99c-f7753de0d1bd None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:32.599895 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-3deab46c-5e30-43f1-a99c-f7753de0d1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:32.607132 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1110/2217] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:32 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:07:32.609888 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356c626-7852-4ed2-9265-415fd5eba896 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:32.610875 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deab46c-5e30-43f1-a99c-f7753de0d1bd None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:32.619525 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deab46c-5e30-43f1-a99c-f7753de0d1bd None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:32.623948 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b343c0e-4524-4ca1-b89f-04db8fb50dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:32.624609 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b343c0e-4524-4ca1-b89f-04db8fb50dcc admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:32.624894 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b343c0e-4524-4ca1-b89f-04db8fb50dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:32.625169 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b343c0e-4524-4ca1-b89f-04db8fb50dcc admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:32.625846 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b343c0e-4524-4ca1-b89f-04db8fb50dcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:07:32.626169 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b343c0e-4524-4ca1-b89f-04db8fb50dcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:32.635259 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356c626-7852-4ed2-9265-415fd5eba896 service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:32.645572 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1108/2218] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:07:32 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:07:32.659719 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b343c0e-4524-4ca1-b89f-04db8fb50dcc admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:32.681899 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1111/2219] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:07:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 15:07:32.687342 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356c626-7852-4ed2-9265-415fd5eba896 service cinder] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:32.698780 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356c626-7852-4ed2-9265-415fd5eba896 service cinder] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:32.703379 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca811f-a6a8-4810-a7d7-7aa45630d07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:32.704092 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca811f-a6a8-4810-a7d7-7aa45630d07e admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:32.704397 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca811f-a6a8-4810-a7d7-7aa45630d07e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:32.704663 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca811f-a6a8-4810-a7d7-7aa45630d07e admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:32.706601 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ca811f-a6a8-4810-a7d7-7aa45630d07e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:32.735356 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ca811f-a6a8-4810-a7d7-7aa45630d07e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:32.773996 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1109/2220] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:07:32 2021] POST /identity/v3/projects => generated 375 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:07:32.775538 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b343c0e-4524-4ca1-b89f-04db8fb50dcc admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:32.787308 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b343c0e-4524-4ca1-b89f-04db8fb50dcc admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:32.869589 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae7ab5-e8c9-4024-b50c-1b59507ab0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:32.870547 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae7ab5-e8c9-4024-b50c-1b59507ab0c6 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:32.870905 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae7ab5-e8c9-4024-b50c-1b59507ab0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:32.871466 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceae7ab5-e8c9-4024-b50c-1b59507ab0c6 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:32.872205 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae7ab5-e8c9-4024-b50c-1b59507ab0c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:32.906655 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceae7ab5-e8c9-4024-b50c-1b59507ab0c6 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:32.923077 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6d9a1-4c71-4678-8fc2-d82412127e7c None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:32.923417 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6d9a1-4c71-4678-8fc2-d82412127e7c None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:32.923875 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6d9a1-4c71-4678-8fc2-d82412127e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:32.928187 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1112/2221] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:07:32 2021] POST /identity/v3/users => generated 288 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:07:32.933088 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae7ab5-e8c9-4024-b50c-1b59507ab0c6 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:32.942506 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceae7ab5-e8c9-4024-b50c-1b59507ab0c6 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:32.947710 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ec74a-7688-48d5-b458-345eb193f8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:32.948650 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ec74a-7688-48d5-b458-345eb193f8bd admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:32.949023 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ec74a-7688-48d5-b458-345eb193f8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:32.949393 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ec74a-7688-48d5-b458-345eb193f8bd admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:32.949673 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-05e6d9a1-4c71-4678-8fc2-d82412127e7c None None] MFA Rules not processed for user `7a86cdc90706440c8fa6bf9e101573b9`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:32.950267 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ec74a-7688-48d5-b458-345eb193f8bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:32.950830 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-05e6d9a1-4c71-4678-8fc2-d82412127e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:32.976573 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ec74a-7688-48d5-b458-345eb193f8bd admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:32.991509 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1113/2222] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:07:32 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:07:32.993792 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ec74a-7688-48d5-b458-345eb193f8bd admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:33.005544 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ec74a-7688-48d5-b458-345eb193f8bd admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:33.011248 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c5807-86ee-4c0e-86df-bae8d8dc4ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:33.012735 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c5807-86ee-4c0e-86df-bae8d8dc4ae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:33.013222 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c5807-86ee-4c0e-86df-bae8d8dc4ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:33.013658 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28c5807-86ee-4c0e-86df-bae8d8dc4ae6 admin admin] PATH_INFO: `/v3/projects/23dda4ab036e4f8998d01e62729f24b5/users/7d8c4d0c72ec4462861537f609feadfe/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:33.029264 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1110/2223] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:32 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:33.040961 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c5807-86ee-4c0e-86df-bae8d8dc4ae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23dda4ab036e4f8998d01e62729f24b5, user_id=7d8c4d0c72ec4462861537f609feadfe, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:33.069987 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28c5807-86ee-4c0e-86df-bae8d8dc4ae6 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:33.106624 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1114/2224] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:07:32 2021] PUT /identity/v3/projects/23dda4ab036e4f8998d01e62729f24b5/users/7d8c4d0c72ec4462861537f609feadfe/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:33.110605 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65939fe-c4ae-4ae5-b8fc-e5c69c3a5028 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:33.111169 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65939fe-c4ae-4ae5-b8fc-e5c69c3a5028 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:33.111634 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65939fe-c4ae-4ae5-b8fc-e5c69c3a5028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:33.179332 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-e65939fe-c4ae-4ae5-b8fc-e5c69c3a5028 None None] MFA Rules not processed for user `7d8c4d0c72ec4462861537f609feadfe`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:33.181126 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-e65939fe-c4ae-4ae5-b8fc-e5c69c3a5028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:33.272042 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1111/2225] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:33 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:07:33.281779 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c5807-86ee-4c0e-86df-bae8d8dc4ae6 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:33.283365 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-e28c5807-86ee-4c0e-86df-bae8d8dc4ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:33.353864 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28c5807-86ee-4c0e-86df-bae8d8dc4ae6 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:33.357838 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d88737-6f0f-4471-b586-d590a0e5226d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:33.358429 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d88737-6f0f-4471-b586-d590a0e5226d service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:33.358717 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d88737-6f0f-4471-b586-d590a0e5226d service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:33.359124 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d88737-6f0f-4471-b586-d590a0e5226d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:33.368520 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d88737-6f0f-4471-b586-d590a0e5226d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:33.393343 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d88737-6f0f-4471-b586-d590a0e5226d service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:33.402712 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1115/2226] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:07:33 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:07:37.936780 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65939fe-c4ae-4ae5-b8fc-e5c69c3a5028 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:37.938273 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-e65939fe-c4ae-4ae5-b8fc-e5c69c3a5028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:38.010743 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65939fe-c4ae-4ae5-b8fc-e5c69c3a5028 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:38.015322 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c10c56-8f70-42b2-94ef-177899f16f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:38.016404 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c10c56-8f70-42b2-94ef-177899f16f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:38.016639 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c10c56-8f70-42b2-94ef-177899f16f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:38.016930 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c10c56-8f70-42b2-94ef-177899f16f19 admin admin] PATH_INFO: `/v3/users/2c45a879d9344d33bf2c3cf431a8c84c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:38.018112 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c10c56-8f70-42b2-94ef-177899f16f19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c45a879d9344d33bf2c3cf431a8c84c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:38.045098 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c10c56-8f70-42b2-94ef-177899f16f19 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:38.104132 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-73c10c56-8f70-42b2-94ef-177899f16f19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c45a879d9344d33bf2c3cf431a8c84c'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:38.119115 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-73c10c56-8f70-42b2-94ef-177899f16f19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c45a879d9344d33bf2c3cf431a8c84c'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:38.120037 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-73c10c56-8f70-42b2-94ef-177899f16f19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c45a879d9344d33bf2c3cf431a8c84c'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:38.130107 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-73c10c56-8f70-42b2-94ef-177899f16f19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c45a879d9344d33bf2c3cf431a8c84c'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:38.144866 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-73c10c56-8f70-42b2-94ef-177899f16f19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c45a879d9344d33bf2c3cf431a8c84c'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:38.151187 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1112/2227] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:07:37 2021] DELETE /identity/v3/users/2c45a879d9344d33bf2c3cf431a8c84c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:38.155658 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df1b4a-9756-4126-99c3-e8ec7bbd191b None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:38.156137 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df1b4a-9756-4126-99c3-e8ec7bbd191b None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:38.156231 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df1b4a-9756-4126-99c3-e8ec7bbd191b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:38.181462 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-d9df1b4a-9756-4126-99c3-e8ec7bbd191b None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:38.183305 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-d9df1b4a-9756-4126-99c3-e8ec7bbd191b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:38.288414 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1116/2228] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:38.301140 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c10c56-8f70-42b2-94ef-177899f16f19 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:38.303516 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-73c10c56-8f70-42b2-94ef-177899f16f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:38.378494 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c10c56-8f70-42b2-94ef-177899f16f19 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:38.381793 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2ad0b0-0bd6-4655-bc2e-5d322c63a14a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:38.382383 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ad0b0-0bd6-4655-bc2e-5d322c63a14a service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:38.382667 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ad0b0-0bd6-4655-bc2e-5d322c63a14a service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:38.382942 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ad0b0-0bd6-4655-bc2e-5d322c63a14a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:38.393155 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ad0b0-0bd6-4655-bc2e-5d322c63a14a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:38.420766 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2ad0b0-0bd6-4655-bc2e-5d322c63a14a service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:38.431986 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1113/2229] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:07:38 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:07:38.828017 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df1b4a-9756-4126-99c3-e8ec7bbd191b None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:38.829671 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-d9df1b4a-9756-4126-99c3-e8ec7bbd191b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:38.842813 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df1b4a-9756-4126-99c3-e8ec7bbd191b None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:38.847628 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a543b08-451e-4e0e-a96c-e1f83d2ed3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:38.848444 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a543b08-451e-4e0e-a96c-e1f83d2ed3ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:38.848733 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a543b08-451e-4e0e-a96c-e1f83d2ed3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:38.849015 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a543b08-451e-4e0e-a96c-e1f83d2ed3ff admin admin] PATH_INFO: `/v3/projects/7b989ceb09074047aa41c3b1c49595d1` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:38.850120 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a543b08-451e-4e0e-a96c-e1f83d2ed3ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b989ceb09074047aa41c3b1c49595d1)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:38.877401 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a543b08-451e-4e0e-a96c-e1f83d2ed3ff admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:38.933776 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-3a543b08-451e-4e0e-a96c-e1f83d2ed3ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b989ceb09074047aa41c3b1c49595d1', 'request_id': 'req-3a543b08-451e-4e0e-a96c-e1f83d2ed3ff'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:38.939336 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-3a543b08-451e-4e0e-a96c-e1f83d2ed3ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b989ceb09074047aa41c3b1c49595d1', 'request_id': 'req-3a543b08-451e-4e0e-a96c-e1f83d2ed3ff'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:38.951679 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-3a543b08-451e-4e0e-a96c-e1f83d2ed3ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b989ceb09074047aa41c3b1c49595d1', 'request_id': 'req-3a543b08-451e-4e0e-a96c-e1f83d2ed3ff'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:38.968420 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-3a543b08-451e-4e0e-a96c-e1f83d2ed3ff admin admin] The token cache is being invalidate because project 7b989ceb09074047aa41c3b1c49595d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:07:38.968711 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-3a543b08-451e-4e0e-a96c-e1f83d2ed3ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:38.969357 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-3a543b08-451e-4e0e-a96c-e1f83d2ed3ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:38.970827 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1117/2230] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:07:38 2021] DELETE /identity/v3/projects/7b989ceb09074047aa41c3b1c49595d1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:38.977517 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e998d-812a-4aef-8b82-ad1aabc58a56 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:38.978107 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e998d-812a-4aef-8b82-ad1aabc58a56 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:38.978107 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e998d-812a-4aef-8b82-ad1aabc58a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:39.003191 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-e38e998d-812a-4aef-8b82-ad1aabc58a56 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:39.004388 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-e38e998d-812a-4aef-8b82-ad1aabc58a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:39.069922 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1114/2231] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:39.078580 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d55ff-0e8b-4514-8c67-ab902d5a0fe2 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:39.079022 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d55ff-0e8b-4514-8c67-ab902d5a0fe2 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:39.079419 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d55ff-0e8b-4514-8c67-ab902d5a0fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:39.102258 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-111d55ff-0e8b-4514-8c67-ab902d5a0fe2 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:39.103394 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-111d55ff-0e8b-4514-8c67-ab902d5a0fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:39.110667 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1118/2232] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:39.114737 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e998d-812a-4aef-8b82-ad1aabc58a56 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:39.123880 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e998d-812a-4aef-8b82-ad1aabc58a56 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:39.127980 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503ca19-67a5-4558-8907-eb7859611b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:39.128568 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503ca19-67a5-4558-8907-eb7859611b63 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:39.128854 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503ca19-67a5-4558-8907-eb7859611b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:39.129132 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503ca19-67a5-4558-8907-eb7859611b63 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:39.129809 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503ca19-67a5-4558-8907-eb7859611b63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:07:39.130106 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503ca19-67a5-4558-8907-eb7859611b63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:39.156192 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503ca19-67a5-4558-8907-eb7859611b63 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:39.169138 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1115/2233] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:07:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:07:39.173389 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d55ff-0e8b-4514-8c67-ab902d5a0fe2 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:39.183288 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d55ff-0e8b-4514-8c67-ab902d5a0fe2 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:39.188056 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715a522-86c1-49f0-aa7c-de7269fefea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:39.188669 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715a522-86c1-49f0-aa7c-de7269fefea2 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:39.188945 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715a522-86c1-49f0-aa7c-de7269fefea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:39.189257 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715a522-86c1-49f0-aa7c-de7269fefea2 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:39.189872 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715a522-86c1-49f0-aa7c-de7269fefea2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:39.216452 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715a522-86c1-49f0-aa7c-de7269fefea2 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:39.248922 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1119/2234] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:07:39 2021] POST /identity/v3/projects => generated 375 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:07:39.252909 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503ca19-67a5-4558-8907-eb7859611b63 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:39.264451 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503ca19-67a5-4558-8907-eb7859611b63 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:39.335772 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85724715-b295-4206-8769-37d4e3602020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:39.336995 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85724715-b295-4206-8769-37d4e3602020 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:39.337283 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85724715-b295-4206-8769-37d4e3602020 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:39.337562 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85724715-b295-4206-8769-37d4e3602020 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:39.338200 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85724715-b295-4206-8769-37d4e3602020 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:39.363621 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85724715-b295-4206-8769-37d4e3602020 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:39.386808 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1116/2235] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:07:39 2021] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:07:39.388057 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715a522-86c1-49f0-aa7c-de7269fefea2 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:39.397824 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715a522-86c1-49f0-aa7c-de7269fefea2 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:39.402771 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96c722-909b-4c9f-b193-54f852ba2999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:39.403374 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96c722-909b-4c9f-b193-54f852ba2999 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:39.403693 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96c722-909b-4c9f-b193-54f852ba2999 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:39.403973 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96c722-909b-4c9f-b193-54f852ba2999 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:39.404670 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd96c722-909b-4c9f-b193-54f852ba2999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:39.430790 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd96c722-909b-4c9f-b193-54f852ba2999 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:39.441179 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1120/2236] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:07:39 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:07:39.445375 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85724715-b295-4206-8769-37d4e3602020 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:39.455209 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85724715-b295-4206-8769-37d4e3602020 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:39.459398 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12f3b0-d0a7-4996-a879-9d4adf127240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:39.460241 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12f3b0-d0a7-4996-a879-9d4adf127240 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:39.460526 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12f3b0-d0a7-4996-a879-9d4adf127240 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:39.460806 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12f3b0-d0a7-4996-a879-9d4adf127240 admin admin] PATH_INFO: `/v3/projects/232e08d132a9419d8e005d58c8c63763/users/36e0c8e8108c4231be49368e19dc1ec3/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:39.480836 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12f3b0-d0a7-4996-a879-9d4adf127240 admin admin] RBAC: Authorizing `identity:create_grant(project_id=232e08d132a9419d8e005d58c8c63763, user_id=36e0c8e8108c4231be49368e19dc1ec3, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:39.507481 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12f3b0-d0a7-4996-a879-9d4adf127240 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:39.521064 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1117/2237] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:07:39 2021] PUT /identity/v3/projects/232e08d132a9419d8e005d58c8c63763/users/36e0c8e8108c4231be49368e19dc1ec3/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:07:39.532645 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f882c79-1ed2-47d4-a5e5-81577107a1d8 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:39.533076 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f882c79-1ed2-47d4-a5e5-81577107a1d8 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:39.533433 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f882c79-1ed2-47d4-a5e5-81577107a1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:39.569961 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-3f882c79-1ed2-47d4-a5e5-81577107a1d8 None None] MFA Rules not processed for user `36e0c8e8108c4231be49368e19dc1ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:39.571720 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-3f882c79-1ed2-47d4-a5e5-81577107a1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:39.641954 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1121/2238] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:39 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:39.651131 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12f3b0-d0a7-4996-a879-9d4adf127240 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:39.652730 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-9f12f3b0-d0a7-4996-a879-9d4adf127240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:39.717268 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12f3b0-d0a7-4996-a879-9d4adf127240 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:39.720713 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fb2d0-9bd6-40a4-998d-a9aecc4cff06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:39.721322 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fb2d0-9bd6-40a4-998d-a9aecc4cff06 service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:39.721609 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fb2d0-9bd6-40a4-998d-a9aecc4cff06 service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:39.721887 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8fb2d0-9bd6-40a4-998d-a9aecc4cff06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:39.730317 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8fb2d0-9bd6-40a4-998d-a9aecc4cff06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:39.756173 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8fb2d0-9bd6-40a4-998d-a9aecc4cff06 service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:39.767360 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1118/2239] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:07:39 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:07:43.501323 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af00815-6d39-463a-a9eb-c73e4cb5cb86 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:43.501894 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af00815-6d39-463a-a9eb-c73e4cb5cb86 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:43.502160 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af00815-6d39-463a-a9eb-c73e4cb5cb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:43.537483 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-6af00815-6d39-463a-a9eb-c73e4cb5cb86 None None] MFA Rules not processed for user `36e0c8e8108c4231be49368e19dc1ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:43.538740 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-6af00815-6d39-463a-a9eb-c73e4cb5cb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:43.572259 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1122/2240] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:43 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:48.405027 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fb2d0-9bd6-40a4-998d-a9aecc4cff06 service cinder] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:48.408660 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-ef8fb2d0-9bd6-40a4-998d-a9aecc4cff06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:48.593467 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8fb2d0-9bd6-40a4-998d-a9aecc4cff06 service cinder] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:48.600193 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0e6d1-6e4f-4375-b219-1f6b90b1a47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:48.601787 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0e6d1-6e4f-4375-b219-1f6b90b1a47a admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:48.602178 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0e6d1-6e4f-4375-b219-1f6b90b1a47a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:48.602711 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0e6d1-6e4f-4375-b219-1f6b90b1a47a admin admin] PATH_INFO: `/v3/users/b53dbc10407248f7a6672053ae35c962` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:48.604649 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0e6d1-6e4f-4375-b219-1f6b90b1a47a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b53dbc10407248f7a6672053ae35c962)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:48.643146 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0e6d1-6e4f-4375-b219-1f6b90b1a47a admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:48.740445 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-d2d0e6d1-6e4f-4375-b219-1f6b90b1a47a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b53dbc10407248f7a6672053ae35c962'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:48.754507 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-d2d0e6d1-6e4f-4375-b219-1f6b90b1a47a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b53dbc10407248f7a6672053ae35c962'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:48.755217 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-d2d0e6d1-6e4f-4375-b219-1f6b90b1a47a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b53dbc10407248f7a6672053ae35c962'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:48.763521 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-d2d0e6d1-6e4f-4375-b219-1f6b90b1a47a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b53dbc10407248f7a6672053ae35c962'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:48.772339 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-d2d0e6d1-6e4f-4375-b219-1f6b90b1a47a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b53dbc10407248f7a6672053ae35c962'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:48.783065 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1119/2241] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:07:48 2021] DELETE /identity/v3/users/b53dbc10407248f7a6672053ae35c962 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:48.785230 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dede00-3911-49b9-b070-d1ee9d4ab0d4 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:48.785703 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dede00-3911-49b9-b070-d1ee9d4ab0d4 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:48.786314 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dede00-3911-49b9-b070-d1ee9d4ab0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:48.829479 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-38dede00-3911-49b9-b070-d1ee9d4ab0d4 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:48.830556 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-38dede00-3911-49b9-b070-d1ee9d4ab0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:48.903953 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1123/2242] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:48.914878 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0e6d1-6e4f-4375-b219-1f6b90b1a47a admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:48.916433 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-d2d0e6d1-6e4f-4375-b219-1f6b90b1a47a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:49.095746 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0e6d1-6e4f-4375-b219-1f6b90b1a47a admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:49.099633 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b994b4-a934-425d-abce-1da35c4bd6a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:49.100296 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b994b4-a934-425d-abce-1da35c4bd6a4 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:49.100648 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b994b4-a934-425d-abce-1da35c4bd6a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:49.100995 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b994b4-a934-425d-abce-1da35c4bd6a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:49.112368 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b994b4-a934-425d-abce-1da35c4bd6a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:49.141351 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b994b4-a934-425d-abce-1da35c4bd6a4 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:49.153261 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1120/2243] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:07:48 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:07:49.899874 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dede00-3911-49b9-b070-d1ee9d4ab0d4 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:49.901947 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-38dede00-3911-49b9-b070-d1ee9d4ab0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:49.916508 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dede00-3911-49b9-b070-d1ee9d4ab0d4 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:49.923357 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b86cc2-fdcb-404f-938d-609846f51ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:49.924586 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b86cc2-fdcb-404f-938d-609846f51ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:49.925100 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b86cc2-fdcb-404f-938d-609846f51ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:49.925586 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b86cc2-fdcb-404f-938d-609846f51ecc admin admin] PATH_INFO: `/v3/projects/2413768f07b24643aabbc266db7072a5` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:49.926973 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b86cc2-fdcb-404f-938d-609846f51ecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2413768f07b24643aabbc266db7072a5)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:49.956823 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b86cc2-fdcb-404f-938d-609846f51ecc admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:50.017273 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b9b86cc2-fdcb-404f-938d-609846f51ecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2413768f07b24643aabbc266db7072a5', 'request_id': 'req-b9b86cc2-fdcb-404f-938d-609846f51ecc'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:50.022355 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b9b86cc2-fdcb-404f-938d-609846f51ecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2413768f07b24643aabbc266db7072a5', 'request_id': 'req-b9b86cc2-fdcb-404f-938d-609846f51ecc'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:50.034449 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b9b86cc2-fdcb-404f-938d-609846f51ecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2413768f07b24643aabbc266db7072a5', 'request_id': 'req-b9b86cc2-fdcb-404f-938d-609846f51ecc'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:50.050065 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b9b86cc2-fdcb-404f-938d-609846f51ecc admin admin] The token cache is being invalidate because project 2413768f07b24643aabbc266db7072a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:07:50.050616 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b9b86cc2-fdcb-404f-938d-609846f51ecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:50.051395 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b9b86cc2-fdcb-404f-938d-609846f51ecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:50.053043 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1124/2244] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:07:49 2021] DELETE /identity/v3/projects/2413768f07b24643aabbc266db7072a5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:50.060617 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e2cb2-9edb-4cfb-9ffe-dba2fea6db69 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:50.061746 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e2cb2-9edb-4cfb-9ffe-dba2fea6db69 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:50.062035 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e2cb2-9edb-4cfb-9ffe-dba2fea6db69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:50.121687 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-070e2cb2-9edb-4cfb-9ffe-dba2fea6db69 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:50.122807 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-070e2cb2-9edb-4cfb-9ffe-dba2fea6db69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:50.209540 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1121/2245] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:50.217559 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aba5b9-dd62-4a4c-8882-c5457f1da74e None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:50.217858 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aba5b9-dd62-4a4c-8882-c5457f1da74e None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:50.218143 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aba5b9-dd62-4a4c-8882-c5457f1da74e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:50.329403 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-24aba5b9-dd62-4a4c-8882-c5457f1da74e None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:50.330551 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-24aba5b9-dd62-4a4c-8882-c5457f1da74e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:50.339477 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1125/2246] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:07:50.343144 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e2cb2-9edb-4cfb-9ffe-dba2fea6db69 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:50.355063 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e2cb2-9edb-4cfb-9ffe-dba2fea6db69 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:50.360402 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff03d3e-c3c8-47bb-8c3c-dacc3b64a1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:50.361274 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff03d3e-c3c8-47bb-8c3c-dacc3b64a1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:50.361769 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff03d3e-c3c8-47bb-8c3c-dacc3b64a1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:50.362273 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff03d3e-c3c8-47bb-8c3c-dacc3b64a1d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:50.363223 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff03d3e-c3c8-47bb-8c3c-dacc3b64a1d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:07:50.363806 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff03d3e-c3c8-47bb-8c3c-dacc3b64a1d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:50.392711 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff03d3e-c3c8-47bb-8c3c-dacc3b64a1d3 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:50.407627 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1122/2247] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:07:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:07:50.411987 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aba5b9-dd62-4a4c-8882-c5457f1da74e None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:50.420909 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aba5b9-dd62-4a4c-8882-c5457f1da74e None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:50.426420 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed07f63-9868-4b85-a89d-5b711a781d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:50.427300 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed07f63-9868-4b85-a89d-5b711a781d3d admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:50.427736 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed07f63-9868-4b85-a89d-5b711a781d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:50.428077 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed07f63-9868-4b85-a89d-5b711a781d3d admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:50.428773 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed07f63-9868-4b85-a89d-5b711a781d3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:50.455480 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed07f63-9868-4b85-a89d-5b711a781d3d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:50.493696 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1126/2248] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:07:50 2021] POST /identity/v3/projects => generated 397 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:07:50.498356 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff03d3e-c3c8-47bb-8c3c-dacc3b64a1d3 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:50.519760 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff03d3e-c3c8-47bb-8c3c-dacc3b64a1d3 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:50.547209 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed07f63-9868-4b85-a89d-5b711a781d3d admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:50.548913 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-eed07f63-9868-4b85-a89d-5b711a781d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:50.616984 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f04a10-4a4c-4540-814d-709efaedb977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:50.617752 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f04a10-4a4c-4540-814d-709efaedb977 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:50.617964 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f04a10-4a4c-4540-814d-709efaedb977 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:50.618209 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f04a10-4a4c-4540-814d-709efaedb977 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:50.618893 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f04a10-4a4c-4540-814d-709efaedb977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:50.639259 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed07f63-9868-4b85-a89d-5b711a781d3d admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:50.644037 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd59cf6-99a7-4af5-81fc-159ffe99ec2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:50.644516 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd59cf6-99a7-4af5-81fc-159ffe99ec2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:50.644805 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd59cf6-99a7-4af5-81fc-159ffe99ec2b admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:50.645091 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd59cf6-99a7-4af5-81fc-159ffe99ec2b admin admin] PATH_INFO: `/v3/users/7c6578de087b4b4eb75da0aa3f7bc974` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:50.645579 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f04a10-4a4c-4540-814d-709efaedb977 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:50.646221 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd59cf6-99a7-4af5-81fc-159ffe99ec2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c6578de087b4b4eb75da0aa3f7bc974)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:50.667265 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1123/2249] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:07:50 2021] POST /identity/v3/users => generated 299 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:07:50.671070 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f04a10-4a4c-4540-814d-709efaedb977 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:50.674054 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd59cf6-99a7-4af5-81fc-159ffe99ec2b admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:50.680634 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f04a10-4a4c-4540-814d-709efaedb977 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:50.685299 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fae7e2-8119-4960-9d0c-b773eea012c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:50.685897 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fae7e2-8119-4960-9d0c-b773eea012c6 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:50.686186 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fae7e2-8119-4960-9d0c-b773eea012c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:50.686471 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fae7e2-8119-4960-9d0c-b773eea012c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:50.687553 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fae7e2-8119-4960-9d0c-b773eea012c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:50.715037 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fae7e2-8119-4960-9d0c-b773eea012c6 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:50.729470 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1124/2250] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:07:50 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:07:50.730579 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fae7e2-8119-4960-9d0c-b773eea012c6 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:50.731912 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-3cd59cf6-99a7-4af5-81fc-159ffe99ec2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c6578de087b4b4eb75da0aa3f7bc974'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:50.732570 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-3cd59cf6-99a7-4af5-81fc-159ffe99ec2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c6578de087b4b4eb75da0aa3f7bc974'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:50.740396 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fae7e2-8119-4960-9d0c-b773eea012c6 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:50.745253 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-3cd59cf6-99a7-4af5-81fc-159ffe99ec2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c6578de087b4b4eb75da0aa3f7bc974'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:50.746904 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63228aa6-32c6-4699-b23b-d0921e47756a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:50.747754 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63228aa6-32c6-4699-b23b-d0921e47756a admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:50.748041 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63228aa6-32c6-4699-b23b-d0921e47756a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:50.748320 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63228aa6-32c6-4699-b23b-d0921e47756a admin admin] PATH_INFO: `/v3/projects/ed0bfb06924941d6bf79762e1451029e/users/956957769a5e4aad89f440d0f717793f/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:50.753595 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-3cd59cf6-99a7-4af5-81fc-159ffe99ec2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c6578de087b4b4eb75da0aa3f7bc974'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:50.762022 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-3cd59cf6-99a7-4af5-81fc-159ffe99ec2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c6578de087b4b4eb75da0aa3f7bc974'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:50.768020 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1127/2251] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:07:50 2021] DELETE /identity/v3/users/7c6578de087b4b4eb75da0aa3f7bc974 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:07:50.772420 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44e046-cc89-42b9-ab86-28ffb0d75953 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:50.772563 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63228aa6-32c6-4699-b23b-d0921e47756a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed0bfb06924941d6bf79762e1451029e, user_id=956957769a5e4aad89f440d0f717793f, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:50.772716 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44e046-cc89-42b9-ab86-28ffb0d75953 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:50.773002 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac44e046-cc89-42b9-ab86-28ffb0d75953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:50.794945 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-ac44e046-cc89-42b9-ab86-28ffb0d75953 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:50.796122 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-ac44e046-cc89-42b9-ab86-28ffb0d75953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:50.799206 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63228aa6-32c6-4699-b23b-d0921e47756a admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:50.813891 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1125/2252] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:07:50 2021] PUT /identity/v3/projects/ed0bfb06924941d6bf79762e1451029e/users/956957769a5e4aad89f440d0f717793f/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:07:50.824608 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e230023-12e9-49f5-b201-dec6ca2f7398 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:50.824901 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e230023-12e9-49f5-b201-dec6ca2f7398 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:50.825194 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e230023-12e9-49f5-b201-dec6ca2f7398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:50.862688 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-1e230023-12e9-49f5-b201-dec6ca2f7398 None None] MFA Rules not processed for user `956957769a5e4aad89f440d0f717793f`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:50.863894 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-1e230023-12e9-49f5-b201-dec6ca2f7398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:50.872524 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1128/2253] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:07:50.884834 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44e046-cc89-42b9-ab86-28ffb0d75953 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:50.886139 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-ac44e046-cc89-42b9-ab86-28ffb0d75953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:50.946915 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1126/2254] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:50 2021] POST /identity/v3/auth/tokens => generated 3704 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:07:50.952174 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac44e046-cc89-42b9-ab86-28ffb0d75953 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:50.959203 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e230023-12e9-49f5-b201-dec6ca2f7398 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:50.960710 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-1e230023-12e9-49f5-b201-dec6ca2f7398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:51.014937 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f96d2d-769e-4103-9cd9-e563d7c9ebae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:51.015565 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f96d2d-769e-4103-9cd9-e563d7c9ebae service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:51.015857 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f96d2d-769e-4103-9cd9-e563d7c9ebae service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:51.016139 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f96d2d-769e-4103-9cd9-e563d7c9ebae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:51.033858 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e230023-12e9-49f5-b201-dec6ca2f7398 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:51.037358 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c4af4-154d-4d9b-992a-dfb07f358d1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:51.037948 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c4af4-154d-4d9b-992a-dfb07f358d1d service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:51.038234 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c4af4-154d-4d9b-992a-dfb07f358d1d service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:51.038513 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883c4af4-154d-4d9b-992a-dfb07f358d1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:51.049536 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883c4af4-154d-4d9b-992a-dfb07f358d1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:51.075910 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883c4af4-154d-4d9b-992a-dfb07f358d1d service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:51.087105 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1127/2255] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:07:50 2021] GET /identity/v3/auth/tokens => generated 3704 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:07:51.096870 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f96d2d-769e-4103-9cd9-e563d7c9ebae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:51.123103 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f96d2d-769e-4103-9cd9-e563d7c9ebae service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:51.134005 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1129/2256] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:07:50 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:07:51.713046 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c4af4-154d-4d9b-992a-dfb07f358d1d service cinder] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:51.714618 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-883c4af4-154d-4d9b-992a-dfb07f358d1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:51.728426 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883c4af4-154d-4d9b-992a-dfb07f358d1d service cinder] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:51.733146 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780fe56a-14bc-41ab-90cc-07475c4075fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:51.734039 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fe56a-14bc-41ab-90cc-07475c4075fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:51.734228 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fe56a-14bc-41ab-90cc-07475c4075fe admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:51.734535 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780fe56a-14bc-41ab-90cc-07475c4075fe admin admin] PATH_INFO: `/v3/projects/191c3f8e83074cc4abd2f23a9152a908` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:51.735820 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780fe56a-14bc-41ab-90cc-07475c4075fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=191c3f8e83074cc4abd2f23a9152a908)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:51.764619 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780fe56a-14bc-41ab-90cc-07475c4075fe admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:51.892897 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-780fe56a-14bc-41ab-90cc-07475c4075fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '191c3f8e83074cc4abd2f23a9152a908', 'request_id': 'req-780fe56a-14bc-41ab-90cc-07475c4075fe'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:51.898746 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-780fe56a-14bc-41ab-90cc-07475c4075fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '191c3f8e83074cc4abd2f23a9152a908', 'request_id': 'req-780fe56a-14bc-41ab-90cc-07475c4075fe'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:51.923947 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-780fe56a-14bc-41ab-90cc-07475c4075fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '191c3f8e83074cc4abd2f23a9152a908', 'request_id': 'req-780fe56a-14bc-41ab-90cc-07475c4075fe'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:51.950771 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-780fe56a-14bc-41ab-90cc-07475c4075fe admin admin] The token cache is being invalidate because project 191c3f8e83074cc4abd2f23a9152a908 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:07:51.951066 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-780fe56a-14bc-41ab-90cc-07475c4075fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:51.951719 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-780fe56a-14bc-41ab-90cc-07475c4075fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:51.956230 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1128/2257] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:07:51 2021] DELETE /identity/v3/projects/191c3f8e83074cc4abd2f23a9152a908 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:51.961802 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a548615-e7a7-4d33-b0a8-f80017376088 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:51.962253 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a548615-e7a7-4d33-b0a8-f80017376088 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:51.962394 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a548615-e7a7-4d33-b0a8-f80017376088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:51.989475 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-0a548615-e7a7-4d33-b0a8-f80017376088 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:51.990925 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-0a548615-e7a7-4d33-b0a8-f80017376088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:52.069357 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1130/2258] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:51 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:52.083118 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e464f32-7048-403e-bf46-0f3b32368a5d None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:52.083653 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e464f32-7048-403e-bf46-0f3b32368a5d None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:52.083760 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e464f32-7048-403e-bf46-0f3b32368a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:52.114606 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-8e464f32-7048-403e-bf46-0f3b32368a5d None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:52.115916 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-8e464f32-7048-403e-bf46-0f3b32368a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:52.124042 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1129/2259] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:52 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:52.128346 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a548615-e7a7-4d33-b0a8-f80017376088 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:52.138449 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a548615-e7a7-4d33-b0a8-f80017376088 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:52.145506 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f389df-4fd9-496e-8870-a21950438051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:52.146590 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f389df-4fd9-496e-8870-a21950438051 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:52.147288 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f389df-4fd9-496e-8870-a21950438051 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:52.147799 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f389df-4fd9-496e-8870-a21950438051 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:52.149469 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f389df-4fd9-496e-8870-a21950438051 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:07:52.150040 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f389df-4fd9-496e-8870-a21950438051 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:52.186430 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f389df-4fd9-496e-8870-a21950438051 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:52.200299 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1131/2260] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:07:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 15:07:52.204754 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e464f32-7048-403e-bf46-0f3b32368a5d None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:52.217517 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e464f32-7048-403e-bf46-0f3b32368a5d None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:52.222288 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e95998-3ddd-4f94-98cb-ab9e717ebe4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:52.222893 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e95998-3ddd-4f94-98cb-ab9e717ebe4e admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:52.223181 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e95998-3ddd-4f94-98cb-ab9e717ebe4e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:52.223492 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e95998-3ddd-4f94-98cb-ab9e717ebe4e admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:52.224140 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e95998-3ddd-4f94-98cb-ab9e717ebe4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:52.254011 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e95998-3ddd-4f94-98cb-ab9e717ebe4e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:52.297247 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1130/2261] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:07:52 2021] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:07:52.302784 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f389df-4fd9-496e-8870-a21950438051 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:52.314108 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f389df-4fd9-496e-8870-a21950438051 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:52.403105 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba78e9-edf6-4846-8ca2-1ef3699e2679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:52.403951 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba78e9-edf6-4846-8ca2-1ef3699e2679 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:52.404244 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba78e9-edf6-4846-8ca2-1ef3699e2679 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:52.404960 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba78e9-edf6-4846-8ca2-1ef3699e2679 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:52.405938 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba78e9-edf6-4846-8ca2-1ef3699e2679 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:52.416398 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e95998-3ddd-4f94-98cb-ab9e717ebe4e admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:52.418121 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-59e95998-3ddd-4f94-98cb-ab9e717ebe4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:52.432945 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e95998-3ddd-4f94-98cb-ab9e717ebe4e admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:52.436364 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba78e9-edf6-4846-8ca2-1ef3699e2679 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:52.438345 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1176bb-6c07-4343-b12e-796b43632628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:52.439508 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1176bb-6c07-4343-b12e-796b43632628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:52.440091 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1176bb-6c07-4343-b12e-796b43632628 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:52.440534 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1176bb-6c07-4343-b12e-796b43632628 admin admin] PATH_INFO: `/v3/users/7d8c4d0c72ec4462861537f609feadfe` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:52.441950 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1176bb-6c07-4343-b12e-796b43632628 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d8c4d0c72ec4462861537f609feadfe)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:52.464111 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1132/2262] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:07:52 2021] POST /identity/v3/users => generated 290 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:07:52.468390 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba78e9-edf6-4846-8ca2-1ef3699e2679 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:52.472807 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1176bb-6c07-4343-b12e-796b43632628 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:52.480368 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba78e9-edf6-4846-8ca2-1ef3699e2679 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:52.485271 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435cac9-b83f-4015-8123-fe437e59ea80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:52.486090 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435cac9-b83f-4015-8123-fe437e59ea80 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:52.486541 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435cac9-b83f-4015-8123-fe437e59ea80 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:52.486976 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435cac9-b83f-4015-8123-fe437e59ea80 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:52.487871 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435cac9-b83f-4015-8123-fe437e59ea80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:52.516429 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435cac9-b83f-4015-8123-fe437e59ea80 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:52.525375 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-6d1176bb-6c07-4343-b12e-796b43632628 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d8c4d0c72ec4462861537f609feadfe'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:52.531125 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1133/2263] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:07:52 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:07:52.532162 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435cac9-b83f-4015-8123-fe437e59ea80 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:52.540846 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-6d1176bb-6c07-4343-b12e-796b43632628 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d8c4d0c72ec4462861537f609feadfe'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:52.541926 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-6d1176bb-6c07-4343-b12e-796b43632628 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d8c4d0c72ec4462861537f609feadfe'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:52.544921 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435cac9-b83f-4015-8123-fe437e59ea80 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:52.552564 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-6d1176bb-6c07-4343-b12e-796b43632628 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d8c4d0c72ec4462861537f609feadfe'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:52.559746 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750038e8-499b-49b9-9eff-e9834ad4893b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:52.560580 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750038e8-499b-49b9-9eff-e9834ad4893b admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:52.560867 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750038e8-499b-49b9-9eff-e9834ad4893b admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:52.561156 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750038e8-499b-49b9-9eff-e9834ad4893b admin admin] PATH_INFO: `/v3/projects/ff7a0fe5498d457f807696add8104865/users/06547e0ae25e422c90cc2473f9cabfa4/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:52.563079 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-6d1176bb-6c07-4343-b12e-796b43632628 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d8c4d0c72ec4462861537f609feadfe'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:52.569327 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1131/2264] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:07:52 2021] DELETE /identity/v3/users/7d8c4d0c72ec4462861537f609feadfe => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:07:52.576964 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960a944-7a0d-4d23-a06f-04f0005c9d77 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:52.577260 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960a944-7a0d-4d23-a06f-04f0005c9d77 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:52.577557 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960a944-7a0d-4d23-a06f-04f0005c9d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:52.590276 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750038e8-499b-49b9-9eff-e9834ad4893b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff7a0fe5498d457f807696add8104865, user_id=06547e0ae25e422c90cc2473f9cabfa4, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:52.608538 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-b960a944-7a0d-4d23-a06f-04f0005c9d77 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:52.609983 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-b960a944-7a0d-4d23-a06f-04f0005c9d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:52.618043 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750038e8-499b-49b9-9eff-e9834ad4893b admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:52.638551 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1134/2265] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:07:52 2021] PUT /identity/v3/projects/ff7a0fe5498d457f807696add8104865/users/06547e0ae25e422c90cc2473f9cabfa4/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:07:52.644558 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff4c6a-4266-47dd-949c-b4c008426779 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:52.644962 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff4c6a-4266-47dd-949c-b4c008426779 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:52.645320 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff4c6a-4266-47dd-949c-b4c008426779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:52.672528 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-3aff4c6a-4266-47dd-949c-b4c008426779 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:52.673858 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-3aff4c6a-4266-47dd-949c-b4c008426779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:52.695337 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1132/2266] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:52 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:52.705616 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960a944-7a0d-4d23-a06f-04f0005c9d77 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:52.707043 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-b960a944-7a0d-4d23-a06f-04f0005c9d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:52.749241 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1135/2267] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:52 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:52.759895 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff4c6a-4266-47dd-949c-b4c008426779 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:52.761150 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-3aff4c6a-4266-47dd-949c-b4c008426779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:52.781103 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960a944-7a0d-4d23-a06f-04f0005c9d77 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:52.833068 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff4c6a-4266-47dd-949c-b4c008426779 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:52.836583 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01d853-a4b6-470c-9916-ffd3cdfb8119 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:52.837242 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01d853-a4b6-470c-9916-ffd3cdfb8119 service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:52.837531 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01d853-a4b6-470c-9916-ffd3cdfb8119 service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:52.837810 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01d853-a4b6-470c-9916-ffd3cdfb8119 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:52.843975 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbdc520-3e74-43cc-a93f-8e795d4aa61a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:52.844566 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdc520-3e74-43cc-a93f-8e795d4aa61a service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:52.844857 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdc520-3e74-43cc-a93f-8e795d4aa61a service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:52.845142 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdc520-3e74-43cc-a93f-8e795d4aa61a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:52.846849 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01d853-a4b6-470c-9916-ffd3cdfb8119 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:52.854606 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbdc520-3e74-43cc-a93f-8e795d4aa61a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:52.872669 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01d853-a4b6-470c-9916-ffd3cdfb8119 service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:52.880371 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbdc520-3e74-43cc-a93f-8e795d4aa61a service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:52.882836 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1136/2268] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:07:52 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:07:52.891645 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1133/2269] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:07:52 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:07:53.907612 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01d853-a4b6-470c-9916-ffd3cdfb8119 service neutron] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:53.909862 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-0e01d853-a4b6-470c-9916-ffd3cdfb8119 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:53.926896 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01d853-a4b6-470c-9916-ffd3cdfb8119 service neutron] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:53.932760 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e52509-0437-4079-a5c8-7c24c6197032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:53.933855 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e52509-0437-4079-a5c8-7c24c6197032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:53.934331 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e52509-0437-4079-a5c8-7c24c6197032 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:53.934794 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e52509-0437-4079-a5c8-7c24c6197032 admin admin] PATH_INFO: `/v3/projects/23dda4ab036e4f8998d01e62729f24b5` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:53.937036 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e52509-0437-4079-a5c8-7c24c6197032 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23dda4ab036e4f8998d01e62729f24b5)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:53.970287 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e52509-0437-4079-a5c8-7c24c6197032 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:54.045517 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-15e52509-0437-4079-a5c8-7c24c6197032 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23dda4ab036e4f8998d01e62729f24b5', 'request_id': 'req-15e52509-0437-4079-a5c8-7c24c6197032'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:54.050412 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-15e52509-0437-4079-a5c8-7c24c6197032 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23dda4ab036e4f8998d01e62729f24b5', 'request_id': 'req-15e52509-0437-4079-a5c8-7c24c6197032'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:54.061529 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-15e52509-0437-4079-a5c8-7c24c6197032 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23dda4ab036e4f8998d01e62729f24b5', 'request_id': 'req-15e52509-0437-4079-a5c8-7c24c6197032'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:54.075285 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-15e52509-0437-4079-a5c8-7c24c6197032 admin admin] The token cache is being invalidate because project 23dda4ab036e4f8998d01e62729f24b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:07:54.075620 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-15e52509-0437-4079-a5c8-7c24c6197032 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:54.076219 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-15e52509-0437-4079-a5c8-7c24c6197032 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:07:54.077640 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1137/2270] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:07:53 2021] DELETE /identity/v3/projects/23dda4ab036e4f8998d01e62729f24b5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:07:54.083575 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5aeb5-8b5f-4f7e-adef-7b715f2ea80c None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:54.084074 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5aeb5-8b5f-4f7e-adef-7b715f2ea80c None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:54.084166 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5aeb5-8b5f-4f7e-adef-7b715f2ea80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:54.107028 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-2eb5aeb5-8b5f-4f7e-adef-7b715f2ea80c None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:54.108225 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-2eb5aeb5-8b5f-4f7e-adef-7b715f2ea80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:54.174593 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1134/2271] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:07:54.182899 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0485cd4-b152-4109-9772-0e8e03c07fa7 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:54.183198 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0485cd4-b152-4109-9772-0e8e03c07fa7 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:54.183514 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0485cd4-b152-4109-9772-0e8e03c07fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:54.206185 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-d0485cd4-b152-4109-9772-0e8e03c07fa7 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:54.207336 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-d0485cd4-b152-4109-9772-0e8e03c07fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:54.215097 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1138/2272] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:07:54.219468 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5aeb5-8b5f-4f7e-adef-7b715f2ea80c None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:54.228747 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5aeb5-8b5f-4f7e-adef-7b715f2ea80c None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:54.232919 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e57028-bcf3-459b-84a9-53eb4fb3c26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:54.233517 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e57028-bcf3-459b-84a9-53eb4fb3c26e admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:54.233807 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e57028-bcf3-459b-84a9-53eb4fb3c26e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:54.234090 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e57028-bcf3-459b-84a9-53eb4fb3c26e admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:54.234782 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e57028-bcf3-459b-84a9-53eb4fb3c26e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:07:54.235079 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e57028-bcf3-459b-84a9-53eb4fb3c26e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:54.263324 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e57028-bcf3-459b-84a9-53eb4fb3c26e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:54.306790 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1135/2273] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:07:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:07:54.311585 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e57028-bcf3-459b-84a9-53eb4fb3c26e admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:54.312028 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd559c5e-145a-4d75-b336-1b50037d7c18 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:54.312395 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd559c5e-145a-4d75-b336-1b50037d7c18 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:54.312855 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd559c5e-145a-4d75-b336-1b50037d7c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:54.322512 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e57028-bcf3-459b-84a9-53eb4fb3c26e admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:54.328221 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f464d9-c9fb-4d2d-87cd-28134567fcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:54.329048 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f464d9-c9fb-4d2d-87cd-28134567fcf2 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:54.329522 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f464d9-c9fb-4d2d-87cd-28134567fcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:54.329954 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f464d9-c9fb-4d2d-87cd-28134567fcf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:54.330739 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f464d9-c9fb-4d2d-87cd-28134567fcf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:54.353186 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-fd559c5e-145a-4d75-b336-1b50037d7c18 None None] MFA Rules not processed for user `06547e0ae25e422c90cc2473f9cabfa4`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:54.354614 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-fd559c5e-145a-4d75-b336-1b50037d7c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:54.357771 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f464d9-c9fb-4d2d-87cd-28134567fcf2 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:54.385905 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1136/2274] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:07:54 2021] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:07:54.389955 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f464d9-c9fb-4d2d-87cd-28134567fcf2 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:54.434590 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1139/2275] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:54 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:54.445669 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd559c5e-145a-4d75-b336-1b50037d7c18 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:54.447038 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-fd559c5e-145a-4d75-b336-1b50037d7c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:54.474364 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f464d9-c9fb-4d2d-87cd-28134567fcf2 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:54.478944 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b47ec-72f8-41a3-b050-18735598a409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:54.479636 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b47ec-72f8-41a3-b050-18735598a409 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:54.479927 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b47ec-72f8-41a3-b050-18735598a409 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:54.480210 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b47ec-72f8-41a3-b050-18735598a409 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:54.480852 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b47ec-72f8-41a3-b050-18735598a409 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:54.515063 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b47ec-72f8-41a3-b050-18735598a409 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:54.519695 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd559c5e-145a-4d75-b336-1b50037d7c18 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:54.541434 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1137/2276] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:07:54 2021] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:07:54.546552 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b47ec-72f8-41a3-b050-18735598a409 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:54.561364 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b47ec-72f8-41a3-b050-18735598a409 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:54.566272 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98454b59-6ed2-4e83-84c9-7e1b3c9a78a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:54.567035 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98454b59-6ed2-4e83-84c9-7e1b3c9a78a9 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:54.568301 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98454b59-6ed2-4e83-84c9-7e1b3c9a78a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:54.568746 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98454b59-6ed2-4e83-84c9-7e1b3c9a78a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:54.569597 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98454b59-6ed2-4e83-84c9-7e1b3c9a78a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:54.584796 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119bc774-104b-41c6-a755-e43121e18e30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:54.585382 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bc774-104b-41c6-a755-e43121e18e30 service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:54.585698 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bc774-104b-41c6-a755-e43121e18e30 service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:54.585978 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119bc774-104b-41c6-a755-e43121e18e30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:54.599252 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98454b59-6ed2-4e83-84c9-7e1b3c9a78a9 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:54.612314 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1138/2277] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:07:54 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:07:54.616174 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98454b59-6ed2-4e83-84c9-7e1b3c9a78a9 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:54.626196 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98454b59-6ed2-4e83-84c9-7e1b3c9a78a9 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:54.630535 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa4060-3cc1-4604-8ac8-646ae67b3317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:54.631339 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa4060-3cc1-4604-8ac8-646ae67b3317 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:54.631663 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa4060-3cc1-4604-8ac8-646ae67b3317 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:54.631945 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa4060-3cc1-4604-8ac8-646ae67b3317 admin admin] PATH_INFO: `/v3/projects/0ef0fcc833424463b242c242eeeaebf1/users/cfd38937e0504a11bb1c9e5418047f23/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:54.652654 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa4060-3cc1-4604-8ac8-646ae67b3317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ef0fcc833424463b242c242eeeaebf1, user_id=cfd38937e0504a11bb1c9e5418047f23, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:54.656138 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bc774-104b-41c6-a755-e43121e18e30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:54.681667 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119bc774-104b-41c6-a755-e43121e18e30 service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:54.683161 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa4060-3cc1-4604-8ac8-646ae67b3317 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:54.692130 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1140/2278] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:07:54 2021] GET /identity/v3/auth/tokens => generated 3686 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:07:54.717141 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1139/2279] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:07:54 2021] PUT /identity/v3/projects/0ef0fcc833424463b242c242eeeaebf1/users/cfd38937e0504a11bb1c9e5418047f23/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:07:54.722919 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f842e6-a1df-4c15-8869-bf890729d06e None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:54.723283 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f842e6-a1df-4c15-8869-bf890729d06e None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:54.723656 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f842e6-a1df-4c15-8869-bf890729d06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:54.752558 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-b1f842e6-a1df-4c15-8869-bf890729d06e None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:54.753594 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-b1f842e6-a1df-4c15-8869-bf890729d06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:54.832517 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1141/2280] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:54 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:07:54.843005 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa4060-3cc1-4604-8ac8-646ae67b3317 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:07:54.845597 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-7baa4060-3cc1-4604-8ac8-646ae67b3317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:54.924550 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa4060-3cc1-4604-8ac8-646ae67b3317 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:07:54.931255 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535ae96-b96a-4fb0-acb1-21977bbc2502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:07:54.932528 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535ae96-b96a-4fb0-acb1-21977bbc2502 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:54.933120 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535ae96-b96a-4fb0-acb1-21977bbc2502 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:54.933422 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535ae96-b96a-4fb0-acb1-21977bbc2502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:54.945971 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535ae96-b96a-4fb0-acb1-21977bbc2502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:07:54.975859 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535ae96-b96a-4fb0-acb1-21977bbc2502 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:07:54.986914 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1140/2281] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:07:54 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:07:57.511854 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a973ec-82b3-4456-867b-d70e9959297b None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:07:57.512308 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a973ec-82b3-4456-867b-d70e9959297b None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:07:57.512493 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a973ec-82b3-4456-867b-d70e9959297b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:07:57.544605 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-d9a973ec-82b3-4456-867b-d70e9959297b None None] MFA Rules not processed for user `06547e0ae25e422c90cc2473f9cabfa4`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:07:57.546241 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-d9a973ec-82b3-4456-867b-d70e9959297b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:07:57.618474 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1142/2282] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:07:57 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:08:00.797237 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535ae96-b96a-4fb0-acb1-21977bbc2502 service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:08:00.799939 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-a535ae96-b96a-4fb0-acb1-21977bbc2502 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:08:00.849995 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535ae96-b96a-4fb0-acb1-21977bbc2502 service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:08:00.874454 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f689b-823c-4c61-9070-89a84cd865bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:08:00.875327 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f689b-823c-4c61-9070-89a84cd865bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:00.875641 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f689b-823c-4c61-9070-89a84cd865bc admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:00.875948 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508f689b-823c-4c61-9070-89a84cd865bc admin admin] PATH_INFO: `/v3/users/956957769a5e4aad89f440d0f717793f` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:00.877217 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f689b-823c-4c61-9070-89a84cd865bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=956957769a5e4aad89f440d0f717793f)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:08:00.920238 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508f689b-823c-4c61-9070-89a84cd865bc admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:08:01.055594 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-508f689b-823c-4c61-9070-89a84cd865bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '956957769a5e4aad89f440d0f717793f'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:08:01.077912 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-508f689b-823c-4c61-9070-89a84cd865bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '956957769a5e4aad89f440d0f717793f'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:08:01.080578 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-508f689b-823c-4c61-9070-89a84cd865bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '956957769a5e4aad89f440d0f717793f'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:08:01.110487 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-508f689b-823c-4c61-9070-89a84cd865bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '956957769a5e4aad89f440d0f717793f'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:08:01.136794 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-508f689b-823c-4c61-9070-89a84cd865bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '956957769a5e4aad89f440d0f717793f'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:08:01.157745 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1141/2283] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:08:00 2021] DELETE /identity/v3/users/956957769a5e4aad89f440d0f717793f => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:08:01.159302 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf9c4f-33c1-4f7d-8a7d-3d56276e63cb None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:01.159831 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf9c4f-33c1-4f7d-8a7d-3d56276e63cb None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:01.159940 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf9c4f-33c1-4f7d-8a7d-3d56276e63cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:01.221187 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-4ddf9c4f-33c1-4f7d-8a7d-3d56276e63cb None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:08:01.233046 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-4ddf9c4f-33c1-4f7d-8a7d-3d56276e63cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:08:01.431209 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1143/2284] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:08:01 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:08:01.468538 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f689b-823c-4c61-9070-89a84cd865bc admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:08:01.470379 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-508f689b-823c-4c61-9070-89a84cd865bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:08:01.564327 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508f689b-823c-4c61-9070-89a84cd865bc admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:08:01.570532 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513fa2d6-b291-44c6-bb75-27389a2d85d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:08:01.571845 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fa2d6-b291-44c6-bb75-27389a2d85d5 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:01.572334 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fa2d6-b291-44c6-bb75-27389a2d85d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:01.572791 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513fa2d6-b291-44c6-bb75-27389a2d85d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:01.584097 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513fa2d6-b291-44c6-bb75-27389a2d85d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:08:01.612621 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513fa2d6-b291-44c6-bb75-27389a2d85d5 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:08:01.625627 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1142/2285] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:08:01 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:08:02.866660 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf9c4f-33c1-4f7d-8a7d-3d56276e63cb None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:08:02.869746 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-4ddf9c4f-33c1-4f7d-8a7d-3d56276e63cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:08:02.917153 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf9c4f-33c1-4f7d-8a7d-3d56276e63cb None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:08:02.924422 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216ea16-4969-4f0b-a0a8-17b51a8947b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:08:02.925926 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216ea16-4969-4f0b-a0a8-17b51a8947b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:02.926415 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216ea16-4969-4f0b-a0a8-17b51a8947b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:02.926691 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216ea16-4969-4f0b-a0a8-17b51a8947b8 admin admin] PATH_INFO: `/v3/projects/ed0bfb06924941d6bf79762e1451029e` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:02.928113 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216ea16-4969-4f0b-a0a8-17b51a8947b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed0bfb06924941d6bf79762e1451029e)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:08:02.962583 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f51577-346d-4a13-9673-37e3fe3fe3cb None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:02.963163 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f51577-346d-4a13-9673-37e3fe3fe3cb None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:02.963351 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f51577-346d-4a13-9673-37e3fe3fe3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:02.964884 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216ea16-4969-4f0b-a0a8-17b51a8947b8 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:08:03.009479 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-15f51577-346d-4a13-9673-37e3fe3fe3cb None None] MFA Rules not processed for user `cfd38937e0504a11bb1c9e5418047f23`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:08:03.030870 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-8216ea16-4969-4f0b-a0a8-17b51a8947b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed0bfb06924941d6bf79762e1451029e', 'request_id': 'req-8216ea16-4969-4f0b-a0a8-17b51a8947b8'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:08:03.036902 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-15f51577-346d-4a13-9673-37e3fe3fe3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:08:03.039114 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-8216ea16-4969-4f0b-a0a8-17b51a8947b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed0bfb06924941d6bf79762e1451029e', 'request_id': 'req-8216ea16-4969-4f0b-a0a8-17b51a8947b8'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:08:03.054786 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-8216ea16-4969-4f0b-a0a8-17b51a8947b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed0bfb06924941d6bf79762e1451029e', 'request_id': 'req-8216ea16-4969-4f0b-a0a8-17b51a8947b8'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:08:03.075664 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-8216ea16-4969-4f0b-a0a8-17b51a8947b8 admin admin] The token cache is being invalidate because project ed0bfb06924941d6bf79762e1451029e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:08:03.076366 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-8216ea16-4969-4f0b-a0a8-17b51a8947b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:08:03.077574 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-8216ea16-4969-4f0b-a0a8-17b51a8947b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:08:03.080267 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1144/2286] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:08:02 2021] DELETE /identity/v3/projects/ed0bfb06924941d6bf79762e1451029e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:08:03.257041 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1143/2287] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:08:02 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:08:03.262437 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216ea16-4969-4f0b-a0a8-17b51a8947b8 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:08:03.265204 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-8216ea16-4969-4f0b-a0a8-17b51a8947b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:08:03.408072 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216ea16-4969-4f0b-a0a8-17b51a8947b8 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:08:03.413118 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2a9c3-fc48-4fc7-9a65-be2e0da28c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:08:03.413837 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2a9c3-fc48-4fc7-9a65-be2e0da28c5e admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:03.414227 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2a9c3-fc48-4fc7-9a65-be2e0da28c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:03.414580 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2a9c3-fc48-4fc7-9a65-be2e0da28c5e admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:03.415346 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2a9c3-fc48-4fc7-9a65-be2e0da28c5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:08:03.448117 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2a9c3-fc48-4fc7-9a65-be2e0da28c5e admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:08:03.485970 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1145/2288] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:08:03 2021] POST /identity/v3/projects => generated 385 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:08:03.490016 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f51577-346d-4a13-9673-37e3fe3fe3cb None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:08:03.505016 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f51577-346d-4a13-9673-37e3fe3fe3cb None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:08:03.651783 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb7708-e569-49e4-a2af-715b8423b5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:08:03.653039 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb7708-e569-49e4-a2af-715b8423b5e4 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:03.654125 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb7708-e569-49e4-a2af-715b8423b5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:03.655603 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb7708-e569-49e4-a2af-715b8423b5e4 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:03.656720 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb7708-e569-49e4-a2af-715b8423b5e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:08:03.688677 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb7708-e569-49e4-a2af-715b8423b5e4 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:08:03.714054 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1144/2289] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:08:03 2021] POST /identity/v3/users => generated 299 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:08:03.715380 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2a9c3-fc48-4fc7-9a65-be2e0da28c5e admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:08:03.725723 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2a9c3-fc48-4fc7-9a65-be2e0da28c5e admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:08:03.730278 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc71f0-bfe3-471b-8971-28a1b00af94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:08:03.730885 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc71f0-bfe3-471b-8971-28a1b00af94e admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:03.731469 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc71f0-bfe3-471b-8971-28a1b00af94e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:03.731777 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc71f0-bfe3-471b-8971-28a1b00af94e admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:03.732469 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc71f0-bfe3-471b-8971-28a1b00af94e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:08:03.758983 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bc71f0-bfe3-471b-8971-28a1b00af94e admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:08:03.775600 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1146/2290] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:08:03 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:08:03.780131 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb7708-e569-49e4-a2af-715b8423b5e4 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:08:03.790921 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb7708-e569-49e4-a2af-715b8423b5e4 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:08:03.796416 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694974e-e60d-4be4-bca9-c26cd379893c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:08:03.797247 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694974e-e60d-4be4-bca9-c26cd379893c admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:03.797538 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694974e-e60d-4be4-bca9-c26cd379893c admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:03.797821 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694974e-e60d-4be4-bca9-c26cd379893c admin admin] PATH_INFO: `/v3/projects/17370a1e14984734adf98f923348836e/users/eda1dc32746a433098fc2ce168aed965/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:03.818267 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694974e-e60d-4be4-bca9-c26cd379893c admin admin] RBAC: Authorizing `identity:create_grant(project_id=17370a1e14984734adf98f923348836e, user_id=eda1dc32746a433098fc2ce168aed965, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:08:03.846104 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e694974e-e60d-4be4-bca9-c26cd379893c admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:08:03.859745 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1145/2291] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:08:03 2021] PUT /identity/v3/projects/17370a1e14984734adf98f923348836e/users/eda1dc32746a433098fc2ce168aed965/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:08:03.863799 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc71f0-bfe3-471b-8971-28a1b00af94e admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:08:03.873636 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc71f0-bfe3-471b-8971-28a1b00af94e admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:08:03.936692 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8f203-b4f0-4b14-a2f0-cf2807f96617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:08:03.937328 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8f203-b4f0-4b14-a2f0-cf2807f96617 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:03.937634 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8f203-b4f0-4b14-a2f0-cf2807f96617 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:03.937898 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8f203-b4f0-4b14-a2f0-cf2807f96617 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:03.938590 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8f203-b4f0-4b14-a2f0-cf2807f96617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:08:03.964817 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8f203-b4f0-4b14-a2f0-cf2807f96617 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:08:03.978173 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1147/2292] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:08:03 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:08:03.979326 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694974e-e60d-4be4-bca9-c26cd379893c admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:08:03.989440 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e694974e-e60d-4be4-bca9-c26cd379893c admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:08:03.993666 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d77b1-5345-4c35-8bdf-e1a441aec547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:08:03.994476 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d77b1-5345-4c35-8bdf-e1a441aec547 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:03.994760 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d77b1-5345-4c35-8bdf-e1a441aec547 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:03.995038 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d77b1-5345-4c35-8bdf-e1a441aec547 admin admin] PATH_INFO: `/v3/projects/17370a1e14984734adf98f923348836e/users/eda1dc32746a433098fc2ce168aed965/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:03.996814 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d77b1-5345-4c35-8bdf-e1a441aec547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17370a1e14984734adf98f923348836e, user_id=eda1dc32746a433098fc2ce168aed965, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:08:04.024017 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d77b1-5345-4c35-8bdf-e1a441aec547 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:08:04.038953 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1146/2293] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:08:03 2021] PUT /identity/v3/projects/17370a1e14984734adf98f923348836e/users/eda1dc32746a433098fc2ce168aed965/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:08:04.039945 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8f203-b4f0-4b14-a2f0-cf2807f96617 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:08:04.049504 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8f203-b4f0-4b14-a2f0-cf2807f96617 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:08:04.121639 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb826f-b431-4592-a413-6b9c5bce42bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:08:04.122579 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb826f-b431-4592-a413-6b9c5bce42bd admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:04.122863 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb826f-b431-4592-a413-6b9c5bce42bd admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:04.123193 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb826f-b431-4592-a413-6b9c5bce42bd admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:04.123950 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb826f-b431-4592-a413-6b9c5bce42bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:08:04.150354 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb826f-b431-4592-a413-6b9c5bce42bd admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:08:04.164291 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1148/2294] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:08:04 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:08:04.165370 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d77b1-5345-4c35-8bdf-e1a441aec547 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:08:04.176569 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d77b1-5345-4c35-8bdf-e1a441aec547 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:08:04.180813 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a00cda-cfe4-4ffe-8fff-3e76d8b2fe60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:08:04.181643 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a00cda-cfe4-4ffe-8fff-3e76d8b2fe60 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:04.181925 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a00cda-cfe4-4ffe-8fff-3e76d8b2fe60 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:04.182199 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a00cda-cfe4-4ffe-8fff-3e76d8b2fe60 admin admin] PATH_INFO: `/v3/projects/17370a1e14984734adf98f923348836e/users/eda1dc32746a433098fc2ce168aed965/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:04.184143 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a00cda-cfe4-4ffe-8fff-3e76d8b2fe60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17370a1e14984734adf98f923348836e, user_id=eda1dc32746a433098fc2ce168aed965, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:08:04.212268 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a00cda-cfe4-4ffe-8fff-3e76d8b2fe60 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:08:04.227396 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1147/2295] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:08:04 2021] PUT /identity/v3/projects/17370a1e14984734adf98f923348836e/users/eda1dc32746a433098fc2ce168aed965/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:08:11.025136 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00077b28-1285-41a8-b9b6-459cb310c071 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:11.025651 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00077b28-1285-41a8-b9b6-459cb310c071 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:11.026559 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00077b28-1285-41a8-b9b6-459cb310c071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:11.074459 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-00077b28-1285-41a8-b9b6-459cb310c071 None None] MFA Rules not processed for user `ed972e6b35be47a8af2e86651ccc6911`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:08:11.077767 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-00077b28-1285-41a8-b9b6-459cb310c071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:08:11.172060 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1149/2296] 10.222.0.89 () {58 vars in 1014 bytes} [Wed Oct 27 15:08:11 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:08:11.225721 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a00cda-cfe4-4ffe-8fff-3e76d8b2fe60 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:08:11.227399 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-07a00cda-cfe4-4ffe-8fff-3e76d8b2fe60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:08:11.406325 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a00cda-cfe4-4ffe-8fff-3e76d8b2fe60 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:08:11.416903 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc34748-04bd-4434-b612-92fcdb6c2a2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffba82bc9ddf42069a813b932bd310ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:08:11.417793 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc34748-04bd-4434-b612-92fcdb6c2a2c service swift] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:11.418084 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc34748-04bd-4434-b612-92fcdb6c2a2c service swift] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:11.418360 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc34748-04bd-4434-b612-92fcdb6c2a2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:11.434541 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc34748-04bd-4434-b612-92fcdb6c2a2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:08:11.462686 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc34748-04bd-4434-b612-92fcdb6c2a2c service swift] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:08:11.474015 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1148/2297] 10.222.0.89 () {60 vars in 1384 bytes} [Wed Oct 27 15:08:11 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 15:08:12.098824 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86441d6-f3b7-475b-b224-5b1c6cf36186 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:12.099297 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86441d6-f3b7-475b-b224-5b1c6cf36186 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:12.099395 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86441d6-f3b7-475b-b224-5b1c6cf36186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:12.149333 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-f86441d6-f3b7-475b-b224-5b1c6cf36186 None None] MFA Rules not processed for user `ed972e6b35be47a8af2e86651ccc6911`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:08:12.153939 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-f86441d6-f3b7-475b-b224-5b1c6cf36186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:08:12.173448 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1150/2298] 10.222.0.89 () {58 vars in 1014 bytes} [Wed Oct 27 15:08:12 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:08:12.187971 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc34748-04bd-4434-b612-92fcdb6c2a2c service swift] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:08:12.200333 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc34748-04bd-4434-b612-92fcdb6c2a2c service swift] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:08:12.205409 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387cc5d-cc2a-4847-8ccf-e4db0e1c899f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffba82bc9ddf42069a813b932bd310ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:08:12.206164 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387cc5d-cc2a-4847-8ccf-e4db0e1c899f service swift] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:12.206453 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387cc5d-cc2a-4847-8ccf-e4db0e1c899f service swift] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:12.206727 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387cc5d-cc2a-4847-8ccf-e4db0e1c899f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:12.216749 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387cc5d-cc2a-4847-8ccf-e4db0e1c899f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:08:12.245969 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387cc5d-cc2a-4847-8ccf-e4db0e1c899f service swift] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:08:12.257811 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1149/2299] 10.222.0.89 () {60 vars in 1384 bytes} [Wed Oct 27 15:08:12 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 15:08:12.653520 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e162907-d5df-4acd-939b-6ebc9d35217c None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:12.654113 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e162907-d5df-4acd-939b-6ebc9d35217c None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:12.654796 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e162907-d5df-4acd-939b-6ebc9d35217c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:12.712091 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-7e162907-d5df-4acd-939b-6ebc9d35217c None None] MFA Rules not processed for user `eda1dc32746a433098fc2ce168aed965`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:08:12.713702 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-7e162907-d5df-4acd-939b-6ebc9d35217c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:08:12.848431 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1151/2300] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:08:12 2021] POST /identity/v3/auth/tokens => generated 3759 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:08:12.863507 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387cc5d-cc2a-4847-8ccf-e4db0e1c899f service swift] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:08:12.865217 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-c387cc5d-cc2a-4847-8ccf-e4db0e1c899f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:08:13.012996 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387cc5d-cc2a-4847-8ccf-e4db0e1c899f service swift] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:08:13.016857 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4b4ab-d25e-43df-8958-debffbf9c06c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c345fc642242469346303afbeda2f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:08:13.017447 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4b4ab-d25e-43df-8958-debffbf9c06c service glance] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:13.017872 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4b4ab-d25e-43df-8958-debffbf9c06c service glance] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:13.018043 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4b4ab-d25e-43df-8958-debffbf9c06c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:13.105646 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4b4ab-d25e-43df-8958-debffbf9c06c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:08:13.152573 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4b4ab-d25e-43df-8958-debffbf9c06c service glance] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:08:13.168447 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1150/2301] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:08:12 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:08:13.418036 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6bd20-24bd-4cb7-8164-e15397b8a717 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:13.418561 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6bd20-24bd-4cb7-8164-e15397b8a717 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:13.418645 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6bd20-24bd-4cb7-8164-e15397b8a717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:13.461125 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-d8d6bd20-24bd-4cb7-8164-e15397b8a717 None None] MFA Rules not processed for user `ed972e6b35be47a8af2e86651ccc6911`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:08:13.463175 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-d8d6bd20-24bd-4cb7-8164-e15397b8a717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:08:13.475047 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1152/2302] 10.222.0.89 () {58 vars in 1014 bytes} [Wed Oct 27 15:08:13 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:08:13.501230 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4b4ab-d25e-43df-8958-debffbf9c06c service glance] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:08:13.516428 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4b4ab-d25e-43df-8958-debffbf9c06c service glance] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:08:13.536807 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308084c2-9161-482a-8c60-5d94750fc2d4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffba82bc9ddf42069a813b932bd310ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:08:13.537751 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308084c2-9161-482a-8c60-5d94750fc2d4 service swift] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:13.538283 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308084c2-9161-482a-8c60-5d94750fc2d4 service swift] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:13.538798 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308084c2-9161-482a-8c60-5d94750fc2d4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:13.590596 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308084c2-9161-482a-8c60-5d94750fc2d4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:08:13.644005 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308084c2-9161-482a-8c60-5d94750fc2d4 service swift] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:08:13.667479 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1151/2303] 10.222.0.89 () {60 vars in 1384 bytes} [Wed Oct 27 15:08:13 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 15:08:13.774653 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135d2a9-c0b1-470e-ae7f-8f9485f71b02 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:13.774958 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135d2a9-c0b1-470e-ae7f-8f9485f71b02 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:13.775239 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135d2a9-c0b1-470e-ae7f-8f9485f71b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:13.826029 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-4135d2a9-c0b1-470e-ae7f-8f9485f71b02 None None] MFA Rules not processed for user `ed972e6b35be47a8af2e86651ccc6911`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:08:13.827185 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-4135d2a9-c0b1-470e-ae7f-8f9485f71b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:08:13.852869 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1153/2304] 10.222.0.89 () {58 vars in 1014 bytes} [Wed Oct 27 15:08:13 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:08:13.904695 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308084c2-9161-482a-8c60-5d94750fc2d4 service swift] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:08:13.935389 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308084c2-9161-482a-8c60-5d94750fc2d4 service swift] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:08:13.950549 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0957c5-d0f3-4276-9b76-0ccbb528c9a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffba82bc9ddf42069a813b932bd310ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:08:13.951148 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0957c5-d0f3-4276-9b76-0ccbb528c9a1 service swift] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:13.951465 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0957c5-d0f3-4276-9b76-0ccbb528c9a1 service swift] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:13.951731 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0957c5-d0f3-4276-9b76-0ccbb528c9a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:13.976302 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0957c5-d0f3-4276-9b76-0ccbb528c9a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:08:14.079093 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0957c5-d0f3-4276-9b76-0ccbb528c9a1 service swift] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:08:14.114580 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1152/2305] 10.222.0.89 () {60 vars in 1384 bytes} [Wed Oct 27 15:08:13 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 15:08:14.891238 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c4902-5224-4876-86c2-813641cbf33b None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:14.891238 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c4902-5224-4876-86c2-813641cbf33b None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:14.891238 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19c4902-5224-4876-86c2-813641cbf33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:14.999709 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-c19c4902-5224-4876-86c2-813641cbf33b None None] MFA Rules not processed for user `ed972e6b35be47a8af2e86651ccc6911`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:08:15.002269 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-c19c4902-5224-4876-86c2-813641cbf33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:08:15.020294 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1154/2306] 10.222.0.89 () {58 vars in 967 bytes} [Wed Oct 27 15:08:14 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:08:15.085240 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0957c5-d0f3-4276-9b76-0ccbb528c9a1 service swift] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:08:15.100334 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0957c5-d0f3-4276-9b76-0ccbb528c9a1 service swift] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:08:15.113126 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1f86c-faeb-4377-b3cd-c4d0bc17bd69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffba82bc9ddf42069a813b932bd310ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:08:15.113719 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1f86c-faeb-4377-b3cd-c4d0bc17bd69 service swift] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:15.114012 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1f86c-faeb-4377-b3cd-c4d0bc17bd69 service swift] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:15.115772 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1f86c-faeb-4377-b3cd-c4d0bc17bd69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:15.157460 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1f86c-faeb-4377-b3cd-c4d0bc17bd69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:08:15.282862 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1f86c-faeb-4377-b3cd-c4d0bc17bd69 service swift] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:08:15.301123 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1153/2307] 10.222.0.89 () {60 vars in 1384 bytes} [Wed Oct 27 15:08:15 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 15:08:19.940121 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c4902-5224-4876-86c2-813641cbf33b None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:08:19.941618 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-c19c4902-5224-4876-86c2-813641cbf33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:08:20.214204 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19c4902-5224-4876-86c2-813641cbf33b None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:08:20.234723 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc2864-58e6-4093-946f-5060777cd061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:08:20.235604 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc2864-58e6-4093-946f-5060777cd061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:20.235862 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc2864-58e6-4093-946f-5060777cd061 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:20.236145 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc2864-58e6-4093-946f-5060777cd061 admin admin] PATH_INFO: `/v3/users/36e0c8e8108c4231be49368e19dc1ec3` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:20.237529 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc2864-58e6-4093-946f-5060777cd061 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36e0c8e8108c4231be49368e19dc1ec3)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:08:20.268189 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc2864-58e6-4093-946f-5060777cd061 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:08:20.468797 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-f1fc2864-58e6-4093-946f-5060777cd061 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36e0c8e8108c4231be49368e19dc1ec3'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:08:20.477707 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-f1fc2864-58e6-4093-946f-5060777cd061 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36e0c8e8108c4231be49368e19dc1ec3'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:08:20.542371 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-f1fc2864-58e6-4093-946f-5060777cd061 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36e0c8e8108c4231be49368e19dc1ec3'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:08:20.561182 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-f1fc2864-58e6-4093-946f-5060777cd061 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36e0c8e8108c4231be49368e19dc1ec3'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:08:20.574464 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-f1fc2864-58e6-4093-946f-5060777cd061 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36e0c8e8108c4231be49368e19dc1ec3'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:08:20.581850 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1155/2308] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:08:19 2021] DELETE /identity/v3/users/36e0c8e8108c4231be49368e19dc1ec3 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:08:20.586914 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515008b-ff2e-44c1-b120-56baf6001990 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:20.587985 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515008b-ff2e-44c1-b120-56baf6001990 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:20.588502 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515008b-ff2e-44c1-b120-56baf6001990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:20.625019 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-3515008b-ff2e-44c1-b120-56baf6001990 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:08:20.628687 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-3515008b-ff2e-44c1-b120-56baf6001990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:08:20.788849 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1154/2309] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:08:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:08:20.795183 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc2864-58e6-4093-946f-5060777cd061 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:08:20.804460 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-f1fc2864-58e6-4093-946f-5060777cd061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:08:20.998725 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc2864-58e6-4093-946f-5060777cd061 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:08:21.005474 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76757865-6d84-445b-ad4d-840fdf555243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:08:21.006072 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76757865-6d84-445b-ad4d-840fdf555243 service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:21.006361 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76757865-6d84-445b-ad4d-840fdf555243 service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:21.007215 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76757865-6d84-445b-ad4d-840fdf555243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:21.032311 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76757865-6d84-445b-ad4d-840fdf555243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:08:21.084262 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76757865-6d84-445b-ad4d-840fdf555243 service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:08:21.103089 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1156/2310] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:08:20 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:08:21.811273 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515008b-ff2e-44c1-b120-56baf6001990 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:08:21.813258 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-3515008b-ff2e-44c1-b120-56baf6001990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:08:21.828301 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515008b-ff2e-44c1-b120-56baf6001990 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:08:21.835818 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e589c11-9c9e-46c2-a58f-ed50552e3e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:08:21.837048 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e589c11-9c9e-46c2-a58f-ed50552e3e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:21.837569 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e589c11-9c9e-46c2-a58f-ed50552e3e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:21.838131 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e589c11-9c9e-46c2-a58f-ed50552e3e95 admin admin] PATH_INFO: `/v3/projects/232e08d132a9419d8e005d58c8c63763` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:21.839527 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e589c11-9c9e-46c2-a58f-ed50552e3e95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=232e08d132a9419d8e005d58c8c63763)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:08:21.870567 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e589c11-9c9e-46c2-a58f-ed50552e3e95 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:08:22.015342 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-2e589c11-9c9e-46c2-a58f-ed50552e3e95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '232e08d132a9419d8e005d58c8c63763', 'request_id': 'req-2e589c11-9c9e-46c2-a58f-ed50552e3e95'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:08:22.030692 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-2e589c11-9c9e-46c2-a58f-ed50552e3e95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '232e08d132a9419d8e005d58c8c63763', 'request_id': 'req-2e589c11-9c9e-46c2-a58f-ed50552e3e95'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:08:22.071088 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-2e589c11-9c9e-46c2-a58f-ed50552e3e95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '232e08d132a9419d8e005d58c8c63763', 'request_id': 'req-2e589c11-9c9e-46c2-a58f-ed50552e3e95'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:08:22.096292 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-2e589c11-9c9e-46c2-a58f-ed50552e3e95 admin admin] The token cache is being invalidate because project 232e08d132a9419d8e005d58c8c63763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:08:22.097146 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-2e589c11-9c9e-46c2-a58f-ed50552e3e95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:08:22.100286 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-2e589c11-9c9e-46c2-a58f-ed50552e3e95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:08:22.121695 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1155/2311] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:08:21 2021] DELETE /identity/v3/projects/232e08d132a9419d8e005d58c8c63763 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:08:27.529599 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76757865-6d84-445b-ad4d-840fdf555243 service neutron] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:08:27.531105 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-76757865-6d84-445b-ad4d-840fdf555243 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:08:27.729121 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76757865-6d84-445b-ad4d-840fdf555243 service neutron] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:08:27.890615 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d24563e-67a9-4eb1-a5da-257a1d946cda service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcbab075fd5b4a889c2002639ca9d60a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:08:27.891215 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24563e-67a9-4eb1-a5da-257a1d946cda service placement] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:27.891555 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24563e-67a9-4eb1-a5da-257a1d946cda service placement] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:27.891841 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24563e-67a9-4eb1-a5da-257a1d946cda service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:27.893510 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-7d24563e-67a9-4eb1-a5da-257a1d946cda service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:08:27.932286 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d24563e-67a9-4eb1-a5da-257a1d946cda service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:08:27.980682 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d24563e-67a9-4eb1-a5da-257a1d946cda service placement] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:08:28.020155 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1157/2312] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:08:27 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:08:30.446344 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e39b4-7acc-4a14-b596-8094cb7b0c9e None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:30.446892 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e39b4-7acc-4a14-b596-8094cb7b0c9e None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:30.446892 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e39b4-7acc-4a14-b596-8094cb7b0c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:30.473646 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-627e39b4-7acc-4a14-b596-8094cb7b0c9e None None] MFA Rules not processed for user `cfd38937e0504a11bb1c9e5418047f23`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:08:30.475130 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-627e39b4-7acc-4a14-b596-8094cb7b0c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:08:30.563534 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1156/2313] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:08:30 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:08:33.947268 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75455cc-dca3-48e3-8250-5ec1ffdb1fb0 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:33.948365 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75455cc-dca3-48e3-8250-5ec1ffdb1fb0 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:33.948793 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75455cc-dca3-48e3-8250-5ec1ffdb1fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:33.973903 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-e75455cc-dca3-48e3-8250-5ec1ffdb1fb0 None None] MFA Rules not processed for user `ed972e6b35be47a8af2e86651ccc6911`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:08:33.975380 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-e75455cc-dca3-48e3-8250-5ec1ffdb1fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:08:34.069597 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1158/2314] 10.222.0.89 () {58 vars in 1014 bytes} [Wed Oct 27 15:08:33 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:08:34.070449 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e39b4-7acc-4a14-b596-8094cb7b0c9e None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:08:34.072183 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-627e39b4-7acc-4a14-b596-8094cb7b0c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:08:34.386454 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e39b4-7acc-4a14-b596-8094cb7b0c9e None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:08:34.402850 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a0613-d681-4839-a4dc-65c37b5e69d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffba82bc9ddf42069a813b932bd310ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:08:34.403472 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a0613-d681-4839-a4dc-65c37b5e69d2 service swift] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:34.403759 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a0613-d681-4839-a4dc-65c37b5e69d2 service swift] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:34.404292 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a0613-d681-4839-a4dc-65c37b5e69d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:34.424721 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a0613-d681-4839-a4dc-65c37b5e69d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:08:34.474489 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a0613-d681-4839-a4dc-65c37b5e69d2 service swift] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:08:34.507402 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1157/2315] 10.222.0.89 () {60 vars in 1384 bytes} [Wed Oct 27 15:08:34 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 15:08:35.600631 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438986a-6a63-4ec4-9fd5-e47d5fed42be None None] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:35.601174 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438986a-6a63-4ec4-9fd5-e47d5fed42be None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:35.601174 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438986a-6a63-4ec4-9fd5-e47d5fed42be None None] PATH_INFO: `/` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:35.602915 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1159/2316] 10.222.0.89 () {54 vars in 921 bytes} [Wed Oct 27 15:08:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 15:08:35.609190 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc6e26-6c6e-46ae-8eb0-64215e2c9545 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:35.609689 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc6e26-6c6e-46ae-8eb0-64215e2c9545 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:35.609770 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc6e26-6c6e-46ae-8eb0-64215e2c9545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:35.666553 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-f7dc6e26-6c6e-46ae-8eb0-64215e2c9545 None None] MFA Rules not processed for user `ab1b41f8980348fc878e492e26078e33`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:08:35.667778 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-f7dc6e26-6c6e-46ae-8eb0-64215e2c9545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:08:35.804447 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1158/2317] 10.222.0.89 () {58 vars in 1018 bytes} [Wed Oct 27 15:08:35 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:08:35.817064 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438986a-6a63-4ec4-9fd5-e47d5fed42be None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:08:35.819360 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-6438986a-6a63-4ec4-9fd5-e47d5fed42be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:08:35.851706 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438986a-6a63-4ec4-9fd5-e47d5fed42be None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:08:35.866963 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713454ec-3b65-4788-a58f-7b0edde75ebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:08:35.867933 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713454ec-3b65-4788-a58f-7b0edde75ebb service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:35.869151 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713454ec-3b65-4788-a58f-7b0edde75ebb service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:35.869784 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713454ec-3b65-4788-a58f-7b0edde75ebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:35.896842 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713454ec-3b65-4788-a58f-7b0edde75ebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:08:35.963835 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713454ec-3b65-4788-a58f-7b0edde75ebb service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:08:35.995758 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1160/2318] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:08:35 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:08:59.371899 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97061e54-f533-4524-9606-d5a162b52069 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:59.372469 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97061e54-f533-4524-9606-d5a162b52069 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:59.372580 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97061e54-f533-4524-9606-d5a162b52069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:59.447212 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-97061e54-f533-4524-9606-d5a162b52069 None None] MFA Rules not processed for user `ed972e6b35be47a8af2e86651ccc6911`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:08:59.448351 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-97061e54-f533-4524-9606-d5a162b52069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:08:59.482182 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1159/2319] 10.222.0.89 () {58 vars in 1014 bytes} [Wed Oct 27 15:08:59 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:08:59.504307 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713454ec-3b65-4788-a58f-7b0edde75ebb service neutron] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:08:59.530716 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713454ec-3b65-4788-a58f-7b0edde75ebb service neutron] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:08:59.536169 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb7683-02f6-4c10-86bf-9675c3725c80 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffba82bc9ddf42069a813b932bd310ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:08:59.537498 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb7683-02f6-4c10-86bf-9675c3725c80 service swift] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:08:59.537947 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb7683-02f6-4c10-86bf-9675c3725c80 service swift] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:08:59.538635 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eb7683-02f6-4c10-86bf-9675c3725c80 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:08:59.548020 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb7683-02f6-4c10-86bf-9675c3725c80 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:08:59.575197 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eb7683-02f6-4c10-86bf-9675c3725c80 service swift] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:08:59.583881 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1161/2320] 10.222.0.89 () {60 vars in 1384 bytes} [Wed Oct 27 15:08:59 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 15:09:18.790099 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97061e54-f533-4524-9606-d5a162b52069 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:18.791610 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-97061e54-f533-4524-9606-d5a162b52069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:09:18.872337 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97061e54-f533-4524-9606-d5a162b52069 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:18.876548 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22357a3e-3ab6-4512-9a1d-4a3bdd6bc2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:18.877350 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22357a3e-3ab6-4512-9a1d-4a3bdd6bc2e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:18.877636 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22357a3e-3ab6-4512-9a1d-4a3bdd6bc2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:18.877917 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22357a3e-3ab6-4512-9a1d-4a3bdd6bc2e0 admin admin] PATH_INFO: `/v3/users/7a86cdc90706440c8fa6bf9e101573b9` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:18.879024 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22357a3e-3ab6-4512-9a1d-4a3bdd6bc2e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a86cdc90706440c8fa6bf9e101573b9)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:18.906707 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22357a3e-3ab6-4512-9a1d-4a3bdd6bc2e0 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:18.960418 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-22357a3e-3ab6-4512-9a1d-4a3bdd6bc2e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a86cdc90706440c8fa6bf9e101573b9'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:09:18.976105 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-22357a3e-3ab6-4512-9a1d-4a3bdd6bc2e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a86cdc90706440c8fa6bf9e101573b9'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:09:18.976279 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-22357a3e-3ab6-4512-9a1d-4a3bdd6bc2e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a86cdc90706440c8fa6bf9e101573b9'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:09:18.987473 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-22357a3e-3ab6-4512-9a1d-4a3bdd6bc2e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a86cdc90706440c8fa6bf9e101573b9'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:09:18.997630 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-22357a3e-3ab6-4512-9a1d-4a3bdd6bc2e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a86cdc90706440c8fa6bf9e101573b9'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:09:19.004550 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1160/2321] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:09:18 2021] DELETE /identity/v3/users/7a86cdc90706440c8fa6bf9e101573b9 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:09:19.243343 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb7683-02f6-4c10-86bf-9675c3725c80 service swift] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:19.255785 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eb7683-02f6-4c10-86bf-9675c3725c80 service swift] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:19.330819 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15346590-6b8d-4db1-b4c5-5cf48ea2fa7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:19.331812 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15346590-6b8d-4db1-b4c5-5cf48ea2fa7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:19.332197 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15346590-6b8d-4db1-b4c5-5cf48ea2fa7f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:19.333035 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15346590-6b8d-4db1-b4c5-5cf48ea2fa7f admin admin] PATH_INFO: `/v3/projects/1db44cbda2874a4e9cd4706662ba77b9` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:19.333922 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15346590-6b8d-4db1-b4c5-5cf48ea2fa7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1db44cbda2874a4e9cd4706662ba77b9)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:19.360020 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15346590-6b8d-4db1-b4c5-5cf48ea2fa7f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:19.416147 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-15346590-6b8d-4db1-b4c5-5cf48ea2fa7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1db44cbda2874a4e9cd4706662ba77b9', 'request_id': 'req-15346590-6b8d-4db1-b4c5-5cf48ea2fa7f'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:09:19.421537 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-15346590-6b8d-4db1-b4c5-5cf48ea2fa7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1db44cbda2874a4e9cd4706662ba77b9', 'request_id': 'req-15346590-6b8d-4db1-b4c5-5cf48ea2fa7f'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:09:19.447766 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-15346590-6b8d-4db1-b4c5-5cf48ea2fa7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1db44cbda2874a4e9cd4706662ba77b9', 'request_id': 'req-15346590-6b8d-4db1-b4c5-5cf48ea2fa7f'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:09:19.461301 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-15346590-6b8d-4db1-b4c5-5cf48ea2fa7f admin admin] The token cache is being invalidate because project 1db44cbda2874a4e9cd4706662ba77b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:09:19.461738 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-15346590-6b8d-4db1-b4c5-5cf48ea2fa7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:09:19.462774 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-15346590-6b8d-4db1-b4c5-5cf48ea2fa7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:09:19.468746 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1162/2322] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:09:19 2021] DELETE /identity/v3/projects/1db44cbda2874a4e9cd4706662ba77b9 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:09:19.470784 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52ac99-1757-4c0d-9934-b5c56ed0cb42 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:19.471344 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52ac99-1757-4c0d-9934-b5c56ed0cb42 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:19.471801 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52ac99-1757-4c0d-9934-b5c56ed0cb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:19.496969 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-8b52ac99-1757-4c0d-9934-b5c56ed0cb42 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:09:19.498185 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-8b52ac99-1757-4c0d-9934-b5c56ed0cb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:09:19.565982 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1161/2323] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:09:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:09:19.575513 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9d384-df7f-49be-9411-39b2a91bf4a4 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:19.575817 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9d384-df7f-49be-9411-39b2a91bf4a4 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:19.576104 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9d384-df7f-49be-9411-39b2a91bf4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:19.601879 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-43d9d384-df7f-49be-9411-39b2a91bf4a4 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:09:19.603036 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-43d9d384-df7f-49be-9411-39b2a91bf4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:09:19.610226 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1163/2324] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:09:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:09:19.614432 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52ac99-1757-4c0d-9934-b5c56ed0cb42 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:19.624307 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52ac99-1757-4c0d-9934-b5c56ed0cb42 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:19.632742 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d8014-7903-40a1-8a86-573638c3de43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:19.632742 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d8014-7903-40a1-8a86-573638c3de43 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:19.632742 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d8014-7903-40a1-8a86-573638c3de43 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:19.632742 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d8014-7903-40a1-8a86-573638c3de43 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:19.633135 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d8014-7903-40a1-8a86-573638c3de43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:09:19.633135 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d8014-7903-40a1-8a86-573638c3de43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:19.656382 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d8014-7903-40a1-8a86-573638c3de43 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:19.670770 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1162/2325] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:09:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:09:19.675164 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9d384-df7f-49be-9411-39b2a91bf4a4 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:19.685045 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9d384-df7f-49be-9411-39b2a91bf4a4 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:19.690330 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43e18c-87c0-47cc-a0cc-be2eef44a49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:19.690935 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43e18c-87c0-47cc-a0cc-be2eef44a49b admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:19.691222 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43e18c-87c0-47cc-a0cc-be2eef44a49b admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:19.691529 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43e18c-87c0-47cc-a0cc-be2eef44a49b admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:19.692244 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43e18c-87c0-47cc-a0cc-be2eef44a49b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:19.717881 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f43e18c-87c0-47cc-a0cc-be2eef44a49b admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:19.750465 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1164/2326] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:09:19 2021] POST /identity/v3/projects => generated 367 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:09:19.756341 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d8014-7903-40a1-8a86-573638c3de43 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:19.766929 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d8014-7903-40a1-8a86-573638c3de43 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:19.838664 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47da39-72f8-4912-be5e-d5fe603bcc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:19.840051 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47da39-72f8-4912-be5e-d5fe603bcc25 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:19.840523 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47da39-72f8-4912-be5e-d5fe603bcc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:19.840955 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47da39-72f8-4912-be5e-d5fe603bcc25 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:19.841751 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f47da39-72f8-4912-be5e-d5fe603bcc25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:19.869697 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f47da39-72f8-4912-be5e-d5fe603bcc25 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:19.916211 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1163/2327] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:09:19 2021] POST /identity/v3/users => generated 284 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:09:19.917533 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43e18c-87c0-47cc-a0cc-be2eef44a49b admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:19.937456 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f43e18c-87c0-47cc-a0cc-be2eef44a49b admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:19.949607 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faff678-da73-4149-8581-69f667ecbe82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:19.950168 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faff678-da73-4149-8581-69f667ecbe82 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:19.950643 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faff678-da73-4149-8581-69f667ecbe82 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:19.951082 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faff678-da73-4149-8581-69f667ecbe82 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:19.952841 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faff678-da73-4149-8581-69f667ecbe82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:20.009586 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faff678-da73-4149-8581-69f667ecbe82 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:20.034472 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1165/2328] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:09:19 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:09:20.037015 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47da39-72f8-4912-be5e-d5fe603bcc25 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:20.056335 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47da39-72f8-4912-be5e-d5fe603bcc25 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:20.063208 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2daeab8-b6d7-4d02-8205-ff2ee0890d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:20.065018 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daeab8-b6d7-4d02-8205-ff2ee0890d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:20.065701 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daeab8-b6d7-4d02-8205-ff2ee0890d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:20.066192 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daeab8-b6d7-4d02-8205-ff2ee0890d31 admin admin] PATH_INFO: `/v3/projects/e9e3358c17234df4bfa38f35851bc3a3/users/722a9a1a013141d2aaed7536e7366cd0/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:20.103979 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2daeab8-b6d7-4d02-8205-ff2ee0890d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9e3358c17234df4bfa38f35851bc3a3, user_id=722a9a1a013141d2aaed7536e7366cd0, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:20.130756 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2daeab8-b6d7-4d02-8205-ff2ee0890d31 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:20.147099 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1164/2329] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:09:20 2021] PUT /identity/v3/projects/e9e3358c17234df4bfa38f35851bc3a3/users/722a9a1a013141d2aaed7536e7366cd0/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:09:20.157290 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9b9bb-e140-4563-a84e-0159984da403 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:20.157711 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9b9bb-e140-4563-a84e-0159984da403 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:20.158098 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9b9bb-e140-4563-a84e-0159984da403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:20.207618 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-a5a9b9bb-e140-4563-a84e-0159984da403 None None] MFA Rules not processed for user `722a9a1a013141d2aaed7536e7366cd0`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:09:20.209484 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-a5a9b9bb-e140-4563-a84e-0159984da403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:09:20.315586 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1166/2330] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:09:20 2021] POST /identity/v3/auth/tokens => generated 3674 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:09:20.326620 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2daeab8-b6d7-4d02-8205-ff2ee0890d31 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:20.328664 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-c2daeab8-b6d7-4d02-8205-ff2ee0890d31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:09:20.434357 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2daeab8-b6d7-4d02-8205-ff2ee0890d31 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:20.438050 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8bbb6-aff5-4203-bc9b-60a2d583f6f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:20.438666 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8bbb6-aff5-4203-bc9b-60a2d583f6f6 service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:20.438952 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8bbb6-aff5-4203-bc9b-60a2d583f6f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:20.439243 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8bbb6-aff5-4203-bc9b-60a2d583f6f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:20.450789 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8bbb6-aff5-4203-bc9b-60a2d583f6f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:20.487929 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c8bbb6-aff5-4203-bc9b-60a2d583f6f6 service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:20.498182 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1165/2331] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:09:20 2021] GET /identity/v3/auth/tokens => generated 3674 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:09:23.328818 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9b9bb-e140-4563-a84e-0159984da403 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:23.330841 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-a5a9b9bb-e140-4563-a84e-0159984da403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:09:23.398600 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9b9bb-e140-4563-a84e-0159984da403 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:23.401973 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6464b20-e7c2-423a-9037-b3bd80baeef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:23.402559 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6464b20-e7c2-423a-9037-b3bd80baeef7 service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:23.403231 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6464b20-e7c2-423a-9037-b3bd80baeef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:23.403549 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6464b20-e7c2-423a-9037-b3bd80baeef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:23.405246 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-e6464b20-e7c2-423a-9037-b3bd80baeef7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:09:23.475150 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6464b20-e7c2-423a-9037-b3bd80baeef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:23.500503 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6464b20-e7c2-423a-9037-b3bd80baeef7 service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:23.511056 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1167/2332] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:09:23 2021] GET /identity/v3/auth/tokens => generated 3759 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:09:33.058074 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bcbfa-39bf-4107-b39b-17a5314f4671 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:33.058620 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bcbfa-39bf-4107-b39b-17a5314f4671 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:33.058620 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bcbfa-39bf-4107-b39b-17a5314f4671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:33.081459 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-550bcbfa-39bf-4107-b39b-17a5314f4671 None None] MFA Rules not processed for user `06547e0ae25e422c90cc2473f9cabfa4`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:09:33.083212 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-550bcbfa-39bf-4107-b39b-17a5314f4671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:09:33.148223 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1166/2333] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:09:33 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:09:33.835040 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1252d-591a-4b52-87a8-9857e8e77d94 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:33.836046 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1252d-591a-4b52-87a8-9857e8e77d94 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:33.836564 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1252d-591a-4b52-87a8-9857e8e77d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:33.861803 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-03a1252d-591a-4b52-87a8-9857e8e77d94 None None] MFA Rules not processed for user `ed972e6b35be47a8af2e86651ccc6911`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:09:33.864981 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-03a1252d-591a-4b52-87a8-9857e8e77d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:09:33.944622 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1168/2334] 10.222.0.89 () {58 vars in 967 bytes} [Wed Oct 27 15:09:33 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:09:33.971636 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550bcbfa-39bf-4107-b39b-17a5314f4671 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:33.973576 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-550bcbfa-39bf-4107-b39b-17a5314f4671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:09:34.106162 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550bcbfa-39bf-4107-b39b-17a5314f4671 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:34.112351 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17949386-37d0-4d7f-a3ca-5d6f04fff30b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffba82bc9ddf42069a813b932bd310ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:34.112847 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17949386-37d0-4d7f-a3ca-5d6f04fff30b service swift] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:34.113332 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17949386-37d0-4d7f-a3ca-5d6f04fff30b service swift] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:34.114250 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17949386-37d0-4d7f-a3ca-5d6f04fff30b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:34.130811 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17949386-37d0-4d7f-a3ca-5d6f04fff30b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:34.158508 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17949386-37d0-4d7f-a3ca-5d6f04fff30b service swift] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:34.168869 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1167/2335] 10.222.0.89 () {60 vars in 1384 bytes} [Wed Oct 27 15:09:33 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 15:09:35.449687 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1252d-591a-4b52-87a8-9857e8e77d94 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:35.526168 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1252d-591a-4b52-87a8-9857e8e77d94 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:35.530961 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04585211-f252-4366-ac4a-cfe1a46fa6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:35.531799 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04585211-f252-4366-ac4a-cfe1a46fa6d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:35.532559 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04585211-f252-4366-ac4a-cfe1a46fa6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:35.532559 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04585211-f252-4366-ac4a-cfe1a46fa6d3 admin admin] PATH_INFO: `/v3/users/722a9a1a013141d2aaed7536e7366cd0` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:35.533427 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04585211-f252-4366-ac4a-cfe1a46fa6d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=722a9a1a013141d2aaed7536e7366cd0)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:35.562325 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04585211-f252-4366-ac4a-cfe1a46fa6d3 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:35.624806 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-04585211-f252-4366-ac4a-cfe1a46fa6d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '722a9a1a013141d2aaed7536e7366cd0'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:09:35.625447 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-04585211-f252-4366-ac4a-cfe1a46fa6d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '722a9a1a013141d2aaed7536e7366cd0'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:09:35.638425 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-04585211-f252-4366-ac4a-cfe1a46fa6d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '722a9a1a013141d2aaed7536e7366cd0'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:09:35.646257 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-04585211-f252-4366-ac4a-cfe1a46fa6d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '722a9a1a013141d2aaed7536e7366cd0'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:09:35.663941 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-04585211-f252-4366-ac4a-cfe1a46fa6d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '722a9a1a013141d2aaed7536e7366cd0'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:09:35.663941 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1169/2336] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:09:35 2021] DELETE /identity/v3/users/722a9a1a013141d2aaed7536e7366cd0 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:09:35.667108 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db9f1c-618c-4385-a99f-99d1637fc800 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:35.667952 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db9f1c-618c-4385-a99f-99d1637fc800 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:35.668238 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db9f1c-618c-4385-a99f-99d1637fc800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:35.690432 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-52db9f1c-618c-4385-a99f-99d1637fc800 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:09:35.691624 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-52db9f1c-618c-4385-a99f-99d1637fc800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:09:35.759300 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1168/2337] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:09:35 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:09:35.769366 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04585211-f252-4366-ac4a-cfe1a46fa6d3 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:35.771406 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-04585211-f252-4366-ac4a-cfe1a46fa6d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:09:35.834692 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04585211-f252-4366-ac4a-cfe1a46fa6d3 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:35.838158 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece3269-0cc9-4707-89a4-ccfd224fcbd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:35.838776 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece3269-0cc9-4707-89a4-ccfd224fcbd6 service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:35.839065 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece3269-0cc9-4707-89a4-ccfd224fcbd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:35.839342 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece3269-0cc9-4707-89a4-ccfd224fcbd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:35.848313 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece3269-0cc9-4707-89a4-ccfd224fcbd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:35.873301 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece3269-0cc9-4707-89a4-ccfd224fcbd6 service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:35.883633 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1170/2338] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:09:35 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:09:36.266437 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db9f1c-618c-4385-a99f-99d1637fc800 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:36.267896 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-52db9f1c-618c-4385-a99f-99d1637fc800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:09:36.281346 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db9f1c-618c-4385-a99f-99d1637fc800 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:36.286271 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7991ca-6787-47ad-bd72-b0ba96fca60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:36.287530 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7991ca-6787-47ad-bd72-b0ba96fca60e admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:36.287530 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7991ca-6787-47ad-bd72-b0ba96fca60e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:36.287875 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7991ca-6787-47ad-bd72-b0ba96fca60e admin admin] PATH_INFO: `/v3/projects/e9e3358c17234df4bfa38f35851bc3a3` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:36.289133 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7991ca-6787-47ad-bd72-b0ba96fca60e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9e3358c17234df4bfa38f35851bc3a3)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:36.315972 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7991ca-6787-47ad-bd72-b0ba96fca60e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:36.369482 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-cf7991ca-6787-47ad-bd72-b0ba96fca60e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9e3358c17234df4bfa38f35851bc3a3', 'request_id': 'req-cf7991ca-6787-47ad-bd72-b0ba96fca60e'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:09:36.376381 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-cf7991ca-6787-47ad-bd72-b0ba96fca60e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9e3358c17234df4bfa38f35851bc3a3', 'request_id': 'req-cf7991ca-6787-47ad-bd72-b0ba96fca60e'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:09:36.388076 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-cf7991ca-6787-47ad-bd72-b0ba96fca60e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9e3358c17234df4bfa38f35851bc3a3', 'request_id': 'req-cf7991ca-6787-47ad-bd72-b0ba96fca60e'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:09:36.401075 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-cf7991ca-6787-47ad-bd72-b0ba96fca60e admin admin] The token cache is being invalidate because project e9e3358c17234df4bfa38f35851bc3a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:09:36.401381 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-cf7991ca-6787-47ad-bd72-b0ba96fca60e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:09:36.401976 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-cf7991ca-6787-47ad-bd72-b0ba96fca60e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:09:36.407774 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1169/2339] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:09:36 2021] DELETE /identity/v3/projects/e9e3358c17234df4bfa38f35851bc3a3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:09:36.409650 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e434807-80b8-4053-b82b-c2d647e9dc83 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:36.409942 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e434807-80b8-4053-b82b-c2d647e9dc83 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:36.410243 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e434807-80b8-4053-b82b-c2d647e9dc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:36.435050 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-7e434807-80b8-4053-b82b-c2d647e9dc83 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:09:36.436266 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-7e434807-80b8-4053-b82b-c2d647e9dc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:09:36.508902 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1171/2340] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:09:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:09:36.516693 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181a2bc-3e83-4d28-8a4d-042fd32ee9d5 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:36.516984 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181a2bc-3e83-4d28-8a4d-042fd32ee9d5 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:36.517262 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c181a2bc-3e83-4d28-8a4d-042fd32ee9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:36.554180 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-c181a2bc-3e83-4d28-8a4d-042fd32ee9d5 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:09:36.555746 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-c181a2bc-3e83-4d28-8a4d-042fd32ee9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:09:36.563004 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1170/2341] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:09:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:09:36.567230 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e434807-80b8-4053-b82b-c2d647e9dc83 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:36.576742 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e434807-80b8-4053-b82b-c2d647e9dc83 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:36.580906 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7ea1b-6595-43be-81d9-d512c3bf10f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:36.581488 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7ea1b-6595-43be-81d9-d512c3bf10f4 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:36.581773 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7ea1b-6595-43be-81d9-d512c3bf10f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:36.582050 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec7ea1b-6595-43be-81d9-d512c3bf10f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:36.582790 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7ea1b-6595-43be-81d9-d512c3bf10f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:09:36.583086 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7ea1b-6595-43be-81d9-d512c3bf10f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:36.609287 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec7ea1b-6595-43be-81d9-d512c3bf10f4 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:36.623729 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1172/2342] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:09:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:09:36.628482 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181a2bc-3e83-4d28-8a4d-042fd32ee9d5 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:36.637053 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c181a2bc-3e83-4d28-8a4d-042fd32ee9d5 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:36.641214 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5a890-8991-4bb8-a3bb-1b0a81b31a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:36.641894 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5a890-8991-4bb8-a3bb-1b0a81b31a16 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:36.642067 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5a890-8991-4bb8-a3bb-1b0a81b31a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:36.642341 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5a890-8991-4bb8-a3bb-1b0a81b31a16 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:36.642970 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5a890-8991-4bb8-a3bb-1b0a81b31a16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:36.670793 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5a890-8991-4bb8-a3bb-1b0a81b31a16 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:36.701330 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1171/2343] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:09:36 2021] POST /identity/v3/projects => generated 373 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:09:36.702559 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7ea1b-6595-43be-81d9-d512c3bf10f4 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:36.713257 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec7ea1b-6595-43be-81d9-d512c3bf10f4 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:36.780584 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249b06d-71fb-4d9f-91fd-892902cff363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:36.781193 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249b06d-71fb-4d9f-91fd-892902cff363 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:36.781473 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249b06d-71fb-4d9f-91fd-892902cff363 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:36.781748 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249b06d-71fb-4d9f-91fd-892902cff363 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:36.782407 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249b06d-71fb-4d9f-91fd-892902cff363 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:36.809445 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249b06d-71fb-4d9f-91fd-892902cff363 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:36.829653 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1173/2344] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:09:36 2021] POST /identity/v3/users => generated 287 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:09:36.834042 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5a890-8991-4bb8-a3bb-1b0a81b31a16 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:36.844006 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5a890-8991-4bb8-a3bb-1b0a81b31a16 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:36.848708 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4c44d-0d64-41cf-8e93-82e0ac9b592b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:36.849296 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4c44d-0d64-41cf-8e93-82e0ac9b592b admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:36.849579 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4c44d-0d64-41cf-8e93-82e0ac9b592b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:36.849848 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4c44d-0d64-41cf-8e93-82e0ac9b592b admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:36.850528 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae4c44d-0d64-41cf-8e93-82e0ac9b592b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:36.876188 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae4c44d-0d64-41cf-8e93-82e0ac9b592b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:36.886657 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1172/2345] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:09:36 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:09:36.890997 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249b06d-71fb-4d9f-91fd-892902cff363 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:36.900837 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249b06d-71fb-4d9f-91fd-892902cff363 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:36.906064 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fc4bc-9cd6-4a20-b062-1c3137d81006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:36.906064 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fc4bc-9cd6-4a20-b062-1c3137d81006 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:36.906322 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fc4bc-9cd6-4a20-b062-1c3137d81006 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:36.906597 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fc4bc-9cd6-4a20-b062-1c3137d81006 admin admin] PATH_INFO: `/v3/projects/5cf32a6e07f04a3e8162e2b477e99729/users/c3c4a13d658a4a349b07ae6258082a9b/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:36.926715 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5fc4bc-9cd6-4a20-b062-1c3137d81006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cf32a6e07f04a3e8162e2b477e99729, user_id=c3c4a13d658a4a349b07ae6258082a9b, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:36.953715 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5fc4bc-9cd6-4a20-b062-1c3137d81006 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:36.967186 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1174/2346] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:09:36 2021] PUT /identity/v3/projects/5cf32a6e07f04a3e8162e2b477e99729/users/c3c4a13d658a4a349b07ae6258082a9b/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:09:36.977880 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979cfbf-5c2e-40cf-a267-a60c54acc4da None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:36.978282 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979cfbf-5c2e-40cf-a267-a60c54acc4da None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:36.978630 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979cfbf-5c2e-40cf-a267-a60c54acc4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:37.014298 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-b979cfbf-5c2e-40cf-a267-a60c54acc4da None None] MFA Rules not processed for user `c3c4a13d658a4a349b07ae6258082a9b`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:09:37.015584 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-b979cfbf-5c2e-40cf-a267-a60c54acc4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:09:37.089274 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1173/2347] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:09:36 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:09:37.093640 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fc4bc-9cd6-4a20-b062-1c3137d81006 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:37.167582 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fc4bc-9cd6-4a20-b062-1c3137d81006 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:37.172976 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0339705-713c-4dda-8acc-135dc3a9769d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:37.172976 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0339705-713c-4dda-8acc-135dc3a9769d admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:37.172976 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0339705-713c-4dda-8acc-135dc3a9769d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:37.173271 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0339705-713c-4dda-8acc-135dc3a9769d admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:37.173654 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0339705-713c-4dda-8acc-135dc3a9769d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:37.198923 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0339705-713c-4dda-8acc-135dc3a9769d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:37.238674 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1175/2348] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:09:37 2021] POST /identity/v3/projects => generated 371 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:09:37.238979 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979cfbf-5c2e-40cf-a267-a60c54acc4da None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:37.250561 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979cfbf-5c2e-40cf-a267-a60c54acc4da None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:37.327665 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ac1b6-717f-4f1d-b634-7244cc3b32d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:37.328273 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ac1b6-717f-4f1d-b634-7244cc3b32d7 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:37.328685 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ac1b6-717f-4f1d-b634-7244cc3b32d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:37.328963 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ac1b6-717f-4f1d-b634-7244cc3b32d7 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:37.329605 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ac1b6-717f-4f1d-b634-7244cc3b32d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:37.355754 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ac1b6-717f-4f1d-b634-7244cc3b32d7 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:37.376861 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1174/2349] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:09:37 2021] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:09:37.380838 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0339705-713c-4dda-8acc-135dc3a9769d admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:37.390507 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0339705-713c-4dda-8acc-135dc3a9769d admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:37.394766 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e681a-924a-4fe4-8f16-200921318bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:37.396160 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e681a-924a-4fe4-8f16-200921318bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:37.396444 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e681a-924a-4fe4-8f16-200921318bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:37.396875 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e681a-924a-4fe4-8f16-200921318bf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:37.397406 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e681a-924a-4fe4-8f16-200921318bf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:37.423332 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e681a-924a-4fe4-8f16-200921318bf5 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:37.435544 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1176/2350] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:09:37 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:09:37.439953 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ac1b6-717f-4f1d-b634-7244cc3b32d7 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:37.452401 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ac1b6-717f-4f1d-b634-7244cc3b32d7 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:37.458764 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e14d7f-c6b2-4a0f-a900-cd700b168ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:37.459748 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e14d7f-c6b2-4a0f-a900-cd700b168ceb admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:37.460036 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e14d7f-c6b2-4a0f-a900-cd700b168ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:37.460644 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e14d7f-c6b2-4a0f-a900-cd700b168ceb admin admin] PATH_INFO: `/v3/projects/e49a6e9553bc43d3a86476500c3ea31e/users/43c38ed2bb2d47838b244e1ae32172cb/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:37.480782 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e14d7f-c6b2-4a0f-a900-cd700b168ceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e49a6e9553bc43d3a86476500c3ea31e, user_id=43c38ed2bb2d47838b244e1ae32172cb, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:37.508254 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e14d7f-c6b2-4a0f-a900-cd700b168ceb admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:37.538024 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1175/2351] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:09:37 2021] PUT /identity/v3/projects/e49a6e9553bc43d3a86476500c3ea31e/users/43c38ed2bb2d47838b244e1ae32172cb/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:09:37.539257 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e681a-924a-4fe4-8f16-200921318bf5 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:37.549435 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e681a-924a-4fe4-8f16-200921318bf5 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:37.661330 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b74b9-78e7-4a14-a261-58a2467ca5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:37.661950 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b74b9-78e7-4a14-a261-58a2467ca5aa admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:37.662638 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b74b9-78e7-4a14-a261-58a2467ca5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:37.662951 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b74b9-78e7-4a14-a261-58a2467ca5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:37.663822 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b74b9-78e7-4a14-a261-58a2467ca5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:37.695203 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b74b9-78e7-4a14-a261-58a2467ca5aa admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:37.707990 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1177/2352] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:09:37 2021] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:09:37.711938 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e14d7f-c6b2-4a0f-a900-cd700b168ceb admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:37.726691 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e14d7f-c6b2-4a0f-a900-cd700b168ceb admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:37.731657 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6e551-10c1-4f31-b7e6-5288a0d93d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:37.732761 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6e551-10c1-4f31-b7e6-5288a0d93d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:37.733378 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6e551-10c1-4f31-b7e6-5288a0d93d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:37.733896 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6e551-10c1-4f31-b7e6-5288a0d93d47 admin admin] PATH_INFO: `/v3/projects/e49a6e9553bc43d3a86476500c3ea31e/users/43c38ed2bb2d47838b244e1ae32172cb/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:37.736917 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a6e551-10c1-4f31-b7e6-5288a0d93d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e49a6e9553bc43d3a86476500c3ea31e, user_id=43c38ed2bb2d47838b244e1ae32172cb, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:37.770717 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a6e551-10c1-4f31-b7e6-5288a0d93d47 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:37.789329 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1176/2353] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:09:37 2021] PUT /identity/v3/projects/e49a6e9553bc43d3a86476500c3ea31e/users/43c38ed2bb2d47838b244e1ae32172cb/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:09:37.793564 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b74b9-78e7-4a14-a261-58a2467ca5aa admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:37.813677 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b74b9-78e7-4a14-a261-58a2467ca5aa admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:37.887512 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc11ed8-02a1-4f49-b3f2-04ef62e21bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:37.888220 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc11ed8-02a1-4f49-b3f2-04ef62e21bfe admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:37.888568 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc11ed8-02a1-4f49-b3f2-04ef62e21bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:37.888912 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc11ed8-02a1-4f49-b3f2-04ef62e21bfe admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:37.889669 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc11ed8-02a1-4f49-b3f2-04ef62e21bfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:37.917462 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc11ed8-02a1-4f49-b3f2-04ef62e21bfe admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:37.929885 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1178/2354] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:09:37 2021] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:09:37.933849 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6e551-10c1-4f31-b7e6-5288a0d93d47 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:37.944560 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6e551-10c1-4f31-b7e6-5288a0d93d47 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:37.948862 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d4de0-ed22-4cf3-b5de-5ab15ca63132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:37.949611 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d4de0-ed22-4cf3-b5de-5ab15ca63132 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:37.949901 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d4de0-ed22-4cf3-b5de-5ab15ca63132 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:37.950183 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093d4de0-ed22-4cf3-b5de-5ab15ca63132 admin admin] PATH_INFO: `/v3/projects/e49a6e9553bc43d3a86476500c3ea31e/users/43c38ed2bb2d47838b244e1ae32172cb/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:37.952092 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d4de0-ed22-4cf3-b5de-5ab15ca63132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e49a6e9553bc43d3a86476500c3ea31e, user_id=43c38ed2bb2d47838b244e1ae32172cb, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:37.981421 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093d4de0-ed22-4cf3-b5de-5ab15ca63132 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:37.999649 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1177/2355] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:09:37 2021] PUT /identity/v3/projects/e49a6e9553bc43d3a86476500c3ea31e/users/43c38ed2bb2d47838b244e1ae32172cb/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:09:38.011683 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9d3b5-dadd-4af9-aaea-bef94552671d None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:38.012210 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9d3b5-dadd-4af9-aaea-bef94552671d None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:38.012490 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9d3b5-dadd-4af9-aaea-bef94552671d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:38.053611 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-6aa9d3b5-dadd-4af9-aaea-bef94552671d None None] MFA Rules not processed for user `43c38ed2bb2d47838b244e1ae32172cb`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:09:38.055269 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-6aa9d3b5-dadd-4af9-aaea-bef94552671d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:09:38.144849 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1179/2356] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:09:38 2021] POST /identity/v3/auth/tokens => generated 3745 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:09:38.157100 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d4de0-ed22-4cf3-b5de-5ab15ca63132 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:38.158963 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-093d4de0-ed22-4cf3-b5de-5ab15ca63132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:09:38.244606 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093d4de0-ed22-4cf3-b5de-5ab15ca63132 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:38.249434 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3408b0f-0782-4f44-9d71-581f941f0ded service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:38.250284 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3408b0f-0782-4f44-9d71-581f941f0ded service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:38.250679 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3408b0f-0782-4f44-9d71-581f941f0ded service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:38.251107 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3408b0f-0782-4f44-9d71-581f941f0ded service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:38.264235 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3408b0f-0782-4f44-9d71-581f941f0ded service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:38.293401 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3408b0f-0782-4f44-9d71-581f941f0ded service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:38.304406 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1178/2357] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:09:38 2021] GET /identity/v3/auth/tokens => generated 3745 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:09:38.406915 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9d3b5-dadd-4af9-aaea-bef94552671d None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:38.417607 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9d3b5-dadd-4af9-aaea-bef94552671d None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:38.421272 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ec658-8133-4354-bf3a-c23bd8e5b8bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:38.421866 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ec658-8133-4354-bf3a-c23bd8e5b8bc service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:38.433184 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ec658-8133-4354-bf3a-c23bd8e5b8bc service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:38.433521 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ec658-8133-4354-bf3a-c23bd8e5b8bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:38.519135 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ec658-8133-4354-bf3a-c23bd8e5b8bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:38.545062 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ec658-8133-4354-bf3a-c23bd8e5b8bc service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:38.555457 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1180/2358] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:09:38 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:09:41.022991 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3408b0f-0782-4f44-9d71-581f941f0ded service cinder] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:41.024612 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-b3408b0f-0782-4f44-9d71-581f941f0ded service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:09:41.104113 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3408b0f-0782-4f44-9d71-581f941f0ded service cinder] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:41.108286 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf40c5-8f4e-4f66-9d08-53b25e14f7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:41.109092 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf40c5-8f4e-4f66-9d08-53b25e14f7dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:41.109379 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf40c5-8f4e-4f66-9d08-53b25e14f7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:41.109657 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf40c5-8f4e-4f66-9d08-53b25e14f7dd admin admin] PATH_INFO: `/v3/users/78e8b977173d4eb4b0a32973c8388971` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:41.110732 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf40c5-8f4e-4f66-9d08-53b25e14f7dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=78e8b977173d4eb4b0a32973c8388971)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:41.137043 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf40c5-8f4e-4f66-9d08-53b25e14f7dd admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:41.196687 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-edbf40c5-8f4e-4f66-9d08-53b25e14f7dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78e8b977173d4eb4b0a32973c8388971'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:09:41.213031 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-edbf40c5-8f4e-4f66-9d08-53b25e14f7dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78e8b977173d4eb4b0a32973c8388971'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:09:41.213945 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-edbf40c5-8f4e-4f66-9d08-53b25e14f7dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78e8b977173d4eb4b0a32973c8388971'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:09:41.222157 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-edbf40c5-8f4e-4f66-9d08-53b25e14f7dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78e8b977173d4eb4b0a32973c8388971'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:09:41.230901 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-edbf40c5-8f4e-4f66-9d08-53b25e14f7dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78e8b977173d4eb4b0a32973c8388971'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:09:41.236910 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1179/2359] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:09:41 2021] DELETE /identity/v3/users/78e8b977173d4eb4b0a32973c8388971 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:09:41.471217 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ec658-8133-4354-bf3a-c23bd8e5b8bc service cinder] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:41.482819 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ec658-8133-4354-bf3a-c23bd8e5b8bc service cinder] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:41.547489 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0a183-8f30-4a86-97b8-b6e50a67f091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:41.548286 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0a183-8f30-4a86-97b8-b6e50a67f091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:41.548567 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0a183-8f30-4a86-97b8-b6e50a67f091 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:41.548867 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0a183-8f30-4a86-97b8-b6e50a67f091 admin admin] PATH_INFO: `/v3/projects/332078f71e764c8193f602ddaa78dc81` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:41.550122 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a0a183-8f30-4a86-97b8-b6e50a67f091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=332078f71e764c8193f602ddaa78dc81)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:41.576164 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a0a183-8f30-4a86-97b8-b6e50a67f091 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:41.627831 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-56a0a183-8f30-4a86-97b8-b6e50a67f091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '332078f71e764c8193f602ddaa78dc81', 'request_id': 'req-56a0a183-8f30-4a86-97b8-b6e50a67f091'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:09:41.633051 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-56a0a183-8f30-4a86-97b8-b6e50a67f091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '332078f71e764c8193f602ddaa78dc81', 'request_id': 'req-56a0a183-8f30-4a86-97b8-b6e50a67f091'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:09:41.653603 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-56a0a183-8f30-4a86-97b8-b6e50a67f091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '332078f71e764c8193f602ddaa78dc81', 'request_id': 'req-56a0a183-8f30-4a86-97b8-b6e50a67f091'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:09:41.658257 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-56a0a183-8f30-4a86-97b8-b6e50a67f091 admin admin] The token cache is being invalidate because project 332078f71e764c8193f602ddaa78dc81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:09:41.658543 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-56a0a183-8f30-4a86-97b8-b6e50a67f091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:09:41.659188 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-56a0a183-8f30-4a86-97b8-b6e50a67f091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:09:41.661215 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1181/2360] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:09:41 2021] DELETE /identity/v3/projects/332078f71e764c8193f602ddaa78dc81 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:09:41.666925 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd92fc-90f9-47a2-baa1-1879d648ebe0 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:41.667220 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd92fc-90f9-47a2-baa1-1879d648ebe0 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:41.667530 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd92fc-90f9-47a2-baa1-1879d648ebe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:41.690041 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-3edd92fc-90f9-47a2-baa1-1879d648ebe0 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:09:41.691227 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-3edd92fc-90f9-47a2-baa1-1879d648ebe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:09:41.762786 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1180/2361] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:09:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:09:41.771133 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35688e1c-6ad8-46ad-bd93-d87ef1d934ec None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:41.771458 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35688e1c-6ad8-46ad-bd93-d87ef1d934ec None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:41.771743 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35688e1c-6ad8-46ad-bd93-d87ef1d934ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:41.795113 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-35688e1c-6ad8-46ad-bd93-d87ef1d934ec None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:09:41.796318 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-35688e1c-6ad8-46ad-bd93-d87ef1d934ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:09:41.803977 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1182/2362] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:09:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:09:41.810842 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd92fc-90f9-47a2-baa1-1879d648ebe0 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:41.821894 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd92fc-90f9-47a2-baa1-1879d648ebe0 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:41.828151 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113f7e3-9e9d-4190-ad91-633b4fe33bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:41.828935 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113f7e3-9e9d-4190-ad91-633b4fe33bcb admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:41.829227 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113f7e3-9e9d-4190-ad91-633b4fe33bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:41.829511 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113f7e3-9e9d-4190-ad91-633b4fe33bcb admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:41.830488 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113f7e3-9e9d-4190-ad91-633b4fe33bcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:09:41.830862 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113f7e3-9e9d-4190-ad91-633b4fe33bcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:41.868548 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113f7e3-9e9d-4190-ad91-633b4fe33bcb admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:41.889424 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1181/2363] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:09:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:09:41.891035 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35688e1c-6ad8-46ad-bd93-d87ef1d934ec None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:41.901363 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35688e1c-6ad8-46ad-bd93-d87ef1d934ec None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:41.906179 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970c657-284b-4f21-877c-ab126bdd0641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:41.906796 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970c657-284b-4f21-877c-ab126bdd0641 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:41.907087 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970c657-284b-4f21-877c-ab126bdd0641 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:41.907367 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a970c657-284b-4f21-877c-ab126bdd0641 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:41.908057 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a970c657-284b-4f21-877c-ab126bdd0641 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:41.933897 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a970c657-284b-4f21-877c-ab126bdd0641 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:41.978295 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1183/2364] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:09:41 2021] POST /identity/v3/projects => generated 375 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:09:41.979615 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113f7e3-9e9d-4190-ad91-633b4fe33bcb admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:41.989990 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113f7e3-9e9d-4190-ad91-633b4fe33bcb admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:42.061312 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a81321-d15d-4b15-9156-6b1c405f2663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:42.063379 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a81321-d15d-4b15-9156-6b1c405f2663 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:42.063888 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a81321-d15d-4b15-9156-6b1c405f2663 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:42.064336 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a81321-d15d-4b15-9156-6b1c405f2663 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:42.065749 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a81321-d15d-4b15-9156-6b1c405f2663 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:42.096101 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a81321-d15d-4b15-9156-6b1c405f2663 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:42.117207 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1182/2365] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:09:41 2021] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:09:42.119118 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970c657-284b-4f21-877c-ab126bdd0641 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:42.131309 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a970c657-284b-4f21-877c-ab126bdd0641 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:42.135653 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca6dff-1907-428c-9204-2e6655682270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:42.136262 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca6dff-1907-428c-9204-2e6655682270 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:42.136551 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca6dff-1907-428c-9204-2e6655682270 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:42.136831 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca6dff-1907-428c-9204-2e6655682270 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:42.137529 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca6dff-1907-428c-9204-2e6655682270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:42.162987 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ca6dff-1907-428c-9204-2e6655682270 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:42.174044 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1184/2366] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:09:42 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:09:42.178680 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a81321-d15d-4b15-9156-6b1c405f2663 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:42.188411 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a81321-d15d-4b15-9156-6b1c405f2663 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:42.193831 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc96d4f-9790-40f0-88c0-f3fabd8f887f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:42.194662 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc96d4f-9790-40f0-88c0-f3fabd8f887f admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:42.194953 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc96d4f-9790-40f0-88c0-f3fabd8f887f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:42.195228 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc96d4f-9790-40f0-88c0-f3fabd8f887f admin admin] PATH_INFO: `/v3/projects/16cd4eff02e14dd2bb565b0b65ce8156/users/9e7f42dfb1c443dfa39b62736029931a/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:42.220124 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc96d4f-9790-40f0-88c0-f3fabd8f887f admin admin] RBAC: Authorizing `identity:create_grant(project_id=16cd4eff02e14dd2bb565b0b65ce8156, user_id=9e7f42dfb1c443dfa39b62736029931a, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:42.247358 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc96d4f-9790-40f0-88c0-f3fabd8f887f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:42.268910 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1183/2367] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:09:42 2021] PUT /identity/v3/projects/16cd4eff02e14dd2bb565b0b65ce8156/users/9e7f42dfb1c443dfa39b62736029931a/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:09:42.274139 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2384a28-04ab-49c5-a2ab-f77219262592 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:42.274611 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2384a28-04ab-49c5-a2ab-f77219262592 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:42.274895 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2384a28-04ab-49c5-a2ab-f77219262592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:42.297358 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-d2384a28-04ab-49c5-a2ab-f77219262592 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:09:42.298591 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-d2384a28-04ab-49c5-a2ab-f77219262592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:09:42.364644 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1185/2368] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:09:42 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:09:42.375299 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc96d4f-9790-40f0-88c0-f3fabd8f887f admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:42.377015 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-8cc96d4f-9790-40f0-88c0-f3fabd8f887f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:09:42.522593 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc96d4f-9790-40f0-88c0-f3fabd8f887f admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:42.525887 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61ec85-85f9-43fc-8a07-b625ddafd436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:42.526474 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61ec85-85f9-43fc-8a07-b625ddafd436 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:42.526762 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61ec85-85f9-43fc-8a07-b625ddafd436 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:42.527043 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61ec85-85f9-43fc-8a07-b625ddafd436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:42.537904 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61ec85-85f9-43fc-8a07-b625ddafd436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:42.563403 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61ec85-85f9-43fc-8a07-b625ddafd436 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:42.580403 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1184/2369] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:09:42 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:09:48.171126 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189abef-2616-4c9e-aede-c0b73b5078a5 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:48.171817 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189abef-2616-4c9e-aede-c0b73b5078a5 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:48.171817 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d189abef-2616-4c9e-aede-c0b73b5078a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:48.257103 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-d189abef-2616-4c9e-aede-c0b73b5078a5 None None] MFA Rules not processed for user `9e7f42dfb1c443dfa39b62736029931a`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:09:48.264164 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-d189abef-2616-4c9e-aede-c0b73b5078a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:09:48.420451 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1186/2370] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:09:48 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:09:48.432758 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61ec85-85f9-43fc-8a07-b625ddafd436 service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:09:48.434236 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-5d61ec85-85f9-43fc-8a07-b625ddafd436 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:09:48.656970 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61ec85-85f9-43fc-8a07-b625ddafd436 service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:09:48.662240 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15eb426-e79a-4c84-9e20-2815de8dfb26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:09:48.662832 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15eb426-e79a-4c84-9e20-2815de8dfb26 service nova] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:48.663123 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15eb426-e79a-4c84-9e20-2815de8dfb26 service nova] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:48.663405 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15eb426-e79a-4c84-9e20-2815de8dfb26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:48.672729 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15eb426-e79a-4c84-9e20-2815de8dfb26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:09:48.699376 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15eb426-e79a-4c84-9e20-2815de8dfb26 service nova] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:09:48.710437 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1185/2371] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:09:48 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:09:50.976791 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2ffc4-5e76-40e8-9012-7e2b5f26e0d9 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:09:50.977319 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2ffc4-5e76-40e8-9012-7e2b5f26e0d9 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:09:50.977497 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2ffc4-5e76-40e8-9012-7e2b5f26e0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:09:51.000187 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-29f2ffc4-5e76-40e8-9012-7e2b5f26e0d9 None None] MFA Rules not processed for user `9e7f42dfb1c443dfa39b62736029931a`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:09:51.001431 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-29f2ffc4-5e76-40e8-9012-7e2b5f26e0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:09:51.011641 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1187/2372] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:09:50 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:10:21.885325 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15eb426-e79a-4c84-9e20-2815de8dfb26 service nova] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:21.895378 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15eb426-e79a-4c84-9e20-2815de8dfb26 service nova] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:21.899722 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95179b60-fc75-4c70-b951-5f78603a917d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:21.900311 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95179b60-fc75-4c70-b951-5f78603a917d service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:21.900602 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95179b60-fc75-4c70-b951-5f78603a917d service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:21.900879 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95179b60-fc75-4c70-b951-5f78603a917d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:21.913134 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95179b60-fc75-4c70-b951-5f78603a917d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:21.938635 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95179b60-fc75-4c70-b951-5f78603a917d service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:21.949856 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1186/2373] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:10:21 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:10:27.014790 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2ffc4-5e76-40e8-9012-7e2b5f26e0d9 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:27.016174 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-29f2ffc4-5e76-40e8-9012-7e2b5f26e0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:27.029089 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2ffc4-5e76-40e8-9012-7e2b5f26e0d9 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:27.033591 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2773714-e8b2-4d46-b72d-61eea56e6753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:27.034434 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2773714-e8b2-4d46-b72d-61eea56e6753 service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:27.035419 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2773714-e8b2-4d46-b72d-61eea56e6753 service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:27.035897 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2773714-e8b2-4d46-b72d-61eea56e6753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:27.038185 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-a2773714-e8b2-4d46-b72d-61eea56e6753 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:27.060168 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2773714-e8b2-4d46-b72d-61eea56e6753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:27.109181 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2773714-e8b2-4d46-b72d-61eea56e6753 service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:27.124291 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1188/2374] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:10:27 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:10:28.929057 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95179b60-fc75-4c70-b951-5f78603a917d service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:28.930443 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-95179b60-fc75-4c70-b951-5f78603a917d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:28.942975 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95179b60-fc75-4c70-b951-5f78603a917d service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:28.947191 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3077ff2-2110-43eb-a42a-fdf2907e4af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:28.948026 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3077ff2-2110-43eb-a42a-fdf2907e4af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:28.948312 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3077ff2-2110-43eb-a42a-fdf2907e4af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:28.948591 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3077ff2-2110-43eb-a42a-fdf2907e4af3 admin admin] PATH_INFO: `/v3/users/c3c4a13d658a4a349b07ae6258082a9b` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:28.949723 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3077ff2-2110-43eb-a42a-fdf2907e4af3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3c4a13d658a4a349b07ae6258082a9b)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:28.976257 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3077ff2-2110-43eb-a42a-fdf2907e4af3 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:29.026412 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-f3077ff2-2110-43eb-a42a-fdf2907e4af3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3c4a13d658a4a349b07ae6258082a9b'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:29.038989 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-f3077ff2-2110-43eb-a42a-fdf2907e4af3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3c4a13d658a4a349b07ae6258082a9b'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:29.039640 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-f3077ff2-2110-43eb-a42a-fdf2907e4af3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3c4a13d658a4a349b07ae6258082a9b'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:29.045819 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-f3077ff2-2110-43eb-a42a-fdf2907e4af3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3c4a13d658a4a349b07ae6258082a9b'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:29.053950 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-f3077ff2-2110-43eb-a42a-fdf2907e4af3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3c4a13d658a4a349b07ae6258082a9b'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:29.059679 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1187/2375] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:10:28 2021] DELETE /identity/v3/users/c3c4a13d658a4a349b07ae6258082a9b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:10:29.064076 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a7ac3-9e43-4cb4-b832-7d2102f71add None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:29.064541 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a7ac3-9e43-4cb4-b832-7d2102f71add None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:29.064662 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278a7ac3-9e43-4cb4-b832-7d2102f71add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:29.087542 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-278a7ac3-9e43-4cb4-b832-7d2102f71add None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:10:29.088672 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-278a7ac3-9e43-4cb4-b832-7d2102f71add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:29.151930 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1189/2376] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:10:29 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:10:29.161706 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3077ff2-2110-43eb-a42a-fdf2907e4af3 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:29.162995 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-f3077ff2-2110-43eb-a42a-fdf2907e4af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:29.224269 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3077ff2-2110-43eb-a42a-fdf2907e4af3 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:29.227551 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18184765-ff1e-4407-afb5-778515a58b75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:29.228126 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18184765-ff1e-4407-afb5-778515a58b75 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:29.228406 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18184765-ff1e-4407-afb5-778515a58b75 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:29.228679 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18184765-ff1e-4407-afb5-778515a58b75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:29.237088 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18184765-ff1e-4407-afb5-778515a58b75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:29.262002 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18184765-ff1e-4407-afb5-778515a58b75 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:29.271711 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1188/2377] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:10:29 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:10:29.645009 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a7ac3-9e43-4cb4-b832-7d2102f71add None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:29.648855 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-278a7ac3-9e43-4cb4-b832-7d2102f71add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:29.663194 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278a7ac3-9e43-4cb4-b832-7d2102f71add None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:29.667679 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a715a-f176-4572-8577-fa0d9cef6a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:29.668472 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a715a-f176-4572-8577-fa0d9cef6a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:29.668759 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a715a-f176-4572-8577-fa0d9cef6a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:29.669039 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a715a-f176-4572-8577-fa0d9cef6a79 admin admin] PATH_INFO: `/v3/projects/5cf32a6e07f04a3e8162e2b477e99729` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:29.670161 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a715a-f176-4572-8577-fa0d9cef6a79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cf32a6e07f04a3e8162e2b477e99729)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:29.697359 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a715a-f176-4572-8577-fa0d9cef6a79 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:29.749361 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-0c6a715a-f176-4572-8577-fa0d9cef6a79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cf32a6e07f04a3e8162e2b477e99729', 'request_id': 'req-0c6a715a-f176-4572-8577-fa0d9cef6a79'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:29.754366 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-0c6a715a-f176-4572-8577-fa0d9cef6a79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cf32a6e07f04a3e8162e2b477e99729', 'request_id': 'req-0c6a715a-f176-4572-8577-fa0d9cef6a79'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:29.765285 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-0c6a715a-f176-4572-8577-fa0d9cef6a79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cf32a6e07f04a3e8162e2b477e99729', 'request_id': 'req-0c6a715a-f176-4572-8577-fa0d9cef6a79'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:29.778392 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-0c6a715a-f176-4572-8577-fa0d9cef6a79 admin admin] The token cache is being invalidate because project 5cf32a6e07f04a3e8162e2b477e99729 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:10:29.778504 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-0c6a715a-f176-4572-8577-fa0d9cef6a79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:29.779105 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-0c6a715a-f176-4572-8577-fa0d9cef6a79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:29.780559 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1190/2378] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:10:29 2021] DELETE /identity/v3/projects/5cf32a6e07f04a3e8162e2b477e99729 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:10:29.785122 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18184765-ff1e-4407-afb5-778515a58b75 service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:29.795893 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18184765-ff1e-4407-afb5-778515a58b75 service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:29.861849 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0f427-fcd5-4c0e-a40d-de6977e76a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:29.863459 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0f427-fcd5-4c0e-a40d-de6977e76a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:29.863814 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0f427-fcd5-4c0e-a40d-de6977e76a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:29.864095 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0f427-fcd5-4c0e-a40d-de6977e76a19 admin admin] PATH_INFO: `/v3/users/43c38ed2bb2d47838b244e1ae32172cb` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:29.865210 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad0f427-fcd5-4c0e-a40d-de6977e76a19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43c38ed2bb2d47838b244e1ae32172cb)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:29.890884 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad0f427-fcd5-4c0e-a40d-de6977e76a19 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:29.941940 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-5ad0f427-fcd5-4c0e-a40d-de6977e76a19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43c38ed2bb2d47838b244e1ae32172cb'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:29.953708 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-5ad0f427-fcd5-4c0e-a40d-de6977e76a19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43c38ed2bb2d47838b244e1ae32172cb'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:29.954610 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-5ad0f427-fcd5-4c0e-a40d-de6977e76a19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43c38ed2bb2d47838b244e1ae32172cb'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:29.962205 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-5ad0f427-fcd5-4c0e-a40d-de6977e76a19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43c38ed2bb2d47838b244e1ae32172cb'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:29.971253 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-5ad0f427-fcd5-4c0e-a40d-de6977e76a19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43c38ed2bb2d47838b244e1ae32172cb'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:29.980267 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1189/2379] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:10:29 2021] DELETE /identity/v3/users/43c38ed2bb2d47838b244e1ae32172cb => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:10:30.346803 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a715a-f176-4572-8577-fa0d9cef6a79 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:30.348925 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-0c6a715a-f176-4572-8577-fa0d9cef6a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:30.361671 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a715a-f176-4572-8577-fa0d9cef6a79 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:30.423977 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfadc40a-4274-4821-8d9b-677f7588f532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:30.424768 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadc40a-4274-4821-8d9b-677f7588f532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:30.425048 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadc40a-4274-4821-8d9b-677f7588f532 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:30.425348 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadc40a-4274-4821-8d9b-677f7588f532 admin admin] PATH_INFO: `/v3/projects/e49a6e9553bc43d3a86476500c3ea31e` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:30.426413 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfadc40a-4274-4821-8d9b-677f7588f532 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e49a6e9553bc43d3a86476500c3ea31e)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:30.451854 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfadc40a-4274-4821-8d9b-677f7588f532 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:30.504063 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-bfadc40a-4274-4821-8d9b-677f7588f532 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e49a6e9553bc43d3a86476500c3ea31e', 'request_id': 'req-bfadc40a-4274-4821-8d9b-677f7588f532'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:30.508894 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-bfadc40a-4274-4821-8d9b-677f7588f532 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e49a6e9553bc43d3a86476500c3ea31e', 'request_id': 'req-bfadc40a-4274-4821-8d9b-677f7588f532'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:30.520982 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-bfadc40a-4274-4821-8d9b-677f7588f532 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e49a6e9553bc43d3a86476500c3ea31e', 'request_id': 'req-bfadc40a-4274-4821-8d9b-677f7588f532'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:30.533702 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-bfadc40a-4274-4821-8d9b-677f7588f532 admin admin] The token cache is being invalidate because project e49a6e9553bc43d3a86476500c3ea31e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:10:30.534007 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-bfadc40a-4274-4821-8d9b-677f7588f532 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:30.535091 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-bfadc40a-4274-4821-8d9b-677f7588f532 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:30.536844 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1191/2380] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:10:30 2021] DELETE /identity/v3/projects/e49a6e9553bc43d3a86476500c3ea31e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:10:30.542410 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ddb7fa-a7d2-45e2-9a09-4b9f62bac19a None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:30.542704 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ddb7fa-a7d2-45e2-9a09-4b9f62bac19a None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:30.542983 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ddb7fa-a7d2-45e2-9a09-4b9f62bac19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:30.564986 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-99ddb7fa-a7d2-45e2-9a09-4b9f62bac19a None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:10:30.566149 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-99ddb7fa-a7d2-45e2-9a09-4b9f62bac19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:30.634440 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1190/2381] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:10:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:10:30.642555 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313be204-60a8-4110-bed8-c56314491c69 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:30.642870 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313be204-60a8-4110-bed8-c56314491c69 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:30.643134 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313be204-60a8-4110-bed8-c56314491c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:30.666096 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-313be204-60a8-4110-bed8-c56314491c69 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:10:30.667242 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-313be204-60a8-4110-bed8-c56314491c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:30.674367 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1192/2382] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:10:30 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:10:30.679233 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ddb7fa-a7d2-45e2-9a09-4b9f62bac19a None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:30.688474 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ddb7fa-a7d2-45e2-9a09-4b9f62bac19a None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:30.692866 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bbe1f-2e09-41e1-9ddb-5a704a34f52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:30.693462 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bbe1f-2e09-41e1-9ddb-5a704a34f52f admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:30.693752 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bbe1f-2e09-41e1-9ddb-5a704a34f52f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:30.694033 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bbe1f-2e09-41e1-9ddb-5a704a34f52f admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:30.694750 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bbe1f-2e09-41e1-9ddb-5a704a34f52f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:10:30.695050 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bbe1f-2e09-41e1-9ddb-5a704a34f52f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:30.720275 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bbe1f-2e09-41e1-9ddb-5a704a34f52f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:30.734008 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1191/2383] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:10:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:10:30.738761 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313be204-60a8-4110-bed8-c56314491c69 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:30.747784 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313be204-60a8-4110-bed8-c56314491c69 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:30.752131 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1722f-a24e-4a0a-8659-5a7c319a72ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:30.752722 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1722f-a24e-4a0a-8659-5a7c319a72ad admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:30.753034 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1722f-a24e-4a0a-8659-5a7c319a72ad admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:30.753313 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1722f-a24e-4a0a-8659-5a7c319a72ad admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:30.753947 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1722f-a24e-4a0a-8659-5a7c319a72ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:30.779363 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1722f-a24e-4a0a-8659-5a7c319a72ad admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:30.807754 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1193/2384] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:10:30 2021] POST /identity/v3/projects => generated 379 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:10:30.811915 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bbe1f-2e09-41e1-9ddb-5a704a34f52f admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:30.821679 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bbe1f-2e09-41e1-9ddb-5a704a34f52f admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:30.885717 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17d272-64b7-4d0c-8580-dbcc893ab788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:30.886391 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17d272-64b7-4d0c-8580-dbcc893ab788 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:30.886683 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17d272-64b7-4d0c-8580-dbcc893ab788 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:30.886957 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17d272-64b7-4d0c-8580-dbcc893ab788 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:30.887642 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17d272-64b7-4d0c-8580-dbcc893ab788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:30.914450 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17d272-64b7-4d0c-8580-dbcc893ab788 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:30.935222 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1192/2385] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:10:30 2021] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:10:30.939599 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1722f-a24e-4a0a-8659-5a7c319a72ad admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:30.949561 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1722f-a24e-4a0a-8659-5a7c319a72ad admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:30.954193 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8cfaf-5893-43ca-b03f-923a0630c2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:30.954817 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8cfaf-5893-43ca-b03f-923a0630c2de admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:30.955105 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8cfaf-5893-43ca-b03f-923a0630c2de admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:30.955383 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8cfaf-5893-43ca-b03f-923a0630c2de admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:30.956113 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8cfaf-5893-43ca-b03f-923a0630c2de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:30.982082 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8cfaf-5893-43ca-b03f-923a0630c2de admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:30.993210 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1194/2386] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:10:30 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:10:30.997546 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17d272-64b7-4d0c-8580-dbcc893ab788 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:31.007298 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17d272-64b7-4d0c-8580-dbcc893ab788 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:31.011536 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d13181-0601-4b76-b205-e7bfe8a6842b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:31.012353 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d13181-0601-4b76-b205-e7bfe8a6842b admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:31.012635 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d13181-0601-4b76-b205-e7bfe8a6842b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:31.012910 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d13181-0601-4b76-b205-e7bfe8a6842b admin admin] PATH_INFO: `/v3/projects/ecd3b2cc2cc645fb9f361a317d0f572e/users/fd42160768ad4e5fa69ce7a8e0b31bcd/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:31.033388 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d13181-0601-4b76-b205-e7bfe8a6842b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecd3b2cc2cc645fb9f361a317d0f572e, user_id=fd42160768ad4e5fa69ce7a8e0b31bcd, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:31.060243 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d13181-0601-4b76-b205-e7bfe8a6842b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:31.075332 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1193/2387] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:10:30 2021] PUT /identity/v3/projects/ecd3b2cc2cc645fb9f361a317d0f572e/users/fd42160768ad4e5fa69ce7a8e0b31bcd/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:10:31.087251 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d46db8-7c17-489c-95c8-655c159c7fb9 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:31.087596 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d46db8-7c17-489c-95c8-655c159c7fb9 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:31.087879 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d46db8-7c17-489c-95c8-655c159c7fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:31.125629 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-61d46db8-7c17-489c-95c8-655c159c7fb9 None None] MFA Rules not processed for user `fd42160768ad4e5fa69ce7a8e0b31bcd`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:10:31.126778 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-61d46db8-7c17-489c-95c8-655c159c7fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:31.198715 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1195/2388] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:10:31 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:10:31.203039 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d13181-0601-4b76-b205-e7bfe8a6842b admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:31.271415 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d13181-0601-4b76-b205-e7bfe8a6842b admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:31.275767 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f79a4-a82e-4e02-b1b3-f26f61b11f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:31.276734 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f79a4-a82e-4e02-b1b3-f26f61b11f8c admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:31.277056 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f79a4-a82e-4e02-b1b3-f26f61b11f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:31.277333 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f79a4-a82e-4e02-b1b3-f26f61b11f8c admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:31.277972 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f79a4-a82e-4e02-b1b3-f26f61b11f8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:31.303284 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f79a4-a82e-4e02-b1b3-f26f61b11f8c admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:31.331374 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1194/2389] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:10:31 2021] POST /identity/v3/projects => generated 381 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:10:31.335929 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d46db8-7c17-489c-95c8-655c159c7fb9 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:31.345944 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d46db8-7c17-489c-95c8-655c159c7fb9 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:31.407761 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147ed8a-97ab-480f-822b-293ab6e15a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:31.408440 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147ed8a-97ab-480f-822b-293ab6e15a9f admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:31.408637 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147ed8a-97ab-480f-822b-293ab6e15a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:31.408912 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147ed8a-97ab-480f-822b-293ab6e15a9f admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:31.409551 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147ed8a-97ab-480f-822b-293ab6e15a9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:31.434832 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147ed8a-97ab-480f-822b-293ab6e15a9f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:31.454163 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1196/2390] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:10:31 2021] POST /identity/v3/users => generated 297 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:10:31.458559 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f79a4-a82e-4e02-b1b3-f26f61b11f8c admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:31.475283 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f79a4-a82e-4e02-b1b3-f26f61b11f8c admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:31.480149 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffaf0f3-8553-48c5-9c32-9be7a662afd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:31.480796 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffaf0f3-8553-48c5-9c32-9be7a662afd2 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:31.481130 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffaf0f3-8553-48c5-9c32-9be7a662afd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:31.481493 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffaf0f3-8553-48c5-9c32-9be7a662afd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:31.482240 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffaf0f3-8553-48c5-9c32-9be7a662afd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:31.508534 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffaf0f3-8553-48c5-9c32-9be7a662afd2 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:31.521541 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1195/2391] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:10:31 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:10:31.525902 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147ed8a-97ab-480f-822b-293ab6e15a9f admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:31.535921 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147ed8a-97ab-480f-822b-293ab6e15a9f admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:31.540145 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc7126-a20a-47c0-8e2a-57107c66a1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:31.540948 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc7126-a20a-47c0-8e2a-57107c66a1df admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:31.541230 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc7126-a20a-47c0-8e2a-57107c66a1df admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:31.541506 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abc7126-a20a-47c0-8e2a-57107c66a1df admin admin] PATH_INFO: `/v3/projects/00a0368730284804a5d8dcf42f3a0673/users/0d314671ced241cdacb5f9349c717979/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:31.563108 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc7126-a20a-47c0-8e2a-57107c66a1df admin admin] RBAC: Authorizing `identity:create_grant(project_id=00a0368730284804a5d8dcf42f3a0673, user_id=0d314671ced241cdacb5f9349c717979, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:31.590367 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abc7126-a20a-47c0-8e2a-57107c66a1df admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:31.604273 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1197/2392] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:10:31 2021] PUT /identity/v3/projects/00a0368730284804a5d8dcf42f3a0673/users/0d314671ced241cdacb5f9349c717979/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:10:31.608424 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffaf0f3-8553-48c5-9c32-9be7a662afd2 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:31.619677 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffaf0f3-8553-48c5-9c32-9be7a662afd2 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:31.695649 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029d0bc-421d-4057-81ae-51c7e8aca9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:31.696253 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029d0bc-421d-4057-81ae-51c7e8aca9df admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:31.696535 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029d0bc-421d-4057-81ae-51c7e8aca9df admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:31.696806 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029d0bc-421d-4057-81ae-51c7e8aca9df admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:31.697488 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029d0bc-421d-4057-81ae-51c7e8aca9df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:31.722288 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7029d0bc-421d-4057-81ae-51c7e8aca9df admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:31.732874 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1196/2393] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:10:31 2021] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:10:31.737008 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc7126-a20a-47c0-8e2a-57107c66a1df admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:31.747323 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abc7126-a20a-47c0-8e2a-57107c66a1df admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:31.751587 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d66f06-324b-4157-96f4-710de244260c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:31.752394 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d66f06-324b-4157-96f4-710de244260c admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:31.752678 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d66f06-324b-4157-96f4-710de244260c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:31.752968 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d66f06-324b-4157-96f4-710de244260c admin admin] PATH_INFO: `/v3/projects/00a0368730284804a5d8dcf42f3a0673/users/0d314671ced241cdacb5f9349c717979/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:31.755271 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d66f06-324b-4157-96f4-710de244260c admin admin] RBAC: Authorizing `identity:create_grant(project_id=00a0368730284804a5d8dcf42f3a0673, user_id=0d314671ced241cdacb5f9349c717979, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:31.781749 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d66f06-324b-4157-96f4-710de244260c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:31.792229 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1198/2394] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:10:31 2021] PUT /identity/v3/projects/00a0368730284804a5d8dcf42f3a0673/users/0d314671ced241cdacb5f9349c717979/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:10:31.796323 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029d0bc-421d-4057-81ae-51c7e8aca9df admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:31.806269 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7029d0bc-421d-4057-81ae-51c7e8aca9df admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:31.873006 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3e336-5c36-4135-a6a6-6c81c6d33d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:31.873611 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3e336-5c36-4135-a6a6-6c81c6d33d95 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:31.873898 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3e336-5c36-4135-a6a6-6c81c6d33d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:31.874181 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3e336-5c36-4135-a6a6-6c81c6d33d95 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:31.874870 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e3e336-5c36-4135-a6a6-6c81c6d33d95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:31.900458 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e3e336-5c36-4135-a6a6-6c81c6d33d95 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:31.911412 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1197/2395] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:10:31 2021] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:10:31.915719 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d66f06-324b-4157-96f4-710de244260c admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:31.926119 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d66f06-324b-4157-96f4-710de244260c admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:31.930302 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7216b-3a7e-4416-8138-8d2608c3e484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:31.931102 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7216b-3a7e-4416-8138-8d2608c3e484 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:31.931384 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7216b-3a7e-4416-8138-8d2608c3e484 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:31.931685 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c7216b-3a7e-4416-8138-8d2608c3e484 admin admin] PATH_INFO: `/v3/projects/00a0368730284804a5d8dcf42f3a0673/users/0d314671ced241cdacb5f9349c717979/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:31.933455 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7216b-3a7e-4416-8138-8d2608c3e484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00a0368730284804a5d8dcf42f3a0673, user_id=0d314671ced241cdacb5f9349c717979, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:31.960335 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c7216b-3a7e-4416-8138-8d2608c3e484 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:31.974927 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1199/2396] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:10:31 2021] PUT /identity/v3/projects/00a0368730284804a5d8dcf42f3a0673/users/0d314671ced241cdacb5f9349c717979/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:10:31.984796 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6640df4-29a1-47b5-a5bc-26a3793af1bd None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:31.985071 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6640df4-29a1-47b5-a5bc-26a3793af1bd None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:31.985347 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6640df4-29a1-47b5-a5bc-26a3793af1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:32.023232 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-b6640df4-29a1-47b5-a5bc-26a3793af1bd None None] MFA Rules not processed for user `0d314671ced241cdacb5f9349c717979`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:10:32.024418 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-b6640df4-29a1-47b5-a5bc-26a3793af1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:32.102089 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1198/2397] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:10:31 2021] POST /identity/v3/auth/tokens => generated 3755 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:10:32.107735 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7216b-3a7e-4416-8138-8d2608c3e484 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:32.178906 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c7216b-3a7e-4416-8138-8d2608c3e484 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:32.183186 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d40992-a64c-47eb-b944-f33f88567215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:32.184020 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d40992-a64c-47eb-b944-f33f88567215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:32.184306 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d40992-a64c-47eb-b944-f33f88567215 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:32.184591 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d40992-a64c-47eb-b944-f33f88567215 admin admin] PATH_INFO: `/v3/users/fd42160768ad4e5fa69ce7a8e0b31bcd` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:32.185670 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d40992-a64c-47eb-b944-f33f88567215 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd42160768ad4e5fa69ce7a8e0b31bcd)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:32.211183 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d40992-a64c-47eb-b944-f33f88567215 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:32.261038 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-26d40992-a64c-47eb-b944-f33f88567215 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd42160768ad4e5fa69ce7a8e0b31bcd'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:32.261679 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-26d40992-a64c-47eb-b944-f33f88567215 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd42160768ad4e5fa69ce7a8e0b31bcd'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:32.273851 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-26d40992-a64c-47eb-b944-f33f88567215 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd42160768ad4e5fa69ce7a8e0b31bcd'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:32.284963 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-26d40992-a64c-47eb-b944-f33f88567215 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd42160768ad4e5fa69ce7a8e0b31bcd'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:32.294084 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-26d40992-a64c-47eb-b944-f33f88567215 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd42160768ad4e5fa69ce7a8e0b31bcd'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:32.301002 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1200/2398] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:10:32 2021] DELETE /identity/v3/users/fd42160768ad4e5fa69ce7a8e0b31bcd => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:10:32.306722 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78020bb1-0d34-404a-9a73-4a92a46209be None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:32.307130 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78020bb1-0d34-404a-9a73-4a92a46209be None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:32.307543 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78020bb1-0d34-404a-9a73-4a92a46209be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:32.332803 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-78020bb1-0d34-404a-9a73-4a92a46209be None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:10:32.334098 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-78020bb1-0d34-404a-9a73-4a92a46209be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:32.405601 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1199/2399] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:10:32 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:10:32.412654 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d40992-a64c-47eb-b944-f33f88567215 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:32.414122 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-26d40992-a64c-47eb-b944-f33f88567215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:32.482349 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d40992-a64c-47eb-b944-f33f88567215 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:32.485802 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd190175-51ef-4b86-a2b4-0cb9bf805b3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:32.486396 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd190175-51ef-4b86-a2b4-0cb9bf805b3b service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:32.486683 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd190175-51ef-4b86-a2b4-0cb9bf805b3b service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:32.486961 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd190175-51ef-4b86-a2b4-0cb9bf805b3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:32.497628 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd190175-51ef-4b86-a2b4-0cb9bf805b3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:32.523286 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd190175-51ef-4b86-a2b4-0cb9bf805b3b service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:32.533570 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1201/2400] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:10:32 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:10:32.890940 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78020bb1-0d34-404a-9a73-4a92a46209be None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:32.892443 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-78020bb1-0d34-404a-9a73-4a92a46209be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:32.903740 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78020bb1-0d34-404a-9a73-4a92a46209be None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:32.908085 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931a4ee-9184-412b-b4c1-3c29fac8b6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:32.908877 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931a4ee-9184-412b-b4c1-3c29fac8b6e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:32.909199 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931a4ee-9184-412b-b4c1-3c29fac8b6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:32.910033 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931a4ee-9184-412b-b4c1-3c29fac8b6e6 admin admin] PATH_INFO: `/v3/projects/ecd3b2cc2cc645fb9f361a317d0f572e` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:32.911044 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931a4ee-9184-412b-b4c1-3c29fac8b6e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecd3b2cc2cc645fb9f361a317d0f572e)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:32.937035 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931a4ee-9184-412b-b4c1-3c29fac8b6e6 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:32.990064 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-8931a4ee-9184-412b-b4c1-3c29fac8b6e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecd3b2cc2cc645fb9f361a317d0f572e', 'request_id': 'req-8931a4ee-9184-412b-b4c1-3c29fac8b6e6'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:32.995577 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-8931a4ee-9184-412b-b4c1-3c29fac8b6e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecd3b2cc2cc645fb9f361a317d0f572e', 'request_id': 'req-8931a4ee-9184-412b-b4c1-3c29fac8b6e6'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:33.006386 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-8931a4ee-9184-412b-b4c1-3c29fac8b6e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecd3b2cc2cc645fb9f361a317d0f572e', 'request_id': 'req-8931a4ee-9184-412b-b4c1-3c29fac8b6e6'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:33.018304 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-8931a4ee-9184-412b-b4c1-3c29fac8b6e6 admin admin] The token cache is being invalidate because project ecd3b2cc2cc645fb9f361a317d0f572e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:10:33.018592 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-8931a4ee-9184-412b-b4c1-3c29fac8b6e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:33.019182 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-8931a4ee-9184-412b-b4c1-3c29fac8b6e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:33.020852 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1200/2401] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:10:32 2021] DELETE /identity/v3/projects/ecd3b2cc2cc645fb9f361a317d0f572e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:10:33.024710 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd190175-51ef-4b86-a2b4-0cb9bf805b3b service neutron] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:33.034243 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd190175-51ef-4b86-a2b4-0cb9bf805b3b service neutron] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:33.098490 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4dfa6f-1c9c-463d-b5fa-6f3c5a5c4316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:33.099290 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4dfa6f-1c9c-463d-b5fa-6f3c5a5c4316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:33.099619 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4dfa6f-1c9c-463d-b5fa-6f3c5a5c4316 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:33.099899 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4dfa6f-1c9c-463d-b5fa-6f3c5a5c4316 admin admin] PATH_INFO: `/v3/users/0d314671ced241cdacb5f9349c717979` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:33.101027 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4dfa6f-1c9c-463d-b5fa-6f3c5a5c4316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d314671ced241cdacb5f9349c717979)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:33.126806 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4dfa6f-1c9c-463d-b5fa-6f3c5a5c4316 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:33.176013 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-cb4dfa6f-1c9c-463d-b5fa-6f3c5a5c4316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d314671ced241cdacb5f9349c717979'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:33.176545 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-cb4dfa6f-1c9c-463d-b5fa-6f3c5a5c4316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d314671ced241cdacb5f9349c717979'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:33.191374 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-cb4dfa6f-1c9c-463d-b5fa-6f3c5a5c4316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d314671ced241cdacb5f9349c717979'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:33.195934 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-cb4dfa6f-1c9c-463d-b5fa-6f3c5a5c4316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d314671ced241cdacb5f9349c717979'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:33.203678 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-cb4dfa6f-1c9c-463d-b5fa-6f3c5a5c4316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d314671ced241cdacb5f9349c717979'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:33.210049 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1202/2402] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:10:33 2021] DELETE /identity/v3/users/0d314671ced241cdacb5f9349c717979 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:10:33.632979 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931a4ee-9184-412b-b4c1-3c29fac8b6e6 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:33.634454 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-8931a4ee-9184-412b-b4c1-3c29fac8b6e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:33.647406 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931a4ee-9184-412b-b4c1-3c29fac8b6e6 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:33.710671 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b96a2-f5f5-4e29-bd3d-c211223a1b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:33.711383 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b96a2-f5f5-4e29-bd3d-c211223a1b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:33.711702 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b96a2-f5f5-4e29-bd3d-c211223a1b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:33.711992 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b96a2-f5f5-4e29-bd3d-c211223a1b83 admin admin] PATH_INFO: `/v3/projects/00a0368730284804a5d8dcf42f3a0673` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:33.713087 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b96a2-f5f5-4e29-bd3d-c211223a1b83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00a0368730284804a5d8dcf42f3a0673)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:33.740221 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b96a2-f5f5-4e29-bd3d-c211223a1b83 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:33.801396 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-484b96a2-f5f5-4e29-bd3d-c211223a1b83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00a0368730284804a5d8dcf42f3a0673', 'request_id': 'req-484b96a2-f5f5-4e29-bd3d-c211223a1b83'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:33.806373 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-484b96a2-f5f5-4e29-bd3d-c211223a1b83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00a0368730284804a5d8dcf42f3a0673', 'request_id': 'req-484b96a2-f5f5-4e29-bd3d-c211223a1b83'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:33.818826 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-484b96a2-f5f5-4e29-bd3d-c211223a1b83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00a0368730284804a5d8dcf42f3a0673', 'request_id': 'req-484b96a2-f5f5-4e29-bd3d-c211223a1b83'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:33.834327 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-484b96a2-f5f5-4e29-bd3d-c211223a1b83 admin admin] The token cache is being invalidate because project 00a0368730284804a5d8dcf42f3a0673 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:10:33.834678 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-484b96a2-f5f5-4e29-bd3d-c211223a1b83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:33.835314 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-484b96a2-f5f5-4e29-bd3d-c211223a1b83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:33.836785 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1201/2403] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:10:33 2021] DELETE /identity/v3/projects/00a0368730284804a5d8dcf42f3a0673 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:10:33.842706 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022984a-f04c-4c58-b496-f21cf9ac08ef None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:33.843257 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022984a-f04c-4c58-b496-f21cf9ac08ef None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:33.843574 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c022984a-f04c-4c58-b496-f21cf9ac08ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:33.870932 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-c022984a-f04c-4c58-b496-f21cf9ac08ef None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:10:33.872145 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-c022984a-f04c-4c58-b496-f21cf9ac08ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:33.936947 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1203/2404] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:10:33 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:10:33.945455 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071b740-c440-42ce-8f44-aeb01bd8a790 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:33.945743 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071b740-c440-42ce-8f44-aeb01bd8a790 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:33.946017 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071b740-c440-42ce-8f44-aeb01bd8a790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:33.967460 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-5071b740-c440-42ce-8f44-aeb01bd8a790 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:10:33.968538 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-5071b740-c440-42ce-8f44-aeb01bd8a790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:33.975917 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1202/2405] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:10:33 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:10:33.980162 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022984a-f04c-4c58-b496-f21cf9ac08ef None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:33.990026 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c022984a-f04c-4c58-b496-f21cf9ac08ef None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:33.994246 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7dd5a-dffc-4625-b326-82f1506b61dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:33.994854 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7dd5a-dffc-4625-b326-82f1506b61dd admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:33.995137 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7dd5a-dffc-4625-b326-82f1506b61dd admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:33.995412 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7dd5a-dffc-4625-b326-82f1506b61dd admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:33.996117 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7dd5a-dffc-4625-b326-82f1506b61dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:10:33.996407 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7dd5a-dffc-4625-b326-82f1506b61dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:34.021993 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7dd5a-dffc-4625-b326-82f1506b61dd admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:34.035498 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1204/2406] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:10:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:10:34.039856 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071b740-c440-42ce-8f44-aeb01bd8a790 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:34.048326 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071b740-c440-42ce-8f44-aeb01bd8a790 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:34.054068 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8b4ad-b084-4f7f-b50c-0ef9017cf24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:34.054637 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8b4ad-b084-4f7f-b50c-0ef9017cf24d admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:34.054924 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8b4ad-b084-4f7f-b50c-0ef9017cf24d admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:34.055197 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8b4ad-b084-4f7f-b50c-0ef9017cf24d admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:34.055843 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8b4ad-b084-4f7f-b50c-0ef9017cf24d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:34.081363 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8b4ad-b084-4f7f-b50c-0ef9017cf24d admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:34.106972 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1203/2407] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:10:34 2021] POST /identity/v3/projects => generated 387 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:10:34.111065 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7dd5a-dffc-4625-b326-82f1506b61dd admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:34.121142 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7dd5a-dffc-4625-b326-82f1506b61dd admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:34.269765 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be46266-8b51-4a78-ad62-5fee977c5814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:34.271079 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be46266-8b51-4a78-ad62-5fee977c5814 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:34.271079 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be46266-8b51-4a78-ad62-5fee977c5814 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:34.271651 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be46266-8b51-4a78-ad62-5fee977c5814 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:34.272381 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be46266-8b51-4a78-ad62-5fee977c5814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:34.306405 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be46266-8b51-4a78-ad62-5fee977c5814 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:34.327788 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1205/2408] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:10:34 2021] POST /identity/v3/users => generated 294 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:10:34.332051 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8b4ad-b084-4f7f-b50c-0ef9017cf24d admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:34.341486 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8b4ad-b084-4f7f-b50c-0ef9017cf24d admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:34.345606 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d43433-2b1a-4de2-bd0b-9abd226621ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:34.346200 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d43433-2b1a-4de2-bd0b-9abd226621ae admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:34.346483 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d43433-2b1a-4de2-bd0b-9abd226621ae admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:34.346757 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d43433-2b1a-4de2-bd0b-9abd226621ae admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:34.351567 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d43433-2b1a-4de2-bd0b-9abd226621ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:34.373513 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d43433-2b1a-4de2-bd0b-9abd226621ae admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:34.384015 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1204/2409] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:10:34 2021] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:10:34.388005 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be46266-8b51-4a78-ad62-5fee977c5814 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:34.397756 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be46266-8b51-4a78-ad62-5fee977c5814 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:34.402391 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bb0ea-ed2b-4442-8f47-49e9aa51a1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:34.403229 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bb0ea-ed2b-4442-8f47-49e9aa51a1a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:34.403535 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bb0ea-ed2b-4442-8f47-49e9aa51a1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:34.403819 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1bb0ea-ed2b-4442-8f47-49e9aa51a1a9 admin admin] PATH_INFO: `/v3/projects/ee4499771c064f3ca90617210c5de181/users/27580ec5196a4a07a97a70321d9bad70/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:34.423750 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1bb0ea-ed2b-4442-8f47-49e9aa51a1a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee4499771c064f3ca90617210c5de181, user_id=27580ec5196a4a07a97a70321d9bad70, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:34.450119 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1bb0ea-ed2b-4442-8f47-49e9aa51a1a9 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:34.473430 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1206/2410] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:10:34 2021] PUT /identity/v3/projects/ee4499771c064f3ca90617210c5de181/users/27580ec5196a4a07a97a70321d9bad70/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:10:34.475053 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086f4b4-f0b9-4754-b25a-a9f32843ed2f None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:34.475340 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086f4b4-f0b9-4754-b25a-a9f32843ed2f None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:34.475651 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086f4b4-f0b9-4754-b25a-a9f32843ed2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:34.514756 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-c086f4b4-f0b9-4754-b25a-a9f32843ed2f None None] MFA Rules not processed for user `27580ec5196a4a07a97a70321d9bad70`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:10:34.515864 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-c086f4b4-f0b9-4754-b25a-a9f32843ed2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:34.594108 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1205/2411] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:10:34 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:10:34.599367 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bb0ea-ed2b-4442-8f47-49e9aa51a1a9 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:34.689220 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1bb0ea-ed2b-4442-8f47-49e9aa51a1a9 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:34.694566 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fb9ca-d63a-48b4-808f-5bb4c788419f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:34.695422 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fb9ca-d63a-48b4-808f-5bb4c788419f admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:34.695945 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fb9ca-d63a-48b4-808f-5bb4c788419f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:34.696392 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42fb9ca-d63a-48b4-808f-5bb4c788419f admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:34.697246 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fb9ca-d63a-48b4-808f-5bb4c788419f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:34.725625 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42fb9ca-d63a-48b4-808f-5bb4c788419f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:34.756880 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1207/2412] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:10:34 2021] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:10:34.761961 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086f4b4-f0b9-4754-b25a-a9f32843ed2f None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:34.775994 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086f4b4-f0b9-4754-b25a-a9f32843ed2f None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:34.868901 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a5614-84f7-4796-b15a-c6334fc6bdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:34.868901 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a5614-84f7-4796-b15a-c6334fc6bdaf admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:34.868901 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a5614-84f7-4796-b15a-c6334fc6bdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:34.868901 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a5614-84f7-4796-b15a-c6334fc6bdaf admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:34.870055 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a5614-84f7-4796-b15a-c6334fc6bdaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:34.898735 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a5614-84f7-4796-b15a-c6334fc6bdaf admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:34.928131 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1206/2413] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:10:34 2021] POST /identity/v3/users => generated 299 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:10:34.929596 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fb9ca-d63a-48b4-808f-5bb4c788419f admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:34.943156 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42fb9ca-d63a-48b4-808f-5bb4c788419f admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:34.949971 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8815a5a-d5b0-4ef2-aafa-658031fe1c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:34.950584 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8815a5a-d5b0-4ef2-aafa-658031fe1c5e admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:34.950868 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8815a5a-d5b0-4ef2-aafa-658031fe1c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:34.951148 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8815a5a-d5b0-4ef2-aafa-658031fe1c5e admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:34.951891 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8815a5a-d5b0-4ef2-aafa-658031fe1c5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:34.979165 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8815a5a-d5b0-4ef2-aafa-658031fe1c5e admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:34.991776 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1208/2414] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:10:34 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:10:34.996059 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a5614-84f7-4796-b15a-c6334fc6bdaf admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:35.006296 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a5614-84f7-4796-b15a-c6334fc6bdaf admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:35.010936 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc5c9e-f114-4135-bc76-09e1a5290d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:35.011826 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc5c9e-f114-4135-bc76-09e1a5290d4a admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:35.012111 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc5c9e-f114-4135-bc76-09e1a5290d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:35.012395 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc5c9e-f114-4135-bc76-09e1a5290d4a admin admin] PATH_INFO: `/v3/projects/0e74ebef149b42ab9828f364cbe14253/users/9920698e35d441a5aed140cf14607db9/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:35.036026 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc5c9e-f114-4135-bc76-09e1a5290d4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e74ebef149b42ab9828f364cbe14253, user_id=9920698e35d441a5aed140cf14607db9, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:35.063461 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc5c9e-f114-4135-bc76-09e1a5290d4a admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:35.079806 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1207/2415] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:10:34 2021] PUT /identity/v3/projects/0e74ebef149b42ab9828f364cbe14253/users/9920698e35d441a5aed140cf14607db9/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:10:35.084532 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8815a5a-d5b0-4ef2-aafa-658031fe1c5e admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:35.095127 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8815a5a-d5b0-4ef2-aafa-658031fe1c5e admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:35.166529 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd2806-2b00-45d4-a9bc-80bf89495e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:35.167961 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd2806-2b00-45d4-a9bc-80bf89495e3e admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:35.168334 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd2806-2b00-45d4-a9bc-80bf89495e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:35.168814 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd2806-2b00-45d4-a9bc-80bf89495e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:35.169551 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd2806-2b00-45d4-a9bc-80bf89495e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:35.196756 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbd2806-2b00-45d4-a9bc-80bf89495e3e admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:35.210860 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1209/2416] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:10:35 2021] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:10:35.212239 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc5c9e-f114-4135-bc76-09e1a5290d4a admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:35.222850 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc5c9e-f114-4135-bc76-09e1a5290d4a admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:35.227764 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13f5f0-3fa5-42b7-b926-305cb4244450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:35.228587 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13f5f0-3fa5-42b7-b926-305cb4244450 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:35.228876 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13f5f0-3fa5-42b7-b926-305cb4244450 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:35.229158 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13f5f0-3fa5-42b7-b926-305cb4244450 admin admin] PATH_INFO: `/v3/projects/0e74ebef149b42ab9828f364cbe14253/users/9920698e35d441a5aed140cf14607db9/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:35.231096 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13f5f0-3fa5-42b7-b926-305cb4244450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e74ebef149b42ab9828f364cbe14253, user_id=9920698e35d441a5aed140cf14607db9, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:35.259485 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13f5f0-3fa5-42b7-b926-305cb4244450 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:35.271683 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1208/2417] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:10:35 2021] PUT /identity/v3/projects/0e74ebef149b42ab9828f364cbe14253/users/9920698e35d441a5aed140cf14607db9/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:10:35.275387 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd2806-2b00-45d4-a9bc-80bf89495e3e admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:35.285267 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd2806-2b00-45d4-a9bc-80bf89495e3e admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:35.352391 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418dd4b6-9a28-4b1f-8055-8a83e2319d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:35.353008 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418dd4b6-9a28-4b1f-8055-8a83e2319d1c admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:35.353296 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418dd4b6-9a28-4b1f-8055-8a83e2319d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:35.353577 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418dd4b6-9a28-4b1f-8055-8a83e2319d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:35.354282 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418dd4b6-9a28-4b1f-8055-8a83e2319d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:35.380608 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418dd4b6-9a28-4b1f-8055-8a83e2319d1c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:35.391167 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1210/2418] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:10:35 2021] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:10:35.395786 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13f5f0-3fa5-42b7-b926-305cb4244450 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:35.407364 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13f5f0-3fa5-42b7-b926-305cb4244450 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:35.414470 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0580f0e-3010-4eb4-8ff3-741a9e6d582b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:35.415881 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0580f0e-3010-4eb4-8ff3-741a9e6d582b admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:35.416418 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0580f0e-3010-4eb4-8ff3-741a9e6d582b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:35.416918 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0580f0e-3010-4eb4-8ff3-741a9e6d582b admin admin] PATH_INFO: `/v3/projects/0e74ebef149b42ab9828f364cbe14253/users/9920698e35d441a5aed140cf14607db9/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:35.419895 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0580f0e-3010-4eb4-8ff3-741a9e6d582b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e74ebef149b42ab9828f364cbe14253, user_id=9920698e35d441a5aed140cf14607db9, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:35.481954 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0580f0e-3010-4eb4-8ff3-741a9e6d582b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:35.505982 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1209/2419] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:10:35 2021] PUT /identity/v3/projects/0e74ebef149b42ab9828f364cbe14253/users/9920698e35d441a5aed140cf14607db9/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:10:35.521917 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf860b-c52e-4891-badb-539aa773ea3e None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:35.522206 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf860b-c52e-4891-badb-539aa773ea3e None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:35.522511 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf860b-c52e-4891-badb-539aa773ea3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:35.559776 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-3bcf860b-c52e-4891-badb-539aa773ea3e None None] MFA Rules not processed for user `9920698e35d441a5aed140cf14607db9`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:10:35.560844 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-3bcf860b-c52e-4891-badb-539aa773ea3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:35.640262 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1211/2420] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:10:35 2021] POST /identity/v3/auth/tokens => generated 3759 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:10:35.650152 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0580f0e-3010-4eb4-8ff3-741a9e6d582b admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:35.652045 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-f0580f0e-3010-4eb4-8ff3-741a9e6d582b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:35.718825 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0580f0e-3010-4eb4-8ff3-741a9e6d582b admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:35.722690 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e048b92-fc0f-4d98-ad6b-2476da8821f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:35.723266 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e048b92-fc0f-4d98-ad6b-2476da8821f7 service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:35.723579 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e048b92-fc0f-4d98-ad6b-2476da8821f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:35.723856 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e048b92-fc0f-4d98-ad6b-2476da8821f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:35.732620 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e048b92-fc0f-4d98-ad6b-2476da8821f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:35.757749 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e048b92-fc0f-4d98-ad6b-2476da8821f7 service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:35.767287 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1210/2421] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:10:35 2021] GET /identity/v3/auth/tokens => generated 3759 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:10:35.793138 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf860b-c52e-4891-badb-539aa773ea3e None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:35.879080 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf860b-c52e-4891-badb-539aa773ea3e None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:35.883234 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221f77f-44c9-4d18-b643-da94aa96d13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:35.884101 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221f77f-44c9-4d18-b643-da94aa96d13a admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:35.884386 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221f77f-44c9-4d18-b643-da94aa96d13a admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:35.884660 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221f77f-44c9-4d18-b643-da94aa96d13a admin admin] PATH_INFO: `/v3/users/27580ec5196a4a07a97a70321d9bad70` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:35.886274 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4221f77f-44c9-4d18-b643-da94aa96d13a admin admin] RBAC: Authorizing `identity:delete_user(user_id=27580ec5196a4a07a97a70321d9bad70)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:35.912629 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4221f77f-44c9-4d18-b643-da94aa96d13a admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:35.960780 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-4221f77f-44c9-4d18-b643-da94aa96d13a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27580ec5196a4a07a97a70321d9bad70'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:35.961515 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-4221f77f-44c9-4d18-b643-da94aa96d13a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27580ec5196a4a07a97a70321d9bad70'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:35.974677 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-4221f77f-44c9-4d18-b643-da94aa96d13a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27580ec5196a4a07a97a70321d9bad70'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:35.982698 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-4221f77f-44c9-4d18-b643-da94aa96d13a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27580ec5196a4a07a97a70321d9bad70'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:35.991027 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-4221f77f-44c9-4d18-b643-da94aa96d13a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27580ec5196a4a07a97a70321d9bad70'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:35.998131 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1212/2422] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:10:35 2021] DELETE /identity/v3/users/27580ec5196a4a07a97a70321d9bad70 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:10:36.002630 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49c1ea-f188-492e-b627-aad4835cb652 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:36.002922 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49c1ea-f188-492e-b627-aad4835cb652 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:36.003263 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49c1ea-f188-492e-b627-aad4835cb652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:36.026825 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-9d49c1ea-f188-492e-b627-aad4835cb652 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:10:36.028004 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-9d49c1ea-f188-492e-b627-aad4835cb652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:36.098335 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1211/2423] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:10:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:10:36.109639 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221f77f-44c9-4d18-b643-da94aa96d13a admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:36.112966 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-4221f77f-44c9-4d18-b643-da94aa96d13a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:36.198963 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221f77f-44c9-4d18-b643-da94aa96d13a admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:36.203531 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3074b-181a-4f3f-b02e-0b77d3737323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:36.204394 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3074b-181a-4f3f-b02e-0b77d3737323 service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:36.204816 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3074b-181a-4f3f-b02e-0b77d3737323 service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:36.207623 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3074b-181a-4f3f-b02e-0b77d3737323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:36.219079 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3074b-181a-4f3f-b02e-0b77d3737323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:36.251581 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3074b-181a-4f3f-b02e-0b77d3737323 service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:36.265784 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1213/2424] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:10:36 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:10:36.725250 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49c1ea-f188-492e-b627-aad4835cb652 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:36.726998 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-9d49c1ea-f188-492e-b627-aad4835cb652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:36.738841 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49c1ea-f188-492e-b627-aad4835cb652 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:36.744360 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9f6b8-4952-4599-ac91-f9b551b553cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:36.745458 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9f6b8-4952-4599-ac91-f9b551b553cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:36.745809 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9f6b8-4952-4599-ac91-f9b551b553cc admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:36.746180 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9f6b8-4952-4599-ac91-f9b551b553cc admin admin] PATH_INFO: `/v3/projects/ee4499771c064f3ca90617210c5de181` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:36.747372 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9f6b8-4952-4599-ac91-f9b551b553cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee4499771c064f3ca90617210c5de181)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:36.773900 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9f6b8-4952-4599-ac91-f9b551b553cc admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:36.832937 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-7cf9f6b8-4952-4599-ac91-f9b551b553cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee4499771c064f3ca90617210c5de181', 'request_id': 'req-7cf9f6b8-4952-4599-ac91-f9b551b553cc'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:36.837852 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-7cf9f6b8-4952-4599-ac91-f9b551b553cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee4499771c064f3ca90617210c5de181', 'request_id': 'req-7cf9f6b8-4952-4599-ac91-f9b551b553cc'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:36.849225 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-7cf9f6b8-4952-4599-ac91-f9b551b553cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee4499771c064f3ca90617210c5de181', 'request_id': 'req-7cf9f6b8-4952-4599-ac91-f9b551b553cc'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:36.862026 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-7cf9f6b8-4952-4599-ac91-f9b551b553cc admin admin] The token cache is being invalidate because project ee4499771c064f3ca90617210c5de181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:10:36.862313 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-7cf9f6b8-4952-4599-ac91-f9b551b553cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:36.863428 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-7cf9f6b8-4952-4599-ac91-f9b551b553cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:36.867432 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1212/2425] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:10:36 2021] DELETE /identity/v3/projects/ee4499771c064f3ca90617210c5de181 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:10:36.869001 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3074b-181a-4f3f-b02e-0b77d3737323 service neutron] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:36.878858 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3074b-181a-4f3f-b02e-0b77d3737323 service neutron] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:36.944251 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce08bc-811a-49a8-a3ff-349372d30637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:36.945066 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce08bc-811a-49a8-a3ff-349372d30637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:36.945354 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce08bc-811a-49a8-a3ff-349372d30637 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:36.945633 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce08bc-811a-49a8-a3ff-349372d30637 admin admin] PATH_INFO: `/v3/users/9920698e35d441a5aed140cf14607db9` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:36.946763 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce08bc-811a-49a8-a3ff-349372d30637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9920698e35d441a5aed140cf14607db9)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:36.972565 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce08bc-811a-49a8-a3ff-349372d30637 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:37.022385 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-71ce08bc-811a-49a8-a3ff-349372d30637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9920698e35d441a5aed140cf14607db9'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:37.023018 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-71ce08bc-811a-49a8-a3ff-349372d30637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9920698e35d441a5aed140cf14607db9'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:37.034706 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-71ce08bc-811a-49a8-a3ff-349372d30637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9920698e35d441a5aed140cf14607db9'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:37.041940 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-71ce08bc-811a-49a8-a3ff-349372d30637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9920698e35d441a5aed140cf14607db9'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:37.049666 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-71ce08bc-811a-49a8-a3ff-349372d30637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9920698e35d441a5aed140cf14607db9'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:37.056150 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1214/2426] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:10:36 2021] DELETE /identity/v3/users/9920698e35d441a5aed140cf14607db9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:10:37.419474 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9f6b8-4952-4599-ac91-f9b551b553cc admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:37.421256 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-7cf9f6b8-4952-4599-ac91-f9b551b553cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:37.439056 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9f6b8-4952-4599-ac91-f9b551b553cc admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:37.515092 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e465a-4aff-49f3-8089-8b7146e716ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:37.515922 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e465a-4aff-49f3-8089-8b7146e716ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:37.516204 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e465a-4aff-49f3-8089-8b7146e716ee admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:37.516481 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e465a-4aff-49f3-8089-8b7146e716ee admin admin] PATH_INFO: `/v3/projects/0e74ebef149b42ab9828f364cbe14253` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:37.517551 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e465a-4aff-49f3-8089-8b7146e716ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e74ebef149b42ab9828f364cbe14253)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:37.543881 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e465a-4aff-49f3-8089-8b7146e716ee admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:37.594216 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-cf4e465a-4aff-49f3-8089-8b7146e716ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e74ebef149b42ab9828f364cbe14253', 'request_id': 'req-cf4e465a-4aff-49f3-8089-8b7146e716ee'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:37.600315 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-cf4e465a-4aff-49f3-8089-8b7146e716ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e74ebef149b42ab9828f364cbe14253', 'request_id': 'req-cf4e465a-4aff-49f3-8089-8b7146e716ee'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:37.611764 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-cf4e465a-4aff-49f3-8089-8b7146e716ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e74ebef149b42ab9828f364cbe14253', 'request_id': 'req-cf4e465a-4aff-49f3-8089-8b7146e716ee'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:37.624543 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-cf4e465a-4aff-49f3-8089-8b7146e716ee admin admin] The token cache is being invalidate because project 0e74ebef149b42ab9828f364cbe14253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:10:37.624820 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-cf4e465a-4aff-49f3-8089-8b7146e716ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:37.625401 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-cf4e465a-4aff-49f3-8089-8b7146e716ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:37.626816 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1213/2427] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:10:37 2021] DELETE /identity/v3/projects/0e74ebef149b42ab9828f364cbe14253 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:10:37.634054 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de6beb-db23-44df-a5db-e336ebd3ed1f None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:37.634280 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de6beb-db23-44df-a5db-e336ebd3ed1f None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:37.634562 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de6beb-db23-44df-a5db-e336ebd3ed1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:37.657337 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-d2de6beb-db23-44df-a5db-e336ebd3ed1f None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:10:37.658499 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-d2de6beb-db23-44df-a5db-e336ebd3ed1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:37.729442 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1215/2428] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:10:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:10:37.737056 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637d34d-d80c-48a6-8a1e-cd423b303e7f None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:37.737347 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637d34d-d80c-48a6-8a1e-cd423b303e7f None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:37.738130 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637d34d-d80c-48a6-8a1e-cd423b303e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:37.768541 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-c637d34d-d80c-48a6-8a1e-cd423b303e7f None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:10:37.770312 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-c637d34d-d80c-48a6-8a1e-cd423b303e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:37.779141 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1214/2429] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:10:37 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:10:37.783977 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de6beb-db23-44df-a5db-e336ebd3ed1f None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:37.794353 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de6beb-db23-44df-a5db-e336ebd3ed1f None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:37.799840 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32224e93-5b5d-4de4-83fd-8590ef9a3c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:37.801133 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32224e93-5b5d-4de4-83fd-8590ef9a3c87 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:37.801485 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32224e93-5b5d-4de4-83fd-8590ef9a3c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:37.801826 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32224e93-5b5d-4de4-83fd-8590ef9a3c87 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:37.802606 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32224e93-5b5d-4de4-83fd-8590ef9a3c87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:10:37.803082 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32224e93-5b5d-4de4-83fd-8590ef9a3c87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:37.829540 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32224e93-5b5d-4de4-83fd-8590ef9a3c87 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:37.845548 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1216/2430] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:10:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:10:37.850096 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637d34d-d80c-48a6-8a1e-cd423b303e7f None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:37.859025 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637d34d-d80c-48a6-8a1e-cd423b303e7f None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:37.863862 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aeaf91-7847-4871-97da-ef55e112adb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:37.864500 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aeaf91-7847-4871-97da-ef55e112adb4 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:37.864786 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aeaf91-7847-4871-97da-ef55e112adb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:37.865060 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aeaf91-7847-4871-97da-ef55e112adb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:37.865692 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aeaf91-7847-4871-97da-ef55e112adb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:37.895940 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aeaf91-7847-4871-97da-ef55e112adb4 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:37.923844 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1215/2431] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:10:37 2021] POST /identity/v3/projects => generated 379 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:10:37.928535 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32224e93-5b5d-4de4-83fd-8590ef9a3c87 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:37.938114 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32224e93-5b5d-4de4-83fd-8590ef9a3c87 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:38.000877 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc8b7d-d734-4965-bb0a-512ee78e3e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:38.001527 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc8b7d-d734-4965-bb0a-512ee78e3e59 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:38.001754 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc8b7d-d734-4965-bb0a-512ee78e3e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:38.002127 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc8b7d-d734-4965-bb0a-512ee78e3e59 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:38.002751 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc8b7d-d734-4965-bb0a-512ee78e3e59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:38.003923 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aeaf91-7847-4871-97da-ef55e112adb4 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:38.005455 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-11aeaf91-7847-4871-97da-ef55e112adb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:38.028682 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bc8b7d-d734-4965-bb0a-512ee78e3e59 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:38.051828 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1217/2432] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:10:37 2021] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:10:38.052923 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc8b7d-d734-4965-bb0a-512ee78e3e59 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:38.062608 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc8b7d-d734-4965-bb0a-512ee78e3e59 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:38.070650 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1ead3-0e4e-4587-8bc4-02861038d5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:38.071619 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1ead3-0e4e-4587-8bc4-02861038d5e2 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:38.072091 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1ead3-0e4e-4587-8bc4-02861038d5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:38.072562 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1ead3-0e4e-4587-8bc4-02861038d5e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:38.073379 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd1ead3-0e4e-4587-8bc4-02861038d5e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:38.092604 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aeaf91-7847-4871-97da-ef55e112adb4 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:38.100006 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd1ead3-0e4e-4587-8bc4-02861038d5e2 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:38.100538 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ab89b-952b-466a-aadf-95a2f4ea2098 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:38.101134 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ab89b-952b-466a-aadf-95a2f4ea2098 service nova] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:38.101420 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ab89b-952b-466a-aadf-95a2f4ea2098 service nova] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:38.101693 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ab89b-952b-466a-aadf-95a2f4ea2098 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:38.103392 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-e33ab89b-952b-466a-aadf-95a2f4ea2098 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:38.111231 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1218/2433] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:10:38 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:10:38.116210 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1ead3-0e4e-4587-8bc4-02861038d5e2 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:38.129413 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1ead3-0e4e-4587-8bc4-02861038d5e2 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:38.134232 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb9d567-627c-4f81-a7bf-65de692e99d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:38.135159 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9d567-627c-4f81-a7bf-65de692e99d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:38.135572 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9d567-627c-4f81-a7bf-65de692e99d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:38.135691 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb9d567-627c-4f81-a7bf-65de692e99d2 admin admin] PATH_INFO: `/v3/projects/1343fb51598b4e7c9dba59572cfc2f17/users/0ca58b960cbb42b6b9d5d9a2553ad896/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:38.160058 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9d567-627c-4f81-a7bf-65de692e99d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1343fb51598b4e7c9dba59572cfc2f17, user_id=0ca58b960cbb42b6b9d5d9a2553ad896, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:38.186623 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ab89b-952b-466a-aadf-95a2f4ea2098 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:38.187601 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb9d567-627c-4f81-a7bf-65de692e99d2 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:38.209817 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1219/2434] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:10:38 2021] PUT /identity/v3/projects/1343fb51598b4e7c9dba59572cfc2f17/users/0ca58b960cbb42b6b9d5d9a2553ad896/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:10:38.213373 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ab89b-952b-466a-aadf-95a2f4ea2098 service nova] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:38.221581 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07674c-0204-483a-bafa-4084fa555103 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:38.222396 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07674c-0204-483a-bafa-4084fa555103 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:38.222679 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07674c-0204-483a-bafa-4084fa555103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:38.229799 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1216/2435] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:10:38 2021] GET /identity/v3/auth/tokens => generated 3696 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:10:38.264844 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-ca07674c-0204-483a-bafa-4084fa555103 None None] MFA Rules not processed for user `0ca58b960cbb42b6b9d5d9a2553ad896`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:10:38.266013 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-ca07674c-0204-483a-bafa-4084fa555103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:38.349287 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1220/2436] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:10:38 2021] POST /identity/v3/auth/tokens => generated 3686 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:10:38.353271 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ab89b-952b-466a-aadf-95a2f4ea2098 service nova] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:38.364838 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ab89b-952b-466a-aadf-95a2f4ea2098 service nova] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:38.438873 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da652a-d8fc-4c04-895e-d431e16a7121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:38.439724 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da652a-d8fc-4c04-895e-d431e16a7121 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:38.440106 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da652a-d8fc-4c04-895e-d431e16a7121 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:38.440476 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da652a-d8fc-4c04-895e-d431e16a7121 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:38.441318 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da652a-d8fc-4c04-895e-d431e16a7121 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:38.467294 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da652a-d8fc-4c04-895e-d431e16a7121 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:38.498255 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1217/2437] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:10:38 2021] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:10:38.499316 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07674c-0204-483a-bafa-4084fa555103 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:38.509938 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07674c-0204-483a-bafa-4084fa555103 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:38.574093 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabac96-6437-4120-a2ee-46b1bbb67c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:38.574703 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabac96-6437-4120-a2ee-46b1bbb67c8d admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:38.574991 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabac96-6437-4120-a2ee-46b1bbb67c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:38.575270 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabac96-6437-4120-a2ee-46b1bbb67c8d admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:38.575952 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dabac96-6437-4120-a2ee-46b1bbb67c8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:38.602924 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dabac96-6437-4120-a2ee-46b1bbb67c8d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:38.626459 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1221/2438] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:10:38 2021] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:10:38.627652 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da652a-d8fc-4c04-895e-d431e16a7121 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:38.637665 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da652a-d8fc-4c04-895e-d431e16a7121 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:38.642199 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf61743-1610-40b1-9ab9-1dda4e0d1c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:38.642799 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf61743-1610-40b1-9ab9-1dda4e0d1c36 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:38.643090 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf61743-1610-40b1-9ab9-1dda4e0d1c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:38.643373 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf61743-1610-40b1-9ab9-1dda4e0d1c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:38.644610 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf61743-1610-40b1-9ab9-1dda4e0d1c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:38.670794 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf61743-1610-40b1-9ab9-1dda4e0d1c36 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:38.682314 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1218/2439] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:10:38 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:10:38.686612 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabac96-6437-4120-a2ee-46b1bbb67c8d admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:38.696275 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabac96-6437-4120-a2ee-46b1bbb67c8d admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:38.700382 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982aa20-73f6-44a5-bcbd-fee2194f3c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:38.701215 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982aa20-73f6-44a5-bcbd-fee2194f3c6d admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:38.701495 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982aa20-73f6-44a5-bcbd-fee2194f3c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:38.701769 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982aa20-73f6-44a5-bcbd-fee2194f3c6d admin admin] PATH_INFO: `/v3/projects/786fc699582848e7b5f9ea5641e397e3/users/ba650d6276384c028b4162dfdf606fe8/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:38.722679 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982aa20-73f6-44a5-bcbd-fee2194f3c6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=786fc699582848e7b5f9ea5641e397e3, user_id=ba650d6276384c028b4162dfdf606fe8, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:38.749177 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5982aa20-73f6-44a5-bcbd-fee2194f3c6d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:38.762323 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1222/2440] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:10:38 2021] PUT /identity/v3/projects/786fc699582848e7b5f9ea5641e397e3/users/ba650d6276384c028b4162dfdf606fe8/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:10:38.773114 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40211ae-bb4d-4183-983a-116da4bd0660 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:38.773513 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40211ae-bb4d-4183-983a-116da4bd0660 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:38.773703 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40211ae-bb4d-4183-983a-116da4bd0660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:38.809092 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-d40211ae-bb4d-4183-983a-116da4bd0660 None None] MFA Rules not processed for user `ba650d6276384c028b4162dfdf606fe8`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:10:38.810243 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-d40211ae-bb4d-4183-983a-116da4bd0660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:38.884953 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1219/2441] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:10:38 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:10:38.889310 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982aa20-73f6-44a5-bcbd-fee2194f3c6d admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:38.971611 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5982aa20-73f6-44a5-bcbd-fee2194f3c6d admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:38.980387 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa740746-2a9e-49b3-9687-91f6ccd2b871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:38.981169 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa740746-2a9e-49b3-9687-91f6ccd2b871 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:38.981549 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa740746-2a9e-49b3-9687-91f6ccd2b871 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:38.981859 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa740746-2a9e-49b3-9687-91f6ccd2b871 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:38.982519 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa740746-2a9e-49b3-9687-91f6ccd2b871 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:39.010687 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa740746-2a9e-49b3-9687-91f6ccd2b871 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:39.047897 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40211ae-bb4d-4183-983a-116da4bd0660 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:39.053004 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1223/2442] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:10:38 2021] POST /identity/v3/projects => generated 377 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:10:39.060566 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40211ae-bb4d-4183-983a-116da4bd0660 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:39.141555 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f1f6d-c470-4300-96d6-97043e53a5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:39.142171 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f1f6d-c470-4300-96d6-97043e53a5e1 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:39.142459 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f1f6d-c470-4300-96d6-97043e53a5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:39.142738 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94f1f6d-c470-4300-96d6-97043e53a5e1 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:39.143371 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f1f6d-c470-4300-96d6-97043e53a5e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:39.169623 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94f1f6d-c470-4300-96d6-97043e53a5e1 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:39.194289 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1220/2443] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:10:39 2021] POST /identity/v3/users => generated 295 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:10:39.197875 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa740746-2a9e-49b3-9687-91f6ccd2b871 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:39.209285 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa740746-2a9e-49b3-9687-91f6ccd2b871 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:39.214556 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21301a8-bebe-4504-9c8f-95e647545347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:39.215177 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21301a8-bebe-4504-9c8f-95e647545347 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:39.216521 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21301a8-bebe-4504-9c8f-95e647545347 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:39.216814 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21301a8-bebe-4504-9c8f-95e647545347 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:39.217624 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21301a8-bebe-4504-9c8f-95e647545347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:39.256252 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21301a8-bebe-4504-9c8f-95e647545347 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:39.283654 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f1f6d-c470-4300-96d6-97043e53a5e1 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:39.286941 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1224/2444] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:10:39 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:10:39.299106 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94f1f6d-c470-4300-96d6-97043e53a5e1 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:39.302380 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47402dab-41ca-4a61-bedb-f9e4a18f97fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:39.303770 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47402dab-41ca-4a61-bedb-f9e4a18f97fd admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:39.303770 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47402dab-41ca-4a61-bedb-f9e4a18f97fd admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:39.304579 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47402dab-41ca-4a61-bedb-f9e4a18f97fd admin admin] PATH_INFO: `/v3/projects/7b24dfa5097e44ff8a4c9bf8eb1a7421/users/075936b2b7e1464bb4f2d878a993ed9e/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:39.326592 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47402dab-41ca-4a61-bedb-f9e4a18f97fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b24dfa5097e44ff8a4c9bf8eb1a7421, user_id=075936b2b7e1464bb4f2d878a993ed9e, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:39.353008 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47402dab-41ca-4a61-bedb-f9e4a18f97fd admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:39.369387 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1221/2445] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:10:39 2021] PUT /identity/v3/projects/7b24dfa5097e44ff8a4c9bf8eb1a7421/users/075936b2b7e1464bb4f2d878a993ed9e/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:10:39.373317 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21301a8-bebe-4504-9c8f-95e647545347 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:39.383572 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21301a8-bebe-4504-9c8f-95e647545347 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:39.447672 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdc8d4-1e75-4d6e-adc1-3f2163097c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:39.448448 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdc8d4-1e75-4d6e-adc1-3f2163097c6b admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:39.448744 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdc8d4-1e75-4d6e-adc1-3f2163097c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:39.449027 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdc8d4-1e75-4d6e-adc1-3f2163097c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:39.449736 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acdc8d4-1e75-4d6e-adc1-3f2163097c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:39.475882 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acdc8d4-1e75-4d6e-adc1-3f2163097c6b admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:39.490334 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1225/2446] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:10:39 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:10:39.491854 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47402dab-41ca-4a61-bedb-f9e4a18f97fd admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:39.502167 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47402dab-41ca-4a61-bedb-f9e4a18f97fd admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:39.506758 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769ba29-67f1-4c7e-a144-1730808e36eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:39.507641 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769ba29-67f1-4c7e-a144-1730808e36eb admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:39.507930 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769ba29-67f1-4c7e-a144-1730808e36eb admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:39.508210 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769ba29-67f1-4c7e-a144-1730808e36eb admin admin] PATH_INFO: `/v3/projects/7b24dfa5097e44ff8a4c9bf8eb1a7421/users/075936b2b7e1464bb4f2d878a993ed9e/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:39.510113 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769ba29-67f1-4c7e-a144-1730808e36eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b24dfa5097e44ff8a4c9bf8eb1a7421, user_id=075936b2b7e1464bb4f2d878a993ed9e, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:39.537485 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769ba29-67f1-4c7e-a144-1730808e36eb admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:39.554646 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1222/2447] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:10:39 2021] PUT /identity/v3/projects/7b24dfa5097e44ff8a4c9bf8eb1a7421/users/075936b2b7e1464bb4f2d878a993ed9e/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:10:39.558394 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdc8d4-1e75-4d6e-adc1-3f2163097c6b admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:39.568242 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdc8d4-1e75-4d6e-adc1-3f2163097c6b admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:39.636894 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fc9ee-90e1-491e-9d39-38e0d1d31fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:39.637508 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fc9ee-90e1-491e-9d39-38e0d1d31fff admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:39.637798 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fc9ee-90e1-491e-9d39-38e0d1d31fff admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:39.638079 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fc9ee-90e1-491e-9d39-38e0d1d31fff admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:39.638778 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49fc9ee-90e1-491e-9d39-38e0d1d31fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:39.665078 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49fc9ee-90e1-491e-9d39-38e0d1d31fff admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:39.676703 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1226/2448] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:10:39 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:10:39.680728 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769ba29-67f1-4c7e-a144-1730808e36eb admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:39.690675 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769ba29-67f1-4c7e-a144-1730808e36eb admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:39.695181 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62013d78-d624-4c48-8776-bc2f3c368ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:39.696074 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62013d78-d624-4c48-8776-bc2f3c368ca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:39.696360 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62013d78-d624-4c48-8776-bc2f3c368ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:39.696638 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62013d78-d624-4c48-8776-bc2f3c368ca8 admin admin] PATH_INFO: `/v3/projects/7b24dfa5097e44ff8a4c9bf8eb1a7421/users/075936b2b7e1464bb4f2d878a993ed9e/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:39.698546 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62013d78-d624-4c48-8776-bc2f3c368ca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b24dfa5097e44ff8a4c9bf8eb1a7421, user_id=075936b2b7e1464bb4f2d878a993ed9e, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:39.725831 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62013d78-d624-4c48-8776-bc2f3c368ca8 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:39.746411 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1223/2449] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:10:39 2021] PUT /identity/v3/projects/7b24dfa5097e44ff8a4c9bf8eb1a7421/users/075936b2b7e1464bb4f2d878a993ed9e/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:10:39.757532 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537da6c-36bf-490b-96a8-b3e15bed27e0 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:39.758370 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537da6c-36bf-490b-96a8-b3e15bed27e0 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:39.758657 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537da6c-36bf-490b-96a8-b3e15bed27e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:39.796009 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-6537da6c-36bf-490b-96a8-b3e15bed27e0 None None] MFA Rules not processed for user `075936b2b7e1464bb4f2d878a993ed9e`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:10:39.797392 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-6537da6c-36bf-490b-96a8-b3e15bed27e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:39.878304 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1227/2450] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:10:39 2021] POST /identity/v3/auth/tokens => generated 3751 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:10:39.891458 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62013d78-d624-4c48-8776-bc2f3c368ca8 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:39.891458 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-62013d78-d624-4c48-8776-bc2f3c368ca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:39.961884 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62013d78-d624-4c48-8776-bc2f3c368ca8 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:39.965320 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2255ac-e935-4934-b92a-d297141041b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:39.965926 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2255ac-e935-4934-b92a-d297141041b0 service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:39.966214 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2255ac-e935-4934-b92a-d297141041b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:39.966490 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2255ac-e935-4934-b92a-d297141041b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:39.976316 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2255ac-e935-4934-b92a-d297141041b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:40.001706 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2255ac-e935-4934-b92a-d297141041b0 service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:40.011762 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1224/2451] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:10:39 2021] GET /identity/v3/auth/tokens => generated 3751 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:10:40.073008 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537da6c-36bf-490b-96a8-b3e15bed27e0 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:40.074386 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-6537da6c-36bf-490b-96a8-b3e15bed27e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:40.092308 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537da6c-36bf-490b-96a8-b3e15bed27e0 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:40.098746 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac431f-da7b-4919-a278-8b43e107b399 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:40.099518 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac431f-da7b-4919-a278-8b43e107b399 service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:40.099842 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac431f-da7b-4919-a278-8b43e107b399 service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:40.100123 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac431f-da7b-4919-a278-8b43e107b399 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:40.183615 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac431f-da7b-4919-a278-8b43e107b399 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:40.209764 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac431f-da7b-4919-a278-8b43e107b399 service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:40.221297 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1228/2452] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:10:40 2021] GET /identity/v3/auth/tokens => generated 3686 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:10:44.817141 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2255ac-e935-4934-b92a-d297141041b0 service cinder] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:44.893293 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2255ac-e935-4934-b92a-d297141041b0 service cinder] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:44.898313 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9ad01-490b-4f9c-95a0-6dd1bfb4166d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:44.899131 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9ad01-490b-4f9c-95a0-6dd1bfb4166d admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:44.899417 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9ad01-490b-4f9c-95a0-6dd1bfb4166d admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:44.899744 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df9ad01-490b-4f9c-95a0-6dd1bfb4166d admin admin] PATH_INFO: `/v3/users/0ca58b960cbb42b6b9d5d9a2553ad896` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:44.900829 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9ad01-490b-4f9c-95a0-6dd1bfb4166d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ca58b960cbb42b6b9d5d9a2553ad896)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:44.926582 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df9ad01-490b-4f9c-95a0-6dd1bfb4166d admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:44.980967 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-2df9ad01-490b-4f9c-95a0-6dd1bfb4166d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ca58b960cbb42b6b9d5d9a2553ad896'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:44.994745 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-2df9ad01-490b-4f9c-95a0-6dd1bfb4166d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ca58b960cbb42b6b9d5d9a2553ad896'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:44.995554 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-2df9ad01-490b-4f9c-95a0-6dd1bfb4166d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ca58b960cbb42b6b9d5d9a2553ad896'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:45.008011 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-2df9ad01-490b-4f9c-95a0-6dd1bfb4166d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ca58b960cbb42b6b9d5d9a2553ad896'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:45.016124 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-2df9ad01-490b-4f9c-95a0-6dd1bfb4166d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ca58b960cbb42b6b9d5d9a2553ad896'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:45.023025 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1225/2453] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:10:44 2021] DELETE /identity/v3/users/0ca58b960cbb42b6b9d5d9a2553ad896 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:10:45.027704 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12007f0f-36ab-4016-b6f6-2ac5e6bbf619 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:45.028222 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12007f0f-36ab-4016-b6f6-2ac5e6bbf619 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:45.028328 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12007f0f-36ab-4016-b6f6-2ac5e6bbf619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:45.053138 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-12007f0f-36ab-4016-b6f6-2ac5e6bbf619 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:10:45.054480 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-12007f0f-36ab-4016-b6f6-2ac5e6bbf619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:45.124000 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1229/2454] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:10:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:10:45.137137 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9ad01-490b-4f9c-95a0-6dd1bfb4166d admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:45.138482 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-2df9ad01-490b-4f9c-95a0-6dd1bfb4166d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:45.227162 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df9ad01-490b-4f9c-95a0-6dd1bfb4166d admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:45.231231 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f35cc-a71e-4a7b-9927-344cd95c1e2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:45.231935 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f35cc-a71e-4a7b-9927-344cd95c1e2a service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:45.232285 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f35cc-a71e-4a7b-9927-344cd95c1e2a service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:45.232675 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f35cc-a71e-4a7b-9927-344cd95c1e2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:45.255291 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f35cc-a71e-4a7b-9927-344cd95c1e2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:45.283490 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f35cc-a71e-4a7b-9927-344cd95c1e2a service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:45.293960 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1226/2455] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:10:45 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:10:45.851937 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12007f0f-36ab-4016-b6f6-2ac5e6bbf619 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:45.854446 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-12007f0f-36ab-4016-b6f6-2ac5e6bbf619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:45.877868 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12007f0f-36ab-4016-b6f6-2ac5e6bbf619 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:45.884328 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae455d-bb79-44b5-b34f-b951cbd899cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:45.885203 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae455d-bb79-44b5-b34f-b951cbd899cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:45.885888 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae455d-bb79-44b5-b34f-b951cbd899cc admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:45.886221 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae455d-bb79-44b5-b34f-b951cbd899cc admin admin] PATH_INFO: `/v3/projects/1343fb51598b4e7c9dba59572cfc2f17` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:45.887403 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae455d-bb79-44b5-b34f-b951cbd899cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1343fb51598b4e7c9dba59572cfc2f17)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:45.914958 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae455d-bb79-44b5-b34f-b951cbd899cc admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:45.973891 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-4aae455d-bb79-44b5-b34f-b951cbd899cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1343fb51598b4e7c9dba59572cfc2f17', 'request_id': 'req-4aae455d-bb79-44b5-b34f-b951cbd899cc'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:45.979385 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-4aae455d-bb79-44b5-b34f-b951cbd899cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1343fb51598b4e7c9dba59572cfc2f17', 'request_id': 'req-4aae455d-bb79-44b5-b34f-b951cbd899cc'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:45.991224 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-4aae455d-bb79-44b5-b34f-b951cbd899cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1343fb51598b4e7c9dba59572cfc2f17', 'request_id': 'req-4aae455d-bb79-44b5-b34f-b951cbd899cc'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:46.004404 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-4aae455d-bb79-44b5-b34f-b951cbd899cc admin admin] The token cache is being invalidate because project 1343fb51598b4e7c9dba59572cfc2f17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:10:46.004828 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-4aae455d-bb79-44b5-b34f-b951cbd899cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:46.005578 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-4aae455d-bb79-44b5-b34f-b951cbd899cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:46.007052 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1230/2456] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:10:45 2021] DELETE /identity/v3/projects/1343fb51598b4e7c9dba59572cfc2f17 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:10:46.011311 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f35cc-a71e-4a7b-9927-344cd95c1e2a service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:46.021084 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f35cc-a71e-4a7b-9927-344cd95c1e2a service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:46.093480 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd147c75-0de9-4cff-96d0-dd44c655261d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:46.094288 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd147c75-0de9-4cff-96d0-dd44c655261d admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:46.094571 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd147c75-0de9-4cff-96d0-dd44c655261d admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:46.094855 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd147c75-0de9-4cff-96d0-dd44c655261d admin admin] PATH_INFO: `/v3/users/ba650d6276384c028b4162dfdf606fe8` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:46.096020 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd147c75-0de9-4cff-96d0-dd44c655261d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba650d6276384c028b4162dfdf606fe8)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:46.122887 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd147c75-0de9-4cff-96d0-dd44c655261d admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:46.181468 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-bd147c75-0de9-4cff-96d0-dd44c655261d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba650d6276384c028b4162dfdf606fe8'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:46.195268 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-bd147c75-0de9-4cff-96d0-dd44c655261d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba650d6276384c028b4162dfdf606fe8'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:46.195902 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-bd147c75-0de9-4cff-96d0-dd44c655261d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba650d6276384c028b4162dfdf606fe8'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:46.204832 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-bd147c75-0de9-4cff-96d0-dd44c655261d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba650d6276384c028b4162dfdf606fe8'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:46.213943 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-bd147c75-0de9-4cff-96d0-dd44c655261d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba650d6276384c028b4162dfdf606fe8'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:46.222859 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1227/2457] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:10:46 2021] DELETE /identity/v3/users/ba650d6276384c028b4162dfdf606fe8 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:10:46.637895 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae455d-bb79-44b5-b34f-b951cbd899cc admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:46.643176 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-4aae455d-bb79-44b5-b34f-b951cbd899cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:46.659000 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae455d-bb79-44b5-b34f-b951cbd899cc admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:46.729690 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6434813-078e-4b12-8366-5b24750ce31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:46.730651 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6434813-078e-4b12-8366-5b24750ce31c admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:46.731035 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6434813-078e-4b12-8366-5b24750ce31c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:46.731411 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6434813-078e-4b12-8366-5b24750ce31c admin admin] PATH_INFO: `/v3/projects/786fc699582848e7b5f9ea5641e397e3` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:46.732718 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6434813-078e-4b12-8366-5b24750ce31c admin admin] RBAC: Authorizing `identity:delete_project(project_id=786fc699582848e7b5f9ea5641e397e3)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:46.767630 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6434813-078e-4b12-8366-5b24750ce31c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:46.820402 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f300e3-1b03-486e-9d79-8230cdfd516e None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:46.820749 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f300e3-1b03-486e-9d79-8230cdfd516e None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:46.821033 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f300e3-1b03-486e-9d79-8230cdfd516e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:46.831366 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-c6434813-078e-4b12-8366-5b24750ce31c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '786fc699582848e7b5f9ea5641e397e3', 'request_id': 'req-c6434813-078e-4b12-8366-5b24750ce31c'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:46.836766 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-c6434813-078e-4b12-8366-5b24750ce31c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '786fc699582848e7b5f9ea5641e397e3', 'request_id': 'req-c6434813-078e-4b12-8366-5b24750ce31c'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:46.842832 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-12f300e3-1b03-486e-9d79-8230cdfd516e None None] MFA Rules not processed for user `3a3324c92a85423e9ab73178f876d531`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:10:46.844275 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-12f300e3-1b03-486e-9d79-8230cdfd516e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:46.848648 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-c6434813-078e-4b12-8366-5b24750ce31c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '786fc699582848e7b5f9ea5641e397e3', 'request_id': 'req-c6434813-078e-4b12-8366-5b24750ce31c'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:46.861860 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-c6434813-078e-4b12-8366-5b24750ce31c admin admin] The token cache is being invalidate because project 786fc699582848e7b5f9ea5641e397e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:10:46.862577 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-c6434813-078e-4b12-8366-5b24750ce31c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:46.863144 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-c6434813-078e-4b12-8366-5b24750ce31c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:46.864605 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1231/2458] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:10:46 2021] DELETE /identity/v3/projects/786fc699582848e7b5f9ea5641e397e3 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:10:46.868535 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6434813-078e-4b12-8366-5b24750ce31c admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:46.869809 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-c6434813-078e-4b12-8366-5b24750ce31c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:46.912674 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1228/2459] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:10:46 2021] POST /identity/v3/auth/tokens => generated 3696 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:10:46.943696 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6434813-078e-4b12-8366-5b24750ce31c admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:46.949245 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1cb41-502c-4350-b621-79764ecae516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:46.950133 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1cb41-502c-4350-b621-79764ecae516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:46.950417 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1cb41-502c-4350-b621-79764ecae516 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:46.950700 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1cb41-502c-4350-b621-79764ecae516 admin admin] PATH_INFO: `/v3/users/075936b2b7e1464bb4f2d878a993ed9e` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:46.952000 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c1cb41-502c-4350-b621-79764ecae516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=075936b2b7e1464bb4f2d878a993ed9e)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:46.979124 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c1cb41-502c-4350-b621-79764ecae516 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:47.040810 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-24c1cb41-502c-4350-b621-79764ecae516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '075936b2b7e1464bb4f2d878a993ed9e'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:47.041796 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-24c1cb41-502c-4350-b621-79764ecae516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '075936b2b7e1464bb4f2d878a993ed9e'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:47.056397 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-24c1cb41-502c-4350-b621-79764ecae516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '075936b2b7e1464bb4f2d878a993ed9e'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:47.064982 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-24c1cb41-502c-4350-b621-79764ecae516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '075936b2b7e1464bb4f2d878a993ed9e'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:47.074886 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-24c1cb41-502c-4350-b621-79764ecae516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '075936b2b7e1464bb4f2d878a993ed9e'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:47.081919 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1232/2460] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:10:46 2021] DELETE /identity/v3/users/075936b2b7e1464bb4f2d878a993ed9e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:10:47.531139 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f300e3-1b03-486e-9d79-8230cdfd516e None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:47.532798 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-12f300e3-1b03-486e-9d79-8230cdfd516e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:47.599314 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f300e3-1b03-486e-9d79-8230cdfd516e None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:47.615503 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1cb41-502c-4350-b621-79764ecae516 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:47.619396 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-24c1cb41-502c-4350-b621-79764ecae516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:47.678088 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac75bff3-65bd-4e62-bb8a-4a29b77eb1c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:47.678679 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75bff3-65bd-4e62-bb8a-4a29b77eb1c2 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:47.678959 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75bff3-65bd-4e62-bb8a-4a29b77eb1c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:47.679232 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac75bff3-65bd-4e62-bb8a-4a29b77eb1c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:47.681009 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-ac75bff3-65bd-4e62-bb8a-4a29b77eb1c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:47.690534 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac75bff3-65bd-4e62-bb8a-4a29b77eb1c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:47.700933 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1cb41-502c-4350-b621-79764ecae516 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:47.705477 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb985db-82ba-428f-8ea1-3a595abdb96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:47.706816 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb985db-82ba-428f-8ea1-3a595abdb96d admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:47.707100 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb985db-82ba-428f-8ea1-3a595abdb96d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:47.707380 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb985db-82ba-428f-8ea1-3a595abdb96d admin admin] PATH_INFO: `/v3/projects/7b24dfa5097e44ff8a4c9bf8eb1a7421` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:47.708524 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb985db-82ba-428f-8ea1-3a595abdb96d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b24dfa5097e44ff8a4c9bf8eb1a7421)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:47.718373 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac75bff3-65bd-4e62-bb8a-4a29b77eb1c2 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:47.727659 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1229/2461] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:10:47 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:10:47.734930 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb985db-82ba-428f-8ea1-3a595abdb96d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:47.788599 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-ceb985db-82ba-428f-8ea1-3a595abdb96d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b24dfa5097e44ff8a4c9bf8eb1a7421', 'request_id': 'req-ceb985db-82ba-428f-8ea1-3a595abdb96d'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:47.793687 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-ceb985db-82ba-428f-8ea1-3a595abdb96d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b24dfa5097e44ff8a4c9bf8eb1a7421', 'request_id': 'req-ceb985db-82ba-428f-8ea1-3a595abdb96d'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:47.805821 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-ceb985db-82ba-428f-8ea1-3a595abdb96d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b24dfa5097e44ff8a4c9bf8eb1a7421', 'request_id': 'req-ceb985db-82ba-428f-8ea1-3a595abdb96d'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:47.822466 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-ceb985db-82ba-428f-8ea1-3a595abdb96d admin admin] The token cache is being invalidate because project 7b24dfa5097e44ff8a4c9bf8eb1a7421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:10:47.822862 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-ceb985db-82ba-428f-8ea1-3a595abdb96d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:47.823563 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-ceb985db-82ba-428f-8ea1-3a595abdb96d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:47.825357 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1233/2462] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:10:47 2021] DELETE /identity/v3/projects/7b24dfa5097e44ff8a4c9bf8eb1a7421 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:10:47.833539 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ddc0f-bf91-41ec-876a-ed786d00a274 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:47.834073 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ddc0f-bf91-41ec-876a-ed786d00a274 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:47.834346 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6ddc0f-bf91-41ec-876a-ed786d00a274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:47.859189 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-7b6ddc0f-bf91-41ec-876a-ed786d00a274 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:10:47.860553 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-7b6ddc0f-bf91-41ec-876a-ed786d00a274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:47.934874 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1230/2463] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:10:47 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:10:47.946543 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48a477-a11f-45fc-ba2a-df3e31faed4f None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:47.946543 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48a477-a11f-45fc-ba2a-df3e31faed4f None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:47.946543 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d48a477-a11f-45fc-ba2a-df3e31faed4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:47.968365 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-5d48a477-a11f-45fc-ba2a-df3e31faed4f None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:10:47.969559 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-5d48a477-a11f-45fc-ba2a-df3e31faed4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:47.986825 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1234/2464] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:10:47 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:10:47.989542 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ddc0f-bf91-41ec-876a-ed786d00a274 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:47.999812 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6ddc0f-bf91-41ec-876a-ed786d00a274 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:48.005692 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25102c-d095-4b63-8a17-a0cb9c1e8bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:48.006781 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25102c-d095-4b63-8a17-a0cb9c1e8bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:48.007169 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25102c-d095-4b63-8a17-a0cb9c1e8bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:48.007723 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25102c-d095-4b63-8a17-a0cb9c1e8bf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:48.008549 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25102c-d095-4b63-8a17-a0cb9c1e8bf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:10:48.008993 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25102c-d095-4b63-8a17-a0cb9c1e8bf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:48.036157 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25102c-d095-4b63-8a17-a0cb9c1e8bf0 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:48.052137 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1231/2465] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:10:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:10:48.056377 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48a477-a11f-45fc-ba2a-df3e31faed4f None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:48.066166 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d48a477-a11f-45fc-ba2a-df3e31faed4f None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:48.070708 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761422b-5881-4295-bd41-67e939ca59b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:48.071314 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761422b-5881-4295-bd41-67e939ca59b8 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:48.071639 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761422b-5881-4295-bd41-67e939ca59b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:48.071922 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761422b-5881-4295-bd41-67e939ca59b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:48.072562 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7761422b-5881-4295-bd41-67e939ca59b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:48.098833 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7761422b-5881-4295-bd41-67e939ca59b8 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:48.132713 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1235/2466] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:10:48 2021] POST /identity/v3/projects => generated 375 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:10:48.134125 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25102c-d095-4b63-8a17-a0cb9c1e8bf0 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:48.145560 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25102c-d095-4b63-8a17-a0cb9c1e8bf0 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:48.234990 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761422b-5881-4295-bd41-67e939ca59b8 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:48.236708 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4cdee-c10b-4a7e-a554-6e8d3c5c8e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:48.236891 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-7761422b-5881-4295-bd41-67e939ca59b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:48.237945 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4cdee-c10b-4a7e-a554-6e8d3c5c8e1e admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:48.238239 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4cdee-c10b-4a7e-a554-6e8d3c5c8e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:48.238690 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc4cdee-c10b-4a7e-a554-6e8d3c5c8e1e admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:48.244486 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4cdee-c10b-4a7e-a554-6e8d3c5c8e1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:48.272325 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc4cdee-c10b-4a7e-a554-6e8d3c5c8e1e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:48.303582 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1232/2467] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:10:48 2021] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:10:48.306917 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4cdee-c10b-4a7e-a554-6e8d3c5c8e1e admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:48.319638 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc4cdee-c10b-4a7e-a554-6e8d3c5c8e1e admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:48.325556 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccb01d-5b61-48c7-a491-2f1b75a0c944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:48.326168 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccb01d-5b61-48c7-a491-2f1b75a0c944 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:48.326456 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccb01d-5b61-48c7-a491-2f1b75a0c944 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:48.326822 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eccb01d-5b61-48c7-a491-2f1b75a0c944 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:48.328120 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eccb01d-5b61-48c7-a491-2f1b75a0c944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:48.359691 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eccb01d-5b61-48c7-a491-2f1b75a0c944 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:48.366103 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1233/2468] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:10:48 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:10:48.370024 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761422b-5881-4295-bd41-67e939ca59b8 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:48.370396 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccb01d-5b61-48c7-a491-2f1b75a0c944 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:48.374596 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ee84a-2c19-4bef-b8e5-d2446ac82059 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcbab075fd5b4a889c2002639ca9d60a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:48.375187 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ee84a-2c19-4bef-b8e5-d2446ac82059 service placement] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:48.375501 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ee84a-2c19-4bef-b8e5-d2446ac82059 service placement] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:48.375781 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ee84a-2c19-4bef-b8e5-d2446ac82059 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:48.377477 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-557ee84a-2c19-4bef-b8e5-d2446ac82059 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:48.380798 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eccb01d-5b61-48c7-a491-2f1b75a0c944 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:48.385117 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15029428-9677-4dd8-b357-0a0e294f7498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:48.385942 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15029428-9677-4dd8-b357-0a0e294f7498 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:48.386231 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15029428-9677-4dd8-b357-0a0e294f7498 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:48.386513 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15029428-9677-4dd8-b357-0a0e294f7498 admin admin] PATH_INFO: `/v3/projects/524fbed2a9624becb68f6e3c51f75f2d/users/09cd4c445530470ba050413c11adf737/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:48.389282 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ee84a-2c19-4bef-b8e5-d2446ac82059 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:48.407040 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15029428-9677-4dd8-b357-0a0e294f7498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=524fbed2a9624becb68f6e3c51f75f2d, user_id=09cd4c445530470ba050413c11adf737, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:48.414663 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ee84a-2c19-4bef-b8e5-d2446ac82059 service placement] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:48.425392 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1236/2469] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:10:48 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:10:48.433978 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15029428-9677-4dd8-b357-0a0e294f7498 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:48.448410 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1234/2470] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:10:48 2021] PUT /identity/v3/projects/524fbed2a9624becb68f6e3c51f75f2d/users/09cd4c445530470ba050413c11adf737/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:10:48.459523 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a5f23-5116-413a-9e3f-e0100605622a None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:48.459825 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a5f23-5116-413a-9e3f-e0100605622a None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:48.460132 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a5f23-5116-413a-9e3f-e0100605622a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:48.498575 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-4a1a5f23-5116-413a-9e3f-e0100605622a None None] MFA Rules not processed for user `09cd4c445530470ba050413c11adf737`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:10:48.499763 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-4a1a5f23-5116-413a-9e3f-e0100605622a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:48.530377 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15029428-9677-4dd8-b357-0a0e294f7498 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:48.532087 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-15029428-9677-4dd8-b357-0a0e294f7498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:48.577989 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1237/2471] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:10:48 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:10:48.588737 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a5f23-5116-413a-9e3f-e0100605622a None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:48.590121 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-4a1a5f23-5116-413a-9e3f-e0100605622a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:48.610970 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15029428-9677-4dd8-b357-0a0e294f7498 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:48.616366 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3524c5-f2b5-4b72-8352-7ac0882923f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcbab075fd5b4a889c2002639ca9d60a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:48.616962 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3524c5-f2b5-4b72-8352-7ac0882923f0 service placement] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:48.617256 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3524c5-f2b5-4b72-8352-7ac0882923f0 service placement] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:48.617529 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3524c5-f2b5-4b72-8352-7ac0882923f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:48.619257 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-bb3524c5-f2b5-4b72-8352-7ac0882923f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:48.630444 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3524c5-f2b5-4b72-8352-7ac0882923f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:48.655874 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3524c5-f2b5-4b72-8352-7ac0882923f0 service placement] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:48.666802 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1235/2472] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:10:48 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:10:48.691272 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a5f23-5116-413a-9e3f-e0100605622a None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:48.694840 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aadd2ae-1111-4800-98a3-306c8d6fb0fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c345fc642242469346303afbeda2f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:48.695413 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadd2ae-1111-4800-98a3-306c8d6fb0fb service glance] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:48.695737 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadd2ae-1111-4800-98a3-306c8d6fb0fb service glance] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:48.696006 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadd2ae-1111-4800-98a3-306c8d6fb0fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:48.704983 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aadd2ae-1111-4800-98a3-306c8d6fb0fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:48.730191 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aadd2ae-1111-4800-98a3-306c8d6fb0fb service glance] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:48.741305 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1238/2473] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:10:48 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:10:50.875868 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3524c5-f2b5-4b72-8352-7ac0882923f0 service placement] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:50.880726 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-bb3524c5-f2b5-4b72-8352-7ac0882923f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:50.959493 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3524c5-f2b5-4b72-8352-7ac0882923f0 service placement] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:50.969597 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b5130-fb12-4f33-8725-137a01425c00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:50.970624 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b5130-fb12-4f33-8725-137a01425c00 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:50.971127 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b5130-fb12-4f33-8725-137a01425c00 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:50.971660 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b5130-fb12-4f33-8725-137a01425c00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:50.973856 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-729b5130-fb12-4f33-8725-137a01425c00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:50.985194 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b5130-fb12-4f33-8725-137a01425c00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:51.012176 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b5130-fb12-4f33-8725-137a01425c00 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:51.021799 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1236/2474] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:10:50 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:10:52.037072 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aadd2ae-1111-4800-98a3-306c8d6fb0fb service glance] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:52.039126 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-7aadd2ae-1111-4800-98a3-306c8d6fb0fb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:52.160618 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aadd2ae-1111-4800-98a3-306c8d6fb0fb service glance] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:52.166574 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e65cf6-e990-4ca8-98b6-4140a1a184d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:52.167043 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e65cf6-e990-4ca8-98b6-4140a1a184d3 service nova] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:52.167378 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e65cf6-e990-4ca8-98b6-4140a1a184d3 service nova] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:52.167714 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e65cf6-e990-4ca8-98b6-4140a1a184d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:52.169640 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-21e65cf6-e990-4ca8-98b6-4140a1a184d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:52.183752 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e65cf6-e990-4ca8-98b6-4140a1a184d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:52.210364 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e65cf6-e990-4ca8-98b6-4140a1a184d3 service nova] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:52.242581 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1239/2475] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:10:52 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:10:55.353521 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b5130-fb12-4f33-8725-137a01425c00 service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:55.355778 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-729b5130-fb12-4f33-8725-137a01425c00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:10:55.430301 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b5130-fb12-4f33-8725-137a01425c00 service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:55.434394 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ad6ec-4e3e-4ae7-84e5-6fce73e0b1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:55.435221 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ad6ec-4e3e-4ae7-84e5-6fce73e0b1db admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:55.435546 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ad6ec-4e3e-4ae7-84e5-6fce73e0b1db admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:55.435825 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ad6ec-4e3e-4ae7-84e5-6fce73e0b1db admin admin] PATH_INFO: `/v3/users/06547e0ae25e422c90cc2473f9cabfa4` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:55.436930 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ad6ec-4e3e-4ae7-84e5-6fce73e0b1db admin admin] RBAC: Authorizing `identity:delete_user(user_id=06547e0ae25e422c90cc2473f9cabfa4)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:55.462381 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ad6ec-4e3e-4ae7-84e5-6fce73e0b1db admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:55.517562 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-ba2ad6ec-4e3e-4ae7-84e5-6fce73e0b1db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06547e0ae25e422c90cc2473f9cabfa4'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:55.529800 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-ba2ad6ec-4e3e-4ae7-84e5-6fce73e0b1db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06547e0ae25e422c90cc2473f9cabfa4'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:55.530483 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-ba2ad6ec-4e3e-4ae7-84e5-6fce73e0b1db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06547e0ae25e422c90cc2473f9cabfa4'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:55.538191 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-ba2ad6ec-4e3e-4ae7-84e5-6fce73e0b1db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06547e0ae25e422c90cc2473f9cabfa4'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:55.546144 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-ba2ad6ec-4e3e-4ae7-84e5-6fce73e0b1db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06547e0ae25e422c90cc2473f9cabfa4'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:55.553771 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1237/2476] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:10:55 2021] DELETE /identity/v3/users/06547e0ae25e422c90cc2473f9cabfa4 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:10:55.794909 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e65cf6-e990-4ca8-98b6-4140a1a184d3 service nova] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:10:55.807064 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e65cf6-e990-4ca8-98b6-4140a1a184d3 service nova] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:10:55.872413 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a282c-00b4-49f5-9d6c-bfce4649d147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:10:55.873220 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a282c-00b4-49f5-9d6c-bfce4649d147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:10:55.873509 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a282c-00b4-49f5-9d6c-bfce4649d147 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:10:55.873787 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a282c-00b4-49f5-9d6c-bfce4649d147 admin admin] PATH_INFO: `/v3/projects/ff7a0fe5498d457f807696add8104865` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:10:55.874923 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a282c-00b4-49f5-9d6c-bfce4649d147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff7a0fe5498d457f807696add8104865)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:10:55.901774 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a282c-00b4-49f5-9d6c-bfce4649d147 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:10:55.958998 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-3d2a282c-00b4-49f5-9d6c-bfce4649d147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff7a0fe5498d457f807696add8104865', 'request_id': 'req-3d2a282c-00b4-49f5-9d6c-bfce4649d147'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:55.966118 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-3d2a282c-00b4-49f5-9d6c-bfce4649d147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff7a0fe5498d457f807696add8104865', 'request_id': 'req-3d2a282c-00b4-49f5-9d6c-bfce4649d147'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:55.978832 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-3d2a282c-00b4-49f5-9d6c-bfce4649d147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff7a0fe5498d457f807696add8104865', 'request_id': 'req-3d2a282c-00b4-49f5-9d6c-bfce4649d147'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:55.992922 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-3d2a282c-00b4-49f5-9d6c-bfce4649d147 admin admin] The token cache is being invalidate because project ff7a0fe5498d457f807696add8104865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:10:55.993216 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-3d2a282c-00b4-49f5-9d6c-bfce4649d147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:55.993826 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-3d2a282c-00b4-49f5-9d6c-bfce4649d147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:10:55.995254 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1240/2477] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:10:55 2021] DELETE /identity/v3/projects/ff7a0fe5498d457f807696add8104865 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:11:09.840262 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ad6ec-4e3e-4ae7-84e5-6fce73e0b1db admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:11:09.841703 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-ba2ad6ec-4e3e-4ae7-84e5-6fce73e0b1db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:11:09.856756 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ad6ec-4e3e-4ae7-84e5-6fce73e0b1db admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:11:09.938728 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9388310-5b84-4a1e-9836-7a158d4718b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:11:09.940234 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9388310-5b84-4a1e-9836-7a158d4718b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:11:09.941344 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9388310-5b84-4a1e-9836-7a158d4718b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:11:09.941937 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9388310-5b84-4a1e-9836-7a158d4718b2 admin admin] PATH_INFO: `/v3/users/09cd4c445530470ba050413c11adf737` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:11:09.943357 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9388310-5b84-4a1e-9836-7a158d4718b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09cd4c445530470ba050413c11adf737)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:11:09.970037 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9388310-5b84-4a1e-9836-7a158d4718b2 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:11:10.045111 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-d9388310-5b84-4a1e-9836-7a158d4718b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09cd4c445530470ba050413c11adf737'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:11:10.058656 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-d9388310-5b84-4a1e-9836-7a158d4718b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09cd4c445530470ba050413c11adf737'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:11:10.059376 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-d9388310-5b84-4a1e-9836-7a158d4718b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09cd4c445530470ba050413c11adf737'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:11:10.068248 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-d9388310-5b84-4a1e-9836-7a158d4718b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09cd4c445530470ba050413c11adf737'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:11:10.079507 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-d9388310-5b84-4a1e-9836-7a158d4718b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09cd4c445530470ba050413c11adf737'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:11:10.089184 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1238/2478] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:11:09 2021] DELETE /identity/v3/users/09cd4c445530470ba050413c11adf737 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:11:10.093543 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d0d6c-3240-4e0b-b85b-63fb33e509fd None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:11:10.095891 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d0d6c-3240-4e0b-b85b-63fb33e509fd None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:11:10.097041 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d0d6c-3240-4e0b-b85b-63fb33e509fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:11:10.122271 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-fd1d0d6c-3240-4e0b-b85b-63fb33e509fd None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:11:10.123749 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-fd1d0d6c-3240-4e0b-b85b-63fb33e509fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:11:10.207895 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1241/2479] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:11:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:11:10.218564 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9388310-5b84-4a1e-9836-7a158d4718b2 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:11:10.221312 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-d9388310-5b84-4a1e-9836-7a158d4718b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:11:10.369631 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9388310-5b84-4a1e-9836-7a158d4718b2 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:11:10.373160 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cfc2a-ce89-40d5-9294-87e9da644d15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:11:10.373750 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cfc2a-ce89-40d5-9294-87e9da644d15 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:11:10.374035 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cfc2a-ce89-40d5-9294-87e9da644d15 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:11:10.374314 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cfc2a-ce89-40d5-9294-87e9da644d15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:11:10.391632 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cfc2a-ce89-40d5-9294-87e9da644d15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:11:10.417486 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cfc2a-ce89-40d5-9294-87e9da644d15 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:11:10.428252 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1239/2480] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:11:10 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:11:10.823385 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d0d6c-3240-4e0b-b85b-63fb33e509fd None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:11:10.825713 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-fd1d0d6c-3240-4e0b-b85b-63fb33e509fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:11:10.844693 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d0d6c-3240-4e0b-b85b-63fb33e509fd None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:11:10.849479 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03bf6d6-5289-41f7-a71d-b1a8d3fe82f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:11:10.850350 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bf6d6-5289-41f7-a71d-b1a8d3fe82f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:11:10.850709 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bf6d6-5289-41f7-a71d-b1a8d3fe82f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:11:10.851101 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bf6d6-5289-41f7-a71d-b1a8d3fe82f9 admin admin] PATH_INFO: `/v3/projects/524fbed2a9624becb68f6e3c51f75f2d` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:11:10.852434 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03bf6d6-5289-41f7-a71d-b1a8d3fe82f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=524fbed2a9624becb68f6e3c51f75f2d)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:11:10.879462 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03bf6d6-5289-41f7-a71d-b1a8d3fe82f9 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:11:10.942629 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-f03bf6d6-5289-41f7-a71d-b1a8d3fe82f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '524fbed2a9624becb68f6e3c51f75f2d', 'request_id': 'req-f03bf6d6-5289-41f7-a71d-b1a8d3fe82f9'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:11:10.948457 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-f03bf6d6-5289-41f7-a71d-b1a8d3fe82f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '524fbed2a9624becb68f6e3c51f75f2d', 'request_id': 'req-f03bf6d6-5289-41f7-a71d-b1a8d3fe82f9'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:11:10.960356 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-f03bf6d6-5289-41f7-a71d-b1a8d3fe82f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '524fbed2a9624becb68f6e3c51f75f2d', 'request_id': 'req-f03bf6d6-5289-41f7-a71d-b1a8d3fe82f9'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:11:10.974508 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-f03bf6d6-5289-41f7-a71d-b1a8d3fe82f9 admin admin] The token cache is being invalidate because project 524fbed2a9624becb68f6e3c51f75f2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:11:10.974851 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-f03bf6d6-5289-41f7-a71d-b1a8d3fe82f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:11:10.975493 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-f03bf6d6-5289-41f7-a71d-b1a8d3fe82f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:11:10.976939 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1242/2481] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:11:10 2021] DELETE /identity/v3/projects/524fbed2a9624becb68f6e3c51f75f2d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:11:10.982977 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f22433-96ed-4f66-8c9c-06699f10b27b None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:11:10.983908 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f22433-96ed-4f66-8c9c-06699f10b27b None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:11:10.984259 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f22433-96ed-4f66-8c9c-06699f10b27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:11:11.010380 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-30f22433-96ed-4f66-8c9c-06699f10b27b None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:11:11.011563 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-30f22433-96ed-4f66-8c9c-06699f10b27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:11:11.095654 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1240/2482] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:11:10 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:11:11.097856 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e87107-49a4-4ae7-80b6-ca71c0fc7615 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:11:11.098347 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e87107-49a4-4ae7-80b6-ca71c0fc7615 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:11:11.098440 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e87107-49a4-4ae7-80b6-ca71c0fc7615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:11:11.116637 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f22433-96ed-4f66-8c9c-06699f10b27b None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:11:11.118191 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-30f22433-96ed-4f66-8c9c-06699f10b27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:11:11.142002 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-d0e87107-49a4-4ae7-80b6-ca71c0fc7615 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:11:11.143254 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-d0e87107-49a4-4ae7-80b6-ca71c0fc7615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:11:11.157253 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1243/2483] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:11:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:11:11.159045 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e87107-49a4-4ae7-80b6-ca71c0fc7615 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:11:11.168170 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e87107-49a4-4ae7-80b6-ca71c0fc7615 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:11:11.183955 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296836c8-636e-43fb-bc26-dc020de1fb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:11:11.185539 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296836c8-636e-43fb-bc26-dc020de1fb53 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:11:11.185940 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296836c8-636e-43fb-bc26-dc020de1fb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:11:11.186824 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296836c8-636e-43fb-bc26-dc020de1fb53 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:11:11.187854 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296836c8-636e-43fb-bc26-dc020de1fb53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:11:11.188660 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296836c8-636e-43fb-bc26-dc020de1fb53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:11:11.224019 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f22433-96ed-4f66-8c9c-06699f10b27b None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:11:11.225581 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296836c8-636e-43fb-bc26-dc020de1fb53 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:11:11.229781 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb83513-d53d-497b-81d5-99c6964b82e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:11:11.230467 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb83513-d53d-497b-81d5-99c6964b82e2 service nova] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:11:11.230760 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb83513-d53d-497b-81d5-99c6964b82e2 service nova] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:11:11.231046 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb83513-d53d-497b-81d5-99c6964b82e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:11:11.236844 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-7eb83513-d53d-497b-81d5-99c6964b82e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:11:11.249041 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1244/2484] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:11:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:11:11.254053 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296836c8-636e-43fb-bc26-dc020de1fb53 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:11:11.260599 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb83513-d53d-497b-81d5-99c6964b82e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:11:11.269271 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296836c8-636e-43fb-bc26-dc020de1fb53 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:11:11.278210 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d69a6e-a63a-4801-b296-6a8830e6707f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:11:11.279659 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d69a6e-a63a-4801-b296-6a8830e6707f admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:11:11.280308 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d69a6e-a63a-4801-b296-6a8830e6707f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:11:11.280827 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d69a6e-a63a-4801-b296-6a8830e6707f admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:11:11.282599 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d69a6e-a63a-4801-b296-6a8830e6707f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:11:11.288345 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb83513-d53d-497b-81d5-99c6964b82e2 service nova] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:11:11.301401 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1241/2485] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:11:11 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:11:11.323833 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d69a6e-a63a-4801-b296-6a8830e6707f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:11:11.367829 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1245/2486] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:11:11 2021] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:11:11.372636 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb83513-d53d-497b-81d5-99c6964b82e2 service nova] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:11:11.389997 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb83513-d53d-497b-81d5-99c6964b82e2 service nova] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:11:11.547732 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c323d-7ec2-45b0-bb00-5bd884adf64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:11:11.548362 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c323d-7ec2-45b0-bb00-5bd884adf64f admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:11:11.548656 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c323d-7ec2-45b0-bb00-5bd884adf64f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:11:11.549028 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c323d-7ec2-45b0-bb00-5bd884adf64f admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:11:11.550022 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c323d-7ec2-45b0-bb00-5bd884adf64f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:11:11.625219 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c323d-7ec2-45b0-bb00-5bd884adf64f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:11:11.657624 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1242/2487] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:11:11 2021] POST /identity/v3/users => generated 287 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:11:11.663982 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d69a6e-a63a-4801-b296-6a8830e6707f admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:11:11.675604 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d69a6e-a63a-4801-b296-6a8830e6707f admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:11:11.680435 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09526e4-dedd-4bf5-8a42-2b7b5cf6a84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:11:11.681054 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09526e4-dedd-4bf5-8a42-2b7b5cf6a84f admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:11:11.681339 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09526e4-dedd-4bf5-8a42-2b7b5cf6a84f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:11:11.681617 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09526e4-dedd-4bf5-8a42-2b7b5cf6a84f admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:11:11.682534 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09526e4-dedd-4bf5-8a42-2b7b5cf6a84f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:11:11.709752 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09526e4-dedd-4bf5-8a42-2b7b5cf6a84f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:11:11.721384 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1246/2488] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:11:11 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:11:11.725385 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c323d-7ec2-45b0-bb00-5bd884adf64f admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:11:11.738126 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c323d-7ec2-45b0-bb00-5bd884adf64f admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:11:11.749702 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09fafb7-2c6b-426e-9964-557b01e6719c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:11:11.750649 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09fafb7-2c6b-426e-9964-557b01e6719c admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:11:11.751004 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09fafb7-2c6b-426e-9964-557b01e6719c admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:11:11.753574 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09fafb7-2c6b-426e-9964-557b01e6719c admin admin] PATH_INFO: `/v3/projects/d220deb2c33140c686078aa4d9dca760/users/4edc4c662d2948e083a04c001cff47f1/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:11:11.801166 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09fafb7-2c6b-426e-9964-557b01e6719c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d220deb2c33140c686078aa4d9dca760, user_id=4edc4c662d2948e083a04c001cff47f1, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:11:11.829006 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09fafb7-2c6b-426e-9964-557b01e6719c admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:11:11.848498 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1243/2489] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:11:11 2021] PUT /identity/v3/projects/d220deb2c33140c686078aa4d9dca760/users/4edc4c662d2948e083a04c001cff47f1/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:11:11.851712 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2718e-957d-4c5f-bf6a-4569eda8ff5f None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:11:11.852015 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2718e-957d-4c5f-bf6a-4569eda8ff5f None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:11:11.852291 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2718e-957d-4c5f-bf6a-4569eda8ff5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:11:11.876092 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-6ba2718e-957d-4c5f-bf6a-4569eda8ff5f None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:11:11.878210 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-6ba2718e-957d-4c5f-bf6a-4569eda8ff5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:11:11.946344 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1247/2490] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:11:11 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:11:11.957085 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09fafb7-2c6b-426e-9964-557b01e6719c admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:11:11.958846 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-d09fafb7-2c6b-426e-9964-557b01e6719c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:11:12.036011 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09fafb7-2c6b-426e-9964-557b01e6719c admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:11:12.040148 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48864f0-4523-45e3-a57d-2d6f552d326a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:11:12.040929 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48864f0-4523-45e3-a57d-2d6f552d326a service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:11:12.041387 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48864f0-4523-45e3-a57d-2d6f552d326a service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:11:12.041822 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48864f0-4523-45e3-a57d-2d6f552d326a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:11:12.051816 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48864f0-4523-45e3-a57d-2d6f552d326a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:11:12.078114 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48864f0-4523-45e3-a57d-2d6f552d326a service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:11:12.089116 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1244/2491] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:11:11 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:11:18.003061 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54983341-0c90-4513-86c7-6d1e3166daca None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:11:18.003664 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54983341-0c90-4513-86c7-6d1e3166daca None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:11:18.003664 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54983341-0c90-4513-86c7-6d1e3166daca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:11:18.054401 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-54983341-0c90-4513-86c7-6d1e3166daca None None] MFA Rules not processed for user `4edc4c662d2948e083a04c001cff47f1`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:11:18.056140 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-54983341-0c90-4513-86c7-6d1e3166daca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:11:18.135234 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1248/2492] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:11:18 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:11:18.139825 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48864f0-4523-45e3-a57d-2d6f552d326a service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:11:18.151564 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48864f0-4523-45e3-a57d-2d6f552d326a service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:11:18.156055 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd5e17-2720-400b-9963-0633c314b43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:11:18.156729 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd5e17-2720-400b-9963-0633c314b43b admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:11:18.157020 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd5e17-2720-400b-9963-0633c314b43b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:11:18.157301 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd5e17-2720-400b-9963-0633c314b43b admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:11:18.157955 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd5e17-2720-400b-9963-0633c314b43b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:11:18.184419 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd5e17-2720-400b-9963-0633c314b43b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:11:18.218793 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1245/2493] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:11:18 2021] POST /identity/v3/projects => generated 371 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:11:18.223062 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54983341-0c90-4513-86c7-6d1e3166daca None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:11:18.237702 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54983341-0c90-4513-86c7-6d1e3166daca None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:11:18.350298 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f4d83-140c-43fc-9e7e-8f142a1d9260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:11:18.350926 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f4d83-140c-43fc-9e7e-8f142a1d9260 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:11:18.351213 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f4d83-140c-43fc-9e7e-8f142a1d9260 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:11:18.351519 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200f4d83-140c-43fc-9e7e-8f142a1d9260 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:11:18.352341 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f4d83-140c-43fc-9e7e-8f142a1d9260 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:11:18.380104 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200f4d83-140c-43fc-9e7e-8f142a1d9260 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:11:18.403308 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1249/2494] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:11:18 2021] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:11:18.409234 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd5e17-2720-400b-9963-0633c314b43b admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:11:18.423579 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd5e17-2720-400b-9963-0633c314b43b admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:11:18.428628 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce15cd8-caec-4397-aea4-619a05fb3985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:11:18.429512 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce15cd8-caec-4397-aea4-619a05fb3985 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:11:18.429978 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce15cd8-caec-4397-aea4-619a05fb3985 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:11:18.430412 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce15cd8-caec-4397-aea4-619a05fb3985 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:11:18.431286 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce15cd8-caec-4397-aea4-619a05fb3985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:11:18.464912 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce15cd8-caec-4397-aea4-619a05fb3985 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:11:18.480084 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1246/2495] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:11:18 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:11:18.484399 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f4d83-140c-43fc-9e7e-8f142a1d9260 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:11:18.499106 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200f4d83-140c-43fc-9e7e-8f142a1d9260 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:11:18.506583 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05501587-df49-4e26-9cba-65929caab1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:11:18.507987 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05501587-df49-4e26-9cba-65929caab1c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:11:18.507987 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05501587-df49-4e26-9cba-65929caab1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:11:18.508413 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05501587-df49-4e26-9cba-65929caab1c1 admin admin] PATH_INFO: `/v3/projects/642b9302784d4e77a394768cab836462/users/5d0ed1111aaa448cbdbee3edaba99089/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:11:18.534422 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05501587-df49-4e26-9cba-65929caab1c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=642b9302784d4e77a394768cab836462, user_id=5d0ed1111aaa448cbdbee3edaba99089, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:11:18.563772 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05501587-df49-4e26-9cba-65929caab1c1 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:11:18.582031 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1250/2496] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:11:18 2021] PUT /identity/v3/projects/642b9302784d4e77a394768cab836462/users/5d0ed1111aaa448cbdbee3edaba99089/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:11:18.585899 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce15cd8-caec-4397-aea4-619a05fb3985 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:11:18.599039 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce15cd8-caec-4397-aea4-619a05fb3985 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:11:18.681620 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b919be1-efbb-45ee-af0f-96c3e3fd41b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:11:18.682289 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b919be1-efbb-45ee-af0f-96c3e3fd41b6 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:11:18.682573 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b919be1-efbb-45ee-af0f-96c3e3fd41b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:11:18.682955 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b919be1-efbb-45ee-af0f-96c3e3fd41b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:11:18.683695 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b919be1-efbb-45ee-af0f-96c3e3fd41b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:11:18.710345 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b919be1-efbb-45ee-af0f-96c3e3fd41b6 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:11:18.728885 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1247/2497] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:11:18 2021] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:11:18.729798 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05501587-df49-4e26-9cba-65929caab1c1 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:11:18.750252 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05501587-df49-4e26-9cba-65929caab1c1 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:11:18.758649 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ab7cc-1964-432a-952e-cee4b1c765c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:11:18.759864 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ab7cc-1964-432a-952e-cee4b1c765c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:11:18.760674 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ab7cc-1964-432a-952e-cee4b1c765c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:11:18.761037 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ab7cc-1964-432a-952e-cee4b1c765c0 admin admin] PATH_INFO: `/v3/projects/642b9302784d4e77a394768cab836462/users/5d0ed1111aaa448cbdbee3edaba99089/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:11:18.764681 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ab7cc-1964-432a-952e-cee4b1c765c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=642b9302784d4e77a394768cab836462, user_id=5d0ed1111aaa448cbdbee3edaba99089, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:11:18.808808 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ab7cc-1964-432a-952e-cee4b1c765c0 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:11:18.825442 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1251/2498] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:11:18 2021] PUT /identity/v3/projects/642b9302784d4e77a394768cab836462/users/5d0ed1111aaa448cbdbee3edaba99089/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:11:18.827954 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b919be1-efbb-45ee-af0f-96c3e3fd41b6 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:11:18.845342 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b919be1-efbb-45ee-af0f-96c3e3fd41b6 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:11:18.950869 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc7093-e5f6-4c1d-a0d1-8769040bc32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:11:18.951509 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc7093-e5f6-4c1d-a0d1-8769040bc32b admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:11:18.951804 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc7093-e5f6-4c1d-a0d1-8769040bc32b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:11:18.952084 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc7093-e5f6-4c1d-a0d1-8769040bc32b admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:11:18.952779 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc7093-e5f6-4c1d-a0d1-8769040bc32b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:11:18.977985 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc7093-e5f6-4c1d-a0d1-8769040bc32b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:11:18.989875 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1248/2499] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:11:18 2021] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:11:18.994107 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ab7cc-1964-432a-952e-cee4b1c765c0 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:11:19.005077 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ab7cc-1964-432a-952e-cee4b1c765c0 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:11:19.009606 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ed5fc-a72c-4421-9d55-0b8131c2da7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:11:19.010453 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ed5fc-a72c-4421-9d55-0b8131c2da7f admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:11:19.010738 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ed5fc-a72c-4421-9d55-0b8131c2da7f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:11:19.011770 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ed5fc-a72c-4421-9d55-0b8131c2da7f admin admin] PATH_INFO: `/v3/projects/642b9302784d4e77a394768cab836462/users/5d0ed1111aaa448cbdbee3edaba99089/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:11:19.012898 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ed5fc-a72c-4421-9d55-0b8131c2da7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=642b9302784d4e77a394768cab836462, user_id=5d0ed1111aaa448cbdbee3edaba99089, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:11:19.042317 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ed5fc-a72c-4421-9d55-0b8131c2da7f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:11:19.059912 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1252/2500] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:11:18 2021] PUT /identity/v3/projects/642b9302784d4e77a394768cab836462/users/5d0ed1111aaa448cbdbee3edaba99089/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:11:24.984392 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b8250-44fc-4571-9c51-5ea45b8b32c4 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:11:24.984984 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b8250-44fc-4571-9c51-5ea45b8b32c4 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:11:24.985302 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b8250-44fc-4571-9c51-5ea45b8b32c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:11:25.028358 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-413b8250-44fc-4571-9c51-5ea45b8b32c4 None None] MFA Rules not processed for user `ed972e6b35be47a8af2e86651ccc6911`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:11:25.029778 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-413b8250-44fc-4571-9c51-5ea45b8b32c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:11:25.107176 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1249/2501] 10.222.0.89 () {58 vars in 967 bytes} [Wed Oct 27 15:11:24 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:11:25.159528 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ed5fc-a72c-4421-9d55-0b8131c2da7f admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:11:25.162162 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-3e8ed5fc-a72c-4421-9d55-0b8131c2da7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:11:25.247785 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ed5fc-a72c-4421-9d55-0b8131c2da7f admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:11:25.254121 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37457d5a-6eee-4a89-877f-5a58d13dc213 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffba82bc9ddf42069a813b932bd310ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:11:25.254730 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37457d5a-6eee-4a89-877f-5a58d13dc213 service swift] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:11:25.255020 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37457d5a-6eee-4a89-877f-5a58d13dc213 service swift] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:11:25.255299 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37457d5a-6eee-4a89-877f-5a58d13dc213 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:11:25.264917 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37457d5a-6eee-4a89-877f-5a58d13dc213 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:11:25.290831 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37457d5a-6eee-4a89-877f-5a58d13dc213 service swift] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:11:25.300430 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1253/2502] 10.222.0.89 () {60 vars in 1384 bytes} [Wed Oct 27 15:11:25 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 15:11:25.498061 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3a312-ccfe-482f-90a7-c75c530db098 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:11:25.498459 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3a312-ccfe-482f-90a7-c75c530db098 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:11:25.498943 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3a312-ccfe-482f-90a7-c75c530db098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:11:25.538934 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-a4a3a312-ccfe-482f-90a7-c75c530db098 None None] MFA Rules not processed for user `5d0ed1111aaa448cbdbee3edaba99089`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:11:25.540262 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-a4a3a312-ccfe-482f-90a7-c75c530db098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:11:25.623829 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1250/2503] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:11:25 2021] POST /identity/v3/auth/tokens => generated 3745 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:11:25.635767 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37457d5a-6eee-4a89-877f-5a58d13dc213 service swift] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:11:25.730548 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37457d5a-6eee-4a89-877f-5a58d13dc213 service swift] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:11:25.735597 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9041e-e423-4aa7-b7d4-284a2b8ef4e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:11:25.736706 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9041e-e423-4aa7-b7d4-284a2b8ef4e7 service nova] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:11:25.736998 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9041e-e423-4aa7-b7d4-284a2b8ef4e7 service nova] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:11:25.737279 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9041e-e423-4aa7-b7d4-284a2b8ef4e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:11:25.811053 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9041e-e423-4aa7-b7d4-284a2b8ef4e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:11:25.837145 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec9041e-e423-4aa7-b7d4-284a2b8ef4e7 service nova] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:11:25.846793 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1254/2504] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:11:25 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:11:27.566065 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511c433-eda5-4592-9280-e053a1da01bd None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:11:27.566486 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511c433-eda5-4592-9280-e053a1da01bd None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:11:27.566624 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511c433-eda5-4592-9280-e053a1da01bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:11:27.594427 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-d511c433-eda5-4592-9280-e053a1da01bd None None] MFA Rules not processed for user `4edc4c662d2948e083a04c001cff47f1`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:11:27.596325 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-d511c433-eda5-4592-9280-e053a1da01bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:11:27.602952 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1251/2505] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:11:27 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:11:40.310475 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9041e-e423-4aa7-b7d4-284a2b8ef4e7 service nova] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:11:40.311953 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-3ec9041e-e423-4aa7-b7d4-284a2b8ef4e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:11:40.405810 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9041e-e423-4aa7-b7d4-284a2b8ef4e7 service nova] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:11:40.412951 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9a265-91ec-4c9e-99b6-89b05381b72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:11:40.414034 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9a265-91ec-4c9e-99b6-89b05381b72e admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:11:40.414529 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9a265-91ec-4c9e-99b6-89b05381b72e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:11:40.414806 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a9a265-91ec-4c9e-99b6-89b05381b72e admin admin] PATH_INFO: `/v3/users/cfd38937e0504a11bb1c9e5418047f23` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:11:40.416132 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a9a265-91ec-4c9e-99b6-89b05381b72e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfd38937e0504a11bb1c9e5418047f23)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:11:40.443945 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a9a265-91ec-4c9e-99b6-89b05381b72e admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:11:40.506279 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-53a9a265-91ec-4c9e-99b6-89b05381b72e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfd38937e0504a11bb1c9e5418047f23'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:11:40.506908 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-53a9a265-91ec-4c9e-99b6-89b05381b72e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfd38937e0504a11bb1c9e5418047f23'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:11:40.518855 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-53a9a265-91ec-4c9e-99b6-89b05381b72e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfd38937e0504a11bb1c9e5418047f23'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:11:40.527237 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-53a9a265-91ec-4c9e-99b6-89b05381b72e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfd38937e0504a11bb1c9e5418047f23'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:11:40.535520 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-53a9a265-91ec-4c9e-99b6-89b05381b72e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfd38937e0504a11bb1c9e5418047f23'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:11:40.544754 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1255/2506] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:11:40 2021] DELETE /identity/v3/users/cfd38937e0504a11bb1c9e5418047f23 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:11:40.828324 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511c433-eda5-4592-9280-e053a1da01bd None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:11:40.841397 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511c433-eda5-4592-9280-e053a1da01bd None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:11:40.907089 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b8eb9-91b1-454a-892d-2c90ab30918f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:11:40.908474 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b8eb9-91b1-454a-892d-2c90ab30918f admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:11:40.908707 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b8eb9-91b1-454a-892d-2c90ab30918f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:11:40.908987 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b8eb9-91b1-454a-892d-2c90ab30918f admin admin] PATH_INFO: `/v3/projects/0ef0fcc833424463b242c242eeeaebf1` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:11:40.910099 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b8eb9-91b1-454a-892d-2c90ab30918f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ef0fcc833424463b242c242eeeaebf1)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:11:40.936294 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b8eb9-91b1-454a-892d-2c90ab30918f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:11:40.987990 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-5d3b8eb9-91b1-454a-892d-2c90ab30918f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ef0fcc833424463b242c242eeeaebf1', 'request_id': 'req-5d3b8eb9-91b1-454a-892d-2c90ab30918f'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:11:40.993400 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-5d3b8eb9-91b1-454a-892d-2c90ab30918f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ef0fcc833424463b242c242eeeaebf1', 'request_id': 'req-5d3b8eb9-91b1-454a-892d-2c90ab30918f'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:11:41.005273 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-5d3b8eb9-91b1-454a-892d-2c90ab30918f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ef0fcc833424463b242c242eeeaebf1', 'request_id': 'req-5d3b8eb9-91b1-454a-892d-2c90ab30918f'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:11:41.018996 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-5d3b8eb9-91b1-454a-892d-2c90ab30918f admin admin] The token cache is being invalidate because project 0ef0fcc833424463b242c242eeeaebf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:11:41.019283 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-5d3b8eb9-91b1-454a-892d-2c90ab30918f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:11:41.019966 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-5d3b8eb9-91b1-454a-892d-2c90ab30918f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:11:41.021424 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1252/2507] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:11:40 2021] DELETE /identity/v3/projects/0ef0fcc833424463b242c242eeeaebf1 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:11:41.027160 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9a265-91ec-4c9e-99b6-89b05381b72e admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:11:41.028645 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-53a9a265-91ec-4c9e-99b6-89b05381b72e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:11:41.041856 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a9a265-91ec-4c9e-99b6-89b05381b72e admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:11:41.107851 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84716b-2db4-498f-871d-a3ccb230088e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:11:41.108658 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84716b-2db4-498f-871d-a3ccb230088e admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:11:41.108945 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84716b-2db4-498f-871d-a3ccb230088e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:11:41.109226 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84716b-2db4-498f-871d-a3ccb230088e admin admin] PATH_INFO: `/v3/users/eda1dc32746a433098fc2ce168aed965` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:11:41.110348 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84716b-2db4-498f-871d-a3ccb230088e admin admin] RBAC: Authorizing `identity:delete_user(user_id=eda1dc32746a433098fc2ce168aed965)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:11:41.135993 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84716b-2db4-498f-871d-a3ccb230088e admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:11:41.186248 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-1b84716b-2db4-498f-871d-a3ccb230088e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eda1dc32746a433098fc2ce168aed965'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:11:41.186818 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-1b84716b-2db4-498f-871d-a3ccb230088e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eda1dc32746a433098fc2ce168aed965'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:11:41.199622 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-1b84716b-2db4-498f-871d-a3ccb230088e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eda1dc32746a433098fc2ce168aed965'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:11:41.208229 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-1b84716b-2db4-498f-871d-a3ccb230088e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eda1dc32746a433098fc2ce168aed965'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:11:41.216730 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-1b84716b-2db4-498f-871d-a3ccb230088e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eda1dc32746a433098fc2ce168aed965'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:11:41.223516 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1256/2508] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:11:41 2021] DELETE /identity/v3/users/eda1dc32746a433098fc2ce168aed965 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:11:41.455789 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b8eb9-91b1-454a-892d-2c90ab30918f admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:11:41.457287 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-5d3b8eb9-91b1-454a-892d-2c90ab30918f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:11:41.470439 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b8eb9-91b1-454a-892d-2c90ab30918f admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:11:41.535582 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919e860-1a85-4bd5-9bc1-b1566dd79af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:11:41.536387 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919e860-1a85-4bd5-9bc1-b1566dd79af2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:11:41.536681 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919e860-1a85-4bd5-9bc1-b1566dd79af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:11:41.536959 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9919e860-1a85-4bd5-9bc1-b1566dd79af2 admin admin] PATH_INFO: `/v3/projects/17370a1e14984734adf98f923348836e` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:11:41.538093 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919e860-1a85-4bd5-9bc1-b1566dd79af2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17370a1e14984734adf98f923348836e)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:11:41.564326 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9919e860-1a85-4bd5-9bc1-b1566dd79af2 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:11:41.618046 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-9919e860-1a85-4bd5-9bc1-b1566dd79af2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17370a1e14984734adf98f923348836e', 'request_id': 'req-9919e860-1a85-4bd5-9bc1-b1566dd79af2'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:11:41.623526 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-9919e860-1a85-4bd5-9bc1-b1566dd79af2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17370a1e14984734adf98f923348836e', 'request_id': 'req-9919e860-1a85-4bd5-9bc1-b1566dd79af2'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:11:41.635179 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-9919e860-1a85-4bd5-9bc1-b1566dd79af2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17370a1e14984734adf98f923348836e', 'request_id': 'req-9919e860-1a85-4bd5-9bc1-b1566dd79af2'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:11:41.647607 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-9919e860-1a85-4bd5-9bc1-b1566dd79af2 admin admin] The token cache is being invalidate because project 17370a1e14984734adf98f923348836e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:11:41.647890 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-9919e860-1a85-4bd5-9bc1-b1566dd79af2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:11:41.648544 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-9919e860-1a85-4bd5-9bc1-b1566dd79af2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:11:41.650436 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1253/2509] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:11:41 2021] DELETE /identity/v3/projects/17370a1e14984734adf98f923348836e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:12:03.003963 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84716b-2db4-498f-871d-a3ccb230088e admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:12:03.005961 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-1b84716b-2db4-498f-871d-a3ccb230088e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:12:03.089543 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84716b-2db4-498f-871d-a3ccb230088e admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:12:03.160431 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6590cc21-e91b-4bca-825e-84ac5d1e7f2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:12:03.161023 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590cc21-e91b-4bca-825e-84ac5d1e7f2c service nova] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:12:03.161314 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590cc21-e91b-4bca-825e-84ac5d1e7f2c service nova] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:12:03.161597 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6590cc21-e91b-4bca-825e-84ac5d1e7f2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:12:03.163280 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-6590cc21-e91b-4bca-825e-84ac5d1e7f2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:12:03.174934 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6590cc21-e91b-4bca-825e-84ac5d1e7f2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:12:03.200079 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6590cc21-e91b-4bca-825e-84ac5d1e7f2c service nova] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:12:03.211182 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1257/2510] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:12:03 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:12:06.691597 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919e860-1a85-4bd5-9bc1-b1566dd79af2 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:12:06.692976 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-9919e860-1a85-4bd5-9bc1-b1566dd79af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:12:06.758685 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9919e860-1a85-4bd5-9bc1-b1566dd79af2 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:12:06.761910 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3e03c-6aa8-4626-9f0e-ac1cd64d39e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:12:06.762497 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3e03c-6aa8-4626-9f0e-ac1cd64d39e2 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:12:06.762779 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3e03c-6aa8-4626-9f0e-ac1cd64d39e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:12:06.763051 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3e03c-6aa8-4626-9f0e-ac1cd64d39e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:12:06.764687 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-5cd3e03c-6aa8-4626-9f0e-ac1cd64d39e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:12:06.834507 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3e03c-6aa8-4626-9f0e-ac1cd64d39e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:12:06.860145 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3e03c-6aa8-4626-9f0e-ac1cd64d39e2 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:12:06.870594 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1254/2511] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:12:06 2021] GET /identity/v3/auth/tokens => generated 3745 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:12:08.755431 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68898e3-2d09-4021-b07c-513d0db49c95 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:12:08.756032 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68898e3-2d09-4021-b07c-513d0db49c95 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:12:08.756032 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68898e3-2d09-4021-b07c-513d0db49c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:12:08.780072 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-e68898e3-2d09-4021-b07c-513d0db49c95 None None] MFA Rules not processed for user `ed972e6b35be47a8af2e86651ccc6911`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:12:08.781238 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-e68898e3-2d09-4021-b07c-513d0db49c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:12:08.851614 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1258/2512] 10.222.0.89 () {58 vars in 1014 bytes} [Wed Oct 27 15:12:08 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:12:08.861358 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3e03c-6aa8-4626-9f0e-ac1cd64d39e2 service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:12:08.862844 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-5cd3e03c-6aa8-4626-9f0e-ac1cd64d39e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:12:08.964795 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3e03c-6aa8-4626-9f0e-ac1cd64d39e2 service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:12:08.973788 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286ee40-caaf-4c2f-9ef8-912060965804 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffba82bc9ddf42069a813b932bd310ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:12:08.974390 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286ee40-caaf-4c2f-9ef8-912060965804 service swift] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:12:08.974673 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286ee40-caaf-4c2f-9ef8-912060965804 service swift] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:12:08.974948 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286ee40-caaf-4c2f-9ef8-912060965804 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:12:08.983664 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286ee40-caaf-4c2f-9ef8-912060965804 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:12:09.010155 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286ee40-caaf-4c2f-9ef8-912060965804 service swift] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:12:09.019179 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1255/2513] 10.222.0.89 () {60 vars in 1384 bytes} [Wed Oct 27 15:12:08 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 15:12:24.932840 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68898e3-2d09-4021-b07c-513d0db49c95 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:12:24.934253 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-e68898e3-2d09-4021-b07c-513d0db49c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:12:24.947164 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68898e3-2d09-4021-b07c-513d0db49c95 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:12:24.950568 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34806b26-002e-4428-84fd-a2ba1d544c27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:12:24.951125 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34806b26-002e-4428-84fd-a2ba1d544c27 service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:12:24.951502 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34806b26-002e-4428-84fd-a2ba1d544c27 service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:12:24.952337 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34806b26-002e-4428-84fd-a2ba1d544c27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:12:24.954135 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-34806b26-002e-4428-84fd-a2ba1d544c27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:12:24.964524 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34806b26-002e-4428-84fd-a2ba1d544c27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:12:24.990156 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34806b26-002e-4428-84fd-a2ba1d544c27 service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:12:24.999327 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1259/2514] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:12:24 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:12:25.302041 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fd302-0055-40d2-a070-be8d9b0f8931 None None] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:12:25.302635 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fd302-0055-40d2-a070-be8d9b0f8931 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:12:25.302635 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9fd302-0055-40d2-a070-be8d9b0f8931 None None] PATH_INFO: `/` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:12:25.304317 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1256/2515] 10.222.0.89 () {54 vars in 921 bytes} [Wed Oct 27 15:12:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 15:12:25.310189 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b0397-9818-4dcc-b5c6-c949c4788ec0 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:12:25.310480 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b0397-9818-4dcc-b5c6-c949c4788ec0 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:12:25.310763 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b0397-9818-4dcc-b5c6-c949c4788ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:12:25.337223 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-504b0397-9818-4dcc-b5c6-c949c4788ec0 None None] MFA Rules not processed for user `ab1b41f8980348fc878e492e26078e33`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:12:25.338542 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-504b0397-9818-4dcc-b5c6-c949c4788ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:12:25.345890 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1260/2516] 10.222.0.89 () {58 vars in 1018 bytes} [Wed Oct 27 15:12:25 2021] POST /identity/v3/auth/tokens => generated 3551 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:12:25.365192 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fd302-0055-40d2-a070-be8d9b0f8931 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:12:25.377643 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9fd302-0055-40d2-a070-be8d9b0f8931 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:12:25.381183 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448eebb1-9880-438e-b2f4-70d7cbcfd0aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:12:25.381880 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448eebb1-9880-438e-b2f4-70d7cbcfd0aa service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:12:25.382603 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448eebb1-9880-438e-b2f4-70d7cbcfd0aa service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:12:25.382895 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448eebb1-9880-438e-b2f4-70d7cbcfd0aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:12:25.394501 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448eebb1-9880-438e-b2f4-70d7cbcfd0aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:12:25.421239 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448eebb1-9880-438e-b2f4-70d7cbcfd0aa service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:12:25.431930 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1257/2517] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:12:25 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:12:27.572821 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c007a8-8e90-49e1-9d4f-a21659893a82 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:12:27.573349 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c007a8-8e90-49e1-9d4f-a21659893a82 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:12:27.573462 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c007a8-8e90-49e1-9d4f-a21659893a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:12:27.599661 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-69c007a8-8e90-49e1-9d4f-a21659893a82 None None] MFA Rules not processed for user `ed972e6b35be47a8af2e86651ccc6911`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:12:27.600840 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-69c007a8-8e90-49e1-9d4f-a21659893a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:12:27.607446 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1261/2518] 10.222.0.89 () {58 vars in 1014 bytes} [Wed Oct 27 15:12:27 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:12:27.629343 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448eebb1-9880-438e-b2f4-70d7cbcfd0aa service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:12:27.643680 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448eebb1-9880-438e-b2f4-70d7cbcfd0aa service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:12:27.645798 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029a5c1-8954-49b9-8d3b-60fcf413f537 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffba82bc9ddf42069a813b932bd310ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:12:27.646378 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029a5c1-8954-49b9-8d3b-60fcf413f537 service swift] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:12:27.646665 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029a5c1-8954-49b9-8d3b-60fcf413f537 service swift] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:12:27.646948 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029a5c1-8954-49b9-8d3b-60fcf413f537 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:12:27.655608 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029a5c1-8954-49b9-8d3b-60fcf413f537 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:12:27.681690 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029a5c1-8954-49b9-8d3b-60fcf413f537 service swift] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:12:27.692255 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1258/2519] 10.222.0.89 () {60 vars in 1384 bytes} [Wed Oct 27 15:12:27 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 15:12:44.708644 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330962c-eeac-4209-aba6-d084d70b52dc None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:12:44.709279 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330962c-eeac-4209-aba6-d084d70b52dc None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:12:44.709279 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8330962c-eeac-4209-aba6-d084d70b52dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:12:44.732985 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-8330962c-eeac-4209-aba6-d084d70b52dc None None] MFA Rules not processed for user `ed972e6b35be47a8af2e86651ccc6911`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:12:44.734117 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-8330962c-eeac-4209-aba6-d084d70b52dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:12:44.741088 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1262/2520] 10.222.0.89 () {58 vars in 967 bytes} [Wed Oct 27 15:12:44 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:12:44.753221 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029a5c1-8954-49b9-8d3b-60fcf413f537 service swift] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:12:44.763911 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029a5c1-8954-49b9-8d3b-60fcf413f537 service swift] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:12:44.768760 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55048b4-e471-4321-8063-d08b3503d4ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffba82bc9ddf42069a813b932bd310ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:12:44.769337 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55048b4-e471-4321-8063-d08b3503d4ee service swift] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:12:44.769688 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55048b4-e471-4321-8063-d08b3503d4ee service swift] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:12:44.769933 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55048b4-e471-4321-8063-d08b3503d4ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:12:44.778853 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55048b4-e471-4321-8063-d08b3503d4ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:12:44.804856 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55048b4-e471-4321-8063-d08b3503d4ee service swift] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:12:44.813527 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1259/2521] 10.222.0.89 () {60 vars in 1384 bytes} [Wed Oct 27 15:12:44 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 15:13:26.774410 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330962c-eeac-4209-aba6-d084d70b52dc None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:26.776720 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-8330962c-eeac-4209-aba6-d084d70b52dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:26.888849 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8330962c-eeac-4209-aba6-d084d70b52dc None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:26.894792 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f43458-fa6d-480f-a66d-294b5ad38b00 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcbab075fd5b4a889c2002639ca9d60a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:26.895370 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f43458-fa6d-480f-a66d-294b5ad38b00 service placement] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:26.895750 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f43458-fa6d-480f-a66d-294b5ad38b00 service placement] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:26.896031 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f43458-fa6d-480f-a66d-294b5ad38b00 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:26.897889 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-33f43458-fa6d-480f-a66d-294b5ad38b00 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:26.910328 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f43458-fa6d-480f-a66d-294b5ad38b00 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:26.935784 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f43458-fa6d-480f-a66d-294b5ad38b00 service placement] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:26.946625 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1263/2522] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:13:26 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:13:30.973521 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de994032-1b4e-4f84-9c8f-d867da11df25 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:30.974101 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de994032-1b4e-4f84-9c8f-d867da11df25 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:30.974101 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de994032-1b4e-4f84-9c8f-d867da11df25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:30.996878 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-de994032-1b4e-4f84-9c8f-d867da11df25 None None] MFA Rules not processed for user `9e7f42dfb1c443dfa39b62736029931a`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:13:30.998029 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-de994032-1b4e-4f84-9c8f-d867da11df25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:31.060302 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1260/2523] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:13:30 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:13:31.321220 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f43458-fa6d-480f-a66d-294b5ad38b00 service placement] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:31.332778 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f43458-fa6d-480f-a66d-294b5ad38b00 service placement] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:31.336155 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2691c-c40c-4acf-bea2-152e06ac501a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:31.336799 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2691c-c40c-4acf-bea2-152e06ac501a service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:31.337085 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2691c-c40c-4acf-bea2-152e06ac501a service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:31.337358 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2691c-c40c-4acf-bea2-152e06ac501a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:31.339353 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-d8a2691c-c40c-4acf-bea2-152e06ac501a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:31.416386 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a2691c-c40c-4acf-bea2-152e06ac501a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:31.442042 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a2691c-c40c-4acf-bea2-152e06ac501a service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:31.453088 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1264/2524] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:13:31 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:13:37.892693 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de994032-1b4e-4f84-9c8f-d867da11df25 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:37.894217 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-de994032-1b4e-4f84-9c8f-d867da11df25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:37.907657 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de994032-1b4e-4f84-9c8f-d867da11df25 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:37.912263 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50af187-f3f8-4e4e-b53f-90bb71599357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:37.913055 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50af187-f3f8-4e4e-b53f-90bb71599357 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:37.913341 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50af187-f3f8-4e4e-b53f-90bb71599357 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:37.913618 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50af187-f3f8-4e4e-b53f-90bb71599357 admin admin] PATH_INFO: `/v3/users/3a3324c92a85423e9ab73178f876d531` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:37.914689 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50af187-f3f8-4e4e-b53f-90bb71599357 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a3324c92a85423e9ab73178f876d531)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:37.940890 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50af187-f3f8-4e4e-b53f-90bb71599357 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:37.998407 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-a50af187-f3f8-4e4e-b53f-90bb71599357 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a3324c92a85423e9ab73178f876d531'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:38.013882 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-a50af187-f3f8-4e4e-b53f-90bb71599357 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a3324c92a85423e9ab73178f876d531'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:38.014528 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-a50af187-f3f8-4e4e-b53f-90bb71599357 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a3324c92a85423e9ab73178f876d531'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:38.023970 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-a50af187-f3f8-4e4e-b53f-90bb71599357 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a3324c92a85423e9ab73178f876d531'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:38.031926 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-a50af187-f3f8-4e4e-b53f-90bb71599357 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a3324c92a85423e9ab73178f876d531'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:38.038182 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1261/2525] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:13:37 2021] DELETE /identity/v3/users/3a3324c92a85423e9ab73178f876d531 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:13:38.272840 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2691c-c40c-4acf-bea2-152e06ac501a service neutron] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:38.291555 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2691c-c40c-4acf-bea2-152e06ac501a service neutron] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:38.378832 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a7e1b-d7a1-4f01-9e53-193072588f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:38.379610 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a7e1b-d7a1-4f01-9e53-193072588f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:38.380033 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a7e1b-d7a1-4f01-9e53-193072588f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:38.380466 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a7e1b-d7a1-4f01-9e53-193072588f70 admin admin] PATH_INFO: `/v3/projects/ef93e3d769ba40e79c626d3bc351a81c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:38.382033 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a7e1b-d7a1-4f01-9e53-193072588f70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef93e3d769ba40e79c626d3bc351a81c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:38.430741 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a7e1b-d7a1-4f01-9e53-193072588f70 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:38.499424 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-684a7e1b-d7a1-4f01-9e53-193072588f70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef93e3d769ba40e79c626d3bc351a81c', 'request_id': 'req-684a7e1b-d7a1-4f01-9e53-193072588f70'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:38.506044 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-684a7e1b-d7a1-4f01-9e53-193072588f70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef93e3d769ba40e79c626d3bc351a81c', 'request_id': 'req-684a7e1b-d7a1-4f01-9e53-193072588f70'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:38.524068 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-684a7e1b-d7a1-4f01-9e53-193072588f70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef93e3d769ba40e79c626d3bc351a81c', 'request_id': 'req-684a7e1b-d7a1-4f01-9e53-193072588f70'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:38.536303 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-684a7e1b-d7a1-4f01-9e53-193072588f70 admin admin] The token cache is being invalidate because project ef93e3d769ba40e79c626d3bc351a81c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:13:38.536585 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-684a7e1b-d7a1-4f01-9e53-193072588f70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:38.537163 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-684a7e1b-d7a1-4f01-9e53-193072588f70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:38.538566 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1265/2526] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:13:38 2021] DELETE /identity/v3/projects/ef93e3d769ba40e79c626d3bc351a81c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:13:38.544270 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58932997-a009-4069-9368-3d6b538ffcda None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:38.544564 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58932997-a009-4069-9368-3d6b538ffcda None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:38.544868 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58932997-a009-4069-9368-3d6b538ffcda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:38.568697 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-58932997-a009-4069-9368-3d6b538ffcda None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:13:38.569850 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-58932997-a009-4069-9368-3d6b538ffcda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:38.634242 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1262/2527] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:13:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:13:38.642153 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccedc07-4f4a-4319-a2a2-286d2183b966 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:38.643106 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccedc07-4f4a-4319-a2a2-286d2183b966 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:38.643542 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccedc07-4f4a-4319-a2a2-286d2183b966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:38.666341 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-3ccedc07-4f4a-4319-a2a2-286d2183b966 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:13:38.667529 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-3ccedc07-4f4a-4319-a2a2-286d2183b966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:38.675264 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1266/2528] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:13:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:13:38.679602 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58932997-a009-4069-9368-3d6b538ffcda None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:38.689164 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58932997-a009-4069-9368-3d6b538ffcda None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:38.695642 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f8c05-a94c-499b-b766-70e619cdb5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:38.696446 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f8c05-a94c-499b-b766-70e619cdb5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:38.697077 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f8c05-a94c-499b-b766-70e619cdb5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:38.697203 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f8c05-a94c-499b-b766-70e619cdb5c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:38.698007 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f8c05-a94c-499b-b766-70e619cdb5c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:13:38.698411 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f8c05-a94c-499b-b766-70e619cdb5c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:38.725892 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f8c05-a94c-499b-b766-70e619cdb5c8 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:38.741058 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1263/2529] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:13:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:13:38.745760 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccedc07-4f4a-4319-a2a2-286d2183b966 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:38.755491 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccedc07-4f4a-4319-a2a2-286d2183b966 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:38.759819 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea9aff-f9e7-42be-9033-8f404ac1350a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:38.760406 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea9aff-f9e7-42be-9033-8f404ac1350a admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:38.760698 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea9aff-f9e7-42be-9033-8f404ac1350a admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:38.760980 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea9aff-f9e7-42be-9033-8f404ac1350a admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:38.761622 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea9aff-f9e7-42be-9033-8f404ac1350a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:38.788067 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ea9aff-f9e7-42be-9033-8f404ac1350a admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:38.830599 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1267/2530] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:13:38 2021] POST /identity/v3/projects => generated 369 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:13:38.834491 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f8c05-a94c-499b-b766-70e619cdb5c8 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:38.844793 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f8c05-a94c-499b-b766-70e619cdb5c8 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:38.914737 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb799b8-68e1-4d7c-b424-bb1528194f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:38.915506 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb799b8-68e1-4d7c-b424-bb1528194f4b admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:38.915643 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb799b8-68e1-4d7c-b424-bb1528194f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:38.915890 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb799b8-68e1-4d7c-b424-bb1528194f4b admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:38.916529 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb799b8-68e1-4d7c-b424-bb1528194f4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:38.942641 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb799b8-68e1-4d7c-b424-bb1528194f4b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:38.966780 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1264/2531] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:13:38 2021] POST /identity/v3/users => generated 285 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:13:38.967992 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea9aff-f9e7-42be-9033-8f404ac1350a admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:38.978455 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ea9aff-f9e7-42be-9033-8f404ac1350a admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:38.983035 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7311e3c1-0047-4c85-b61b-e6fc2633cef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:38.983667 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311e3c1-0047-4c85-b61b-e6fc2633cef7 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:38.983960 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311e3c1-0047-4c85-b61b-e6fc2633cef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:38.984247 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7311e3c1-0047-4c85-b61b-e6fc2633cef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:38.984953 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311e3c1-0047-4c85-b61b-e6fc2633cef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:39.011000 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7311e3c1-0047-4c85-b61b-e6fc2633cef7 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:39.029598 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1268/2532] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:13:38 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:13:39.031125 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb799b8-68e1-4d7c-b424-bb1528194f4b admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:39.041181 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb799b8-68e1-4d7c-b424-bb1528194f4b admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:39.045956 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1cbb2-dee4-4a0c-a47e-bcd424579ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:39.046771 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1cbb2-dee4-4a0c-a47e-bcd424579ee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:39.047054 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1cbb2-dee4-4a0c-a47e-bcd424579ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:39.047332 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1cbb2-dee4-4a0c-a47e-bcd424579ee4 admin admin] PATH_INFO: `/v3/projects/0cdca74804194bacb61927b4d6c8c1e5/users/52fcf92e4bdf48bfb8ae4fc5448345e2/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:39.068840 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1cbb2-dee4-4a0c-a47e-bcd424579ee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cdca74804194bacb61927b4d6c8c1e5, user_id=52fcf92e4bdf48bfb8ae4fc5448345e2, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:39.094976 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1cbb2-dee4-4a0c-a47e-bcd424579ee4 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:39.108398 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1265/2533] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:13:39 2021] PUT /identity/v3/projects/0cdca74804194bacb61927b4d6c8c1e5/users/52fcf92e4bdf48bfb8ae4fc5448345e2/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:13:39.119097 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad769ca-1433-48ee-b499-fb2ac21f6038 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:39.119407 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad769ca-1433-48ee-b499-fb2ac21f6038 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:39.119713 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad769ca-1433-48ee-b499-fb2ac21f6038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:39.157985 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-bad769ca-1433-48ee-b499-fb2ac21f6038 None None] MFA Rules not processed for user `52fcf92e4bdf48bfb8ae4fc5448345e2`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:13:39.159135 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-bad769ca-1433-48ee-b499-fb2ac21f6038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:39.232842 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1269/2534] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:13:39 2021] POST /identity/v3/auth/tokens => generated 3676 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:13:39.239254 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1cbb2-dee4-4a0c-a47e-bcd424579ee4 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:39.309954 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1cbb2-dee4-4a0c-a47e-bcd424579ee4 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:39.315106 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc6a80-3f28-49a2-bb77-8a79a5b26780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:39.315746 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc6a80-3f28-49a2-bb77-8a79a5b26780 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:39.316014 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc6a80-3f28-49a2-bb77-8a79a5b26780 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:39.316684 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc6a80-3f28-49a2-bb77-8a79a5b26780 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:39.316939 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc6a80-3f28-49a2-bb77-8a79a5b26780 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:39.342269 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc6a80-3f28-49a2-bb77-8a79a5b26780 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:39.372037 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1266/2535] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:13:39 2021] POST /identity/v3/projects => generated 369 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:13:39.375868 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad769ca-1433-48ee-b499-fb2ac21f6038 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:39.386813 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad769ca-1433-48ee-b499-fb2ac21f6038 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:39.454601 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540737b1-f0c3-4b3f-8cea-a9572ea2940b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:39.455257 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540737b1-f0c3-4b3f-8cea-a9572ea2940b admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:39.455584 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540737b1-f0c3-4b3f-8cea-a9572ea2940b admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:39.455870 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540737b1-f0c3-4b3f-8cea-a9572ea2940b admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:39.456524 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540737b1-f0c3-4b3f-8cea-a9572ea2940b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:39.482665 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540737b1-f0c3-4b3f-8cea-a9572ea2940b admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:39.505830 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1270/2536] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:13:39 2021] POST /identity/v3/users => generated 291 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:13:39.509869 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc6a80-3f28-49a2-bb77-8a79a5b26780 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:39.520669 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc6a80-3f28-49a2-bb77-8a79a5b26780 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:39.525692 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e289cc-1d86-41a9-ad60-6712d1bbb362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:39.526302 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e289cc-1d86-41a9-ad60-6712d1bbb362 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:39.526590 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e289cc-1d86-41a9-ad60-6712d1bbb362 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:39.526879 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e289cc-1d86-41a9-ad60-6712d1bbb362 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:39.527616 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e289cc-1d86-41a9-ad60-6712d1bbb362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:39.553256 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e289cc-1d86-41a9-ad60-6712d1bbb362 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:39.565824 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1267/2537] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:13:39 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:13:39.569999 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540737b1-f0c3-4b3f-8cea-a9572ea2940b admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:39.579808 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540737b1-f0c3-4b3f-8cea-a9572ea2940b admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:39.584716 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a8565-1258-42d4-987b-913c95b392be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:39.585539 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a8565-1258-42d4-987b-913c95b392be admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:39.585831 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a8565-1258-42d4-987b-913c95b392be admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:39.586109 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a8565-1258-42d4-987b-913c95b392be admin admin] PATH_INFO: `/v3/projects/6e2df433d8c24c4495385a947b35837d/users/1106499ae1fd476b897f092820dd778f/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:39.606734 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a8565-1258-42d4-987b-913c95b392be admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e2df433d8c24c4495385a947b35837d, user_id=1106499ae1fd476b897f092820dd778f, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:39.633793 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a8565-1258-42d4-987b-913c95b392be admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:39.648481 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1271/2538] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:13:39 2021] PUT /identity/v3/projects/6e2df433d8c24c4495385a947b35837d/users/1106499ae1fd476b897f092820dd778f/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:13:39.652842 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e289cc-1d86-41a9-ad60-6712d1bbb362 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:39.662557 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e289cc-1d86-41a9-ad60-6712d1bbb362 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:39.728151 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066429a-4c51-4cab-bafa-20602f9b4fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:39.728759 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066429a-4c51-4cab-bafa-20602f9b4fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:39.729045 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066429a-4c51-4cab-bafa-20602f9b4fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:39.729322 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066429a-4c51-4cab-bafa-20602f9b4fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:39.730003 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066429a-4c51-4cab-bafa-20602f9b4fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:39.755626 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9066429a-4c51-4cab-bafa-20602f9b4fd7 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:39.766076 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1268/2539] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:13:39 2021] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:13:39.771074 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a8565-1258-42d4-987b-913c95b392be admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:39.781246 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a8565-1258-42d4-987b-913c95b392be admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:39.785399 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521b98b-447f-4a2d-9967-bd546ff3daf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:39.786209 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521b98b-447f-4a2d-9967-bd546ff3daf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:39.786491 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521b98b-447f-4a2d-9967-bd546ff3daf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:39.786775 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521b98b-447f-4a2d-9967-bd546ff3daf1 admin admin] PATH_INFO: `/v3/projects/6e2df433d8c24c4495385a947b35837d/users/1106499ae1fd476b897f092820dd778f/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:39.788517 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521b98b-447f-4a2d-9967-bd546ff3daf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e2df433d8c24c4495385a947b35837d, user_id=1106499ae1fd476b897f092820dd778f, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:39.816516 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521b98b-447f-4a2d-9967-bd546ff3daf1 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:39.827092 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1272/2540] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:13:39 2021] PUT /identity/v3/projects/6e2df433d8c24c4495385a947b35837d/users/1106499ae1fd476b897f092820dd778f/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:13:39.831090 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066429a-4c51-4cab-bafa-20602f9b4fd7 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:39.840729 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9066429a-4c51-4cab-bafa-20602f9b4fd7 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:39.911728 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e5896-16ed-48a5-99fb-642d85d578bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:39.912336 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e5896-16ed-48a5-99fb-642d85d578bb admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:39.912669 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e5896-16ed-48a5-99fb-642d85d578bb admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:39.912948 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e5896-16ed-48a5-99fb-642d85d578bb admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:39.913635 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e5896-16ed-48a5-99fb-642d85d578bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:39.940041 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e5896-16ed-48a5-99fb-642d85d578bb admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:39.953884 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1269/2541] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:13:39 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:13:39.955117 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521b98b-447f-4a2d-9967-bd546ff3daf1 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:39.964990 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521b98b-447f-4a2d-9967-bd546ff3daf1 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:39.969410 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5704c9-76c6-4cd9-8d2f-7b2ff9abd2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:39.970232 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5704c9-76c6-4cd9-8d2f-7b2ff9abd2bd admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:39.970610 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5704c9-76c6-4cd9-8d2f-7b2ff9abd2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:39.970931 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5704c9-76c6-4cd9-8d2f-7b2ff9abd2bd admin admin] PATH_INFO: `/v3/projects/6e2df433d8c24c4495385a947b35837d/users/1106499ae1fd476b897f092820dd778f/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:39.972805 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5704c9-76c6-4cd9-8d2f-7b2ff9abd2bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e2df433d8c24c4495385a947b35837d, user_id=1106499ae1fd476b897f092820dd778f, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:39.999702 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5704c9-76c6-4cd9-8d2f-7b2ff9abd2bd admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:40.015580 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1273/2542] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:13:39 2021] PUT /identity/v3/projects/6e2df433d8c24c4495385a947b35837d/users/1106499ae1fd476b897f092820dd778f/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:13:40.027189 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63eedc5-e51f-443c-bca9-3122639d7e93 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:40.027538 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63eedc5-e51f-443c-bca9-3122639d7e93 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:40.027825 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63eedc5-e51f-443c-bca9-3122639d7e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:40.069640 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-a63eedc5-e51f-443c-bca9-3122639d7e93 None None] MFA Rules not processed for user `1106499ae1fd476b897f092820dd778f`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:13:40.070934 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-a63eedc5-e51f-443c-bca9-3122639d7e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:40.158778 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1270/2543] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:13:40 2021] POST /identity/v3/auth/tokens => generated 3743 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:13:40.169007 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5704c9-76c6-4cd9-8d2f-7b2ff9abd2bd admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:40.172856 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-aa5704c9-76c6-4cd9-8d2f-7b2ff9abd2bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:40.251107 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5704c9-76c6-4cd9-8d2f-7b2ff9abd2bd admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:40.255006 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ddc757-15d9-49f5-adb4-ea006d0183dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:40.255623 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddc757-15d9-49f5-adb4-ea006d0183dc service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:40.255913 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddc757-15d9-49f5-adb4-ea006d0183dc service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:40.256196 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ddc757-15d9-49f5-adb4-ea006d0183dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:40.272494 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ddc757-15d9-49f5-adb4-ea006d0183dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:40.298925 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ddc757-15d9-49f5-adb4-ea006d0183dc service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:40.309619 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1274/2544] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:13:40 2021] GET /identity/v3/auth/tokens => generated 3743 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:13:40.376489 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63eedc5-e51f-443c-bca9-3122639d7e93 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:40.377830 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-a63eedc5-e51f-443c-bca9-3122639d7e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:40.389173 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63eedc5-e51f-443c-bca9-3122639d7e93 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:40.393014 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019cbeda-f0c0-49a8-899e-bdf89b24360f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:40.393750 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cbeda-f0c0-49a8-899e-bdf89b24360f service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:40.394128 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cbeda-f0c0-49a8-899e-bdf89b24360f service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:40.394408 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019cbeda-f0c0-49a8-899e-bdf89b24360f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:40.460808 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019cbeda-f0c0-49a8-899e-bdf89b24360f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:40.485637 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019cbeda-f0c0-49a8-899e-bdf89b24360f service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:40.497112 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1271/2545] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:13:40 2021] GET /identity/v3/auth/tokens => generated 3676 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:13:43.374464 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ddc757-15d9-49f5-adb4-ea006d0183dc service cinder] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:43.444349 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ddc757-15d9-49f5-adb4-ea006d0183dc service cinder] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:43.448692 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53eb11-1cdf-4d4d-98bc-3b6c00ad7369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:43.449588 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53eb11-1cdf-4d4d-98bc-3b6c00ad7369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:43.449886 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53eb11-1cdf-4d4d-98bc-3b6c00ad7369 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:43.450166 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd53eb11-1cdf-4d4d-98bc-3b6c00ad7369 admin admin] PATH_INFO: `/v3/users/52fcf92e4bdf48bfb8ae4fc5448345e2` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:43.451286 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53eb11-1cdf-4d4d-98bc-3b6c00ad7369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52fcf92e4bdf48bfb8ae4fc5448345e2)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:43.477894 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd53eb11-1cdf-4d4d-98bc-3b6c00ad7369 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:43.536306 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-dd53eb11-1cdf-4d4d-98bc-3b6c00ad7369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52fcf92e4bdf48bfb8ae4fc5448345e2'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:43.537222 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-dd53eb11-1cdf-4d4d-98bc-3b6c00ad7369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52fcf92e4bdf48bfb8ae4fc5448345e2'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:43.549244 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-dd53eb11-1cdf-4d4d-98bc-3b6c00ad7369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52fcf92e4bdf48bfb8ae4fc5448345e2'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:43.556774 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-dd53eb11-1cdf-4d4d-98bc-3b6c00ad7369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52fcf92e4bdf48bfb8ae4fc5448345e2'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:43.566729 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-dd53eb11-1cdf-4d4d-98bc-3b6c00ad7369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52fcf92e4bdf48bfb8ae4fc5448345e2'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:43.573270 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1275/2546] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:13:43 2021] DELETE /identity/v3/users/52fcf92e4bdf48bfb8ae4fc5448345e2 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:13:43.577764 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e283fe-e367-48cb-8001-83b70d3a31a1 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:43.578251 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e283fe-e367-48cb-8001-83b70d3a31a1 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:43.578370 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e283fe-e367-48cb-8001-83b70d3a31a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:43.600222 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-e5e283fe-e367-48cb-8001-83b70d3a31a1 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:13:43.601271 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-e5e283fe-e367-48cb-8001-83b70d3a31a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:43.669152 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1272/2547] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:13:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:13:43.679790 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53eb11-1cdf-4d4d-98bc-3b6c00ad7369 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:43.681162 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-dd53eb11-1cdf-4d4d-98bc-3b6c00ad7369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:43.749182 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd53eb11-1cdf-4d4d-98bc-3b6c00ad7369 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:43.753602 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00486c56-06a5-48a0-be03-d23187ab83c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:43.754184 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00486c56-06a5-48a0-be03-d23187ab83c2 service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:43.754463 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00486c56-06a5-48a0-be03-d23187ab83c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:43.754733 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00486c56-06a5-48a0-be03-d23187ab83c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:43.764307 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00486c56-06a5-48a0-be03-d23187ab83c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:43.789135 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00486c56-06a5-48a0-be03-d23187ab83c2 service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:43.799189 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1276/2548] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:13:43 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:13:44.290478 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e283fe-e367-48cb-8001-83b70d3a31a1 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:44.292717 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-e5e283fe-e367-48cb-8001-83b70d3a31a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:44.312740 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e283fe-e367-48cb-8001-83b70d3a31a1 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:44.319764 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264764c-a48d-4be1-ae7c-6a7e2db06261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:44.321158 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264764c-a48d-4be1-ae7c-6a7e2db06261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:44.321681 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264764c-a48d-4be1-ae7c-6a7e2db06261 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:44.322155 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264764c-a48d-4be1-ae7c-6a7e2db06261 admin admin] PATH_INFO: `/v3/projects/0cdca74804194bacb61927b4d6c8c1e5` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:44.324054 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264764c-a48d-4be1-ae7c-6a7e2db06261 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cdca74804194bacb61927b4d6c8c1e5)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:44.374310 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1264764c-a48d-4be1-ae7c-6a7e2db06261 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:44.435949 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-1264764c-a48d-4be1-ae7c-6a7e2db06261 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cdca74804194bacb61927b4d6c8c1e5', 'request_id': 'req-1264764c-a48d-4be1-ae7c-6a7e2db06261'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:44.441149 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-1264764c-a48d-4be1-ae7c-6a7e2db06261 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cdca74804194bacb61927b4d6c8c1e5', 'request_id': 'req-1264764c-a48d-4be1-ae7c-6a7e2db06261'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:44.463968 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-1264764c-a48d-4be1-ae7c-6a7e2db06261 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cdca74804194bacb61927b4d6c8c1e5', 'request_id': 'req-1264764c-a48d-4be1-ae7c-6a7e2db06261'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:44.483866 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-1264764c-a48d-4be1-ae7c-6a7e2db06261 admin admin] The token cache is being invalidate because project 0cdca74804194bacb61927b4d6c8c1e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:13:44.484322 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-1264764c-a48d-4be1-ae7c-6a7e2db06261 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:44.484993 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-1264764c-a48d-4be1-ae7c-6a7e2db06261 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:44.487006 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1273/2549] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:13:44 2021] DELETE /identity/v3/projects/0cdca74804194bacb61927b4d6c8c1e5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:13:44.492283 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00486c56-06a5-48a0-be03-d23187ab83c2 service neutron] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:44.504503 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00486c56-06a5-48a0-be03-d23187ab83c2 service neutron] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:44.569659 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6738d9b-0e0d-4bce-b198-82a6aba0a2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:44.570462 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6738d9b-0e0d-4bce-b198-82a6aba0a2c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:44.570746 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6738d9b-0e0d-4bce-b198-82a6aba0a2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:44.571022 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6738d9b-0e0d-4bce-b198-82a6aba0a2c2 admin admin] PATH_INFO: `/v3/users/1106499ae1fd476b897f092820dd778f` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:44.572201 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6738d9b-0e0d-4bce-b198-82a6aba0a2c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1106499ae1fd476b897f092820dd778f)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:44.598554 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6738d9b-0e0d-4bce-b198-82a6aba0a2c2 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:44.659076 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-e6738d9b-0e0d-4bce-b198-82a6aba0a2c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1106499ae1fd476b897f092820dd778f'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:44.659720 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-e6738d9b-0e0d-4bce-b198-82a6aba0a2c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1106499ae1fd476b897f092820dd778f'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:44.677572 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-e6738d9b-0e0d-4bce-b198-82a6aba0a2c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1106499ae1fd476b897f092820dd778f'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:44.690878 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-e6738d9b-0e0d-4bce-b198-82a6aba0a2c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1106499ae1fd476b897f092820dd778f'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:44.703143 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-e6738d9b-0e0d-4bce-b198-82a6aba0a2c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1106499ae1fd476b897f092820dd778f'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:44.714132 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1277/2550] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:13:44 2021] DELETE /identity/v3/users/1106499ae1fd476b897f092820dd778f => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:13:45.122623 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264764c-a48d-4be1-ae7c-6a7e2db06261 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:45.130403 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-1264764c-a48d-4be1-ae7c-6a7e2db06261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:45.145112 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1264764c-a48d-4be1-ae7c-6a7e2db06261 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:45.219346 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f252329-59b4-4e85-a878-8c6c28f36c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:45.220202 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f252329-59b4-4e85-a878-8c6c28f36c4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:45.220704 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f252329-59b4-4e85-a878-8c6c28f36c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:45.221197 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f252329-59b4-4e85-a878-8c6c28f36c4e admin admin] PATH_INFO: `/v3/projects/6e2df433d8c24c4495385a947b35837d` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:45.222422 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f252329-59b4-4e85-a878-8c6c28f36c4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e2df433d8c24c4495385a947b35837d)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:45.248756 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f252329-59b4-4e85-a878-8c6c28f36c4e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:45.304584 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-6f252329-59b4-4e85-a878-8c6c28f36c4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e2df433d8c24c4495385a947b35837d', 'request_id': 'req-6f252329-59b4-4e85-a878-8c6c28f36c4e'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:45.309595 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-6f252329-59b4-4e85-a878-8c6c28f36c4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e2df433d8c24c4495385a947b35837d', 'request_id': 'req-6f252329-59b4-4e85-a878-8c6c28f36c4e'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:45.413592 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-6f252329-59b4-4e85-a878-8c6c28f36c4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e2df433d8c24c4495385a947b35837d', 'request_id': 'req-6f252329-59b4-4e85-a878-8c6c28f36c4e'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:45.428545 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-6f252329-59b4-4e85-a878-8c6c28f36c4e admin admin] The token cache is being invalidate because project 6e2df433d8c24c4495385a947b35837d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:13:45.429001 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-6f252329-59b4-4e85-a878-8c6c28f36c4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:45.429581 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-6f252329-59b4-4e85-a878-8c6c28f36c4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:45.431273 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1274/2551] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:13:45 2021] DELETE /identity/v3/projects/6e2df433d8c24c4495385a947b35837d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:13:45.437070 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26603d5-d73f-430e-9e04-91439a236d07 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:45.437370 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26603d5-d73f-430e-9e04-91439a236d07 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:45.437723 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26603d5-d73f-430e-9e04-91439a236d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:45.460378 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-b26603d5-d73f-430e-9e04-91439a236d07 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:13:45.461555 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-b26603d5-d73f-430e-9e04-91439a236d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:45.544567 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1278/2552] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:13:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:13:45.553472 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53708865-04b3-4190-8c1b-f8deaf00e8d6 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:45.553764 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53708865-04b3-4190-8c1b-f8deaf00e8d6 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:45.554035 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53708865-04b3-4190-8c1b-f8deaf00e8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:45.577897 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-53708865-04b3-4190-8c1b-f8deaf00e8d6 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:13:45.579153 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-53708865-04b3-4190-8c1b-f8deaf00e8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:45.587282 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1275/2553] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:13:45 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:13:45.591466 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26603d5-d73f-430e-9e04-91439a236d07 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:45.601966 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26603d5-d73f-430e-9e04-91439a236d07 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:45.606324 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdea9e3-3ebd-481e-8ae9-e2cf1bbb7d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:45.606917 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdea9e3-3ebd-481e-8ae9-e2cf1bbb7d44 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:45.607204 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdea9e3-3ebd-481e-8ae9-e2cf1bbb7d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:45.607511 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdea9e3-3ebd-481e-8ae9-e2cf1bbb7d44 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:45.608209 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdea9e3-3ebd-481e-8ae9-e2cf1bbb7d44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:13:45.608531 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdea9e3-3ebd-481e-8ae9-e2cf1bbb7d44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:45.634364 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdea9e3-3ebd-481e-8ae9-e2cf1bbb7d44 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:45.648555 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1279/2554] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:13:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:13:45.653288 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53708865-04b3-4190-8c1b-f8deaf00e8d6 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:45.663463 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53708865-04b3-4190-8c1b-f8deaf00e8d6 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:45.668029 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72753a6-9e46-484f-9571-b7e655d62b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:45.668816 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72753a6-9e46-484f-9571-b7e655d62b66 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:45.668957 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72753a6-9e46-484f-9571-b7e655d62b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:45.669210 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72753a6-9e46-484f-9571-b7e655d62b66 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:45.669873 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72753a6-9e46-484f-9571-b7e655d62b66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:45.696067 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72753a6-9e46-484f-9571-b7e655d62b66 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:45.724827 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1276/2555] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:13:45 2021] POST /identity/v3/projects => generated 381 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:13:45.728483 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdea9e3-3ebd-481e-8ae9-e2cf1bbb7d44 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:45.740517 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdea9e3-3ebd-481e-8ae9-e2cf1bbb7d44 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:45.807112 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee45bda-f722-468c-a953-cbed5562216a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:45.807755 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee45bda-f722-468c-a953-cbed5562216a admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:45.808036 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee45bda-f722-468c-a953-cbed5562216a admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:45.808311 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee45bda-f722-468c-a953-cbed5562216a admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:45.808940 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee45bda-f722-468c-a953-cbed5562216a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:45.835240 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee45bda-f722-468c-a953-cbed5562216a admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:45.859546 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1280/2556] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:13:45 2021] POST /identity/v3/users => generated 291 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:13:45.862699 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72753a6-9e46-484f-9571-b7e655d62b66 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:45.873624 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72753a6-9e46-484f-9571-b7e655d62b66 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:45.878233 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5845c-a189-4ffe-8d8a-2ae3c28321ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:45.879504 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5845c-a189-4ffe-8d8a-2ae3c28321ea admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:45.879912 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5845c-a189-4ffe-8d8a-2ae3c28321ea admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:45.880395 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5845c-a189-4ffe-8d8a-2ae3c28321ea admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:45.881422 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5845c-a189-4ffe-8d8a-2ae3c28321ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:45.908518 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e5845c-a189-4ffe-8d8a-2ae3c28321ea admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:45.922594 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1277/2557] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:13:45 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:13:45.923986 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee45bda-f722-468c-a953-cbed5562216a admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:45.933771 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee45bda-f722-468c-a953-cbed5562216a admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:45.938244 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced17d33-b9e8-48ed-bbf9-7469a6e4f5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:45.939078 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced17d33-b9e8-48ed-bbf9-7469a6e4f5d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:45.939432 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced17d33-b9e8-48ed-bbf9-7469a6e4f5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:45.939750 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced17d33-b9e8-48ed-bbf9-7469a6e4f5d1 admin admin] PATH_INFO: `/v3/projects/7078fdcf93a044abb5458a07dae56cdd/users/6354e17e1f88448cb6b5db59aa47aeb8/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:45.964086 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced17d33-b9e8-48ed-bbf9-7469a6e4f5d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7078fdcf93a044abb5458a07dae56cdd, user_id=6354e17e1f88448cb6b5db59aa47aeb8, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:45.997580 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced17d33-b9e8-48ed-bbf9-7469a6e4f5d1 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:46.011233 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1281/2558] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:13:45 2021] PUT /identity/v3/projects/7078fdcf93a044abb5458a07dae56cdd/users/6354e17e1f88448cb6b5db59aa47aeb8/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:13:46.021750 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5032f82-e0b8-4a21-a9dc-05bc46f2f005 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:46.022036 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5032f82-e0b8-4a21-a9dc-05bc46f2f005 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:46.022312 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5032f82-e0b8-4a21-a9dc-05bc46f2f005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:46.061055 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-c5032f82-e0b8-4a21-a9dc-05bc46f2f005 None None] MFA Rules not processed for user `6354e17e1f88448cb6b5db59aa47aeb8`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:13:46.062212 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-c5032f82-e0b8-4a21-a9dc-05bc46f2f005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:46.137002 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1278/2559] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:13:46 2021] POST /identity/v3/auth/tokens => generated 3688 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:13:46.142252 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced17d33-b9e8-48ed-bbf9-7469a6e4f5d1 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:46.217590 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced17d33-b9e8-48ed-bbf9-7469a6e4f5d1 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:46.222220 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c050e87-e157-49c1-8585-b52079ffd3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:46.222833 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c050e87-e157-49c1-8585-b52079ffd3f1 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:46.223115 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c050e87-e157-49c1-8585-b52079ffd3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:46.223396 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c050e87-e157-49c1-8585-b52079ffd3f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:46.224069 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c050e87-e157-49c1-8585-b52079ffd3f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:46.250453 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c050e87-e157-49c1-8585-b52079ffd3f1 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:46.303496 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1282/2560] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:13:46 2021] POST /identity/v3/projects => generated 381 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:13:46.307933 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5032f82-e0b8-4a21-a9dc-05bc46f2f005 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:46.322655 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5032f82-e0b8-4a21-a9dc-05bc46f2f005 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:46.406220 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc66a9-df40-4830-abaf-288afcfd62f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:46.407043 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc66a9-df40-4830-abaf-288afcfd62f8 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:46.407434 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc66a9-df40-4830-abaf-288afcfd62f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:46.407890 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc66a9-df40-4830-abaf-288afcfd62f8 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:46.408616 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc66a9-df40-4830-abaf-288afcfd62f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:46.441772 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc66a9-df40-4830-abaf-288afcfd62f8 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:46.469083 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1279/2561] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:13:46 2021] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:13:46.473074 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c050e87-e157-49c1-8585-b52079ffd3f1 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:46.483661 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c050e87-e157-49c1-8585-b52079ffd3f1 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:46.488902 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f747e9-70fa-46cd-840b-9da8eb886ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:46.489780 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f747e9-70fa-46cd-840b-9da8eb886ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:46.490230 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f747e9-70fa-46cd-840b-9da8eb886ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:46.490675 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f747e9-70fa-46cd-840b-9da8eb886ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:46.491579 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f747e9-70fa-46cd-840b-9da8eb886ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:46.518905 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f747e9-70fa-46cd-840b-9da8eb886ee4 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:46.531803 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1283/2562] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:13:46 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:13:46.536426 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc66a9-df40-4830-abaf-288afcfd62f8 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:46.546511 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc66a9-df40-4830-abaf-288afcfd62f8 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:46.555318 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777dc6e7-2a72-4749-b869-f50d50312b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:46.556194 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dc6e7-2a72-4749-b869-f50d50312b7c admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:46.556477 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dc6e7-2a72-4749-b869-f50d50312b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:46.556758 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dc6e7-2a72-4749-b869-f50d50312b7c admin admin] PATH_INFO: `/v3/projects/9bfbaf9c79c24eb0ab1ca6b752f9ebcc/users/6f2843eba984420ebf9c7b636ad3601b/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:46.580310 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777dc6e7-2a72-4749-b869-f50d50312b7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bfbaf9c79c24eb0ab1ca6b752f9ebcc, user_id=6f2843eba984420ebf9c7b636ad3601b, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:46.607593 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777dc6e7-2a72-4749-b869-f50d50312b7c admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:46.623942 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1280/2563] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:13:46 2021] PUT /identity/v3/projects/9bfbaf9c79c24eb0ab1ca6b752f9ebcc/users/6f2843eba984420ebf9c7b636ad3601b/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:13:46.628385 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f747e9-70fa-46cd-840b-9da8eb886ee4 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:46.638639 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f747e9-70fa-46cd-840b-9da8eb886ee4 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:46.706623 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35a263-ffd1-487b-b0c3-aede80b0adac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:46.707353 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35a263-ffd1-487b-b0c3-aede80b0adac admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:46.707770 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35a263-ffd1-487b-b0c3-aede80b0adac admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:46.708176 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35a263-ffd1-487b-b0c3-aede80b0adac admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:46.708942 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35a263-ffd1-487b-b0c3-aede80b0adac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:46.735666 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35a263-ffd1-487b-b0c3-aede80b0adac admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:46.746711 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1284/2564] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:13:46 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:13:46.750776 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777dc6e7-2a72-4749-b869-f50d50312b7c admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:46.761212 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777dc6e7-2a72-4749-b869-f50d50312b7c admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:46.766135 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1d2d1-1c3d-4139-8e8d-c778b82c4397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:46.767052 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1d2d1-1c3d-4139-8e8d-c778b82c4397 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:46.767946 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1d2d1-1c3d-4139-8e8d-c778b82c4397 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:46.768300 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1d2d1-1c3d-4139-8e8d-c778b82c4397 admin admin] PATH_INFO: `/v3/projects/9bfbaf9c79c24eb0ab1ca6b752f9ebcc/users/6f2843eba984420ebf9c7b636ad3601b/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:46.770383 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1d2d1-1c3d-4139-8e8d-c778b82c4397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bfbaf9c79c24eb0ab1ca6b752f9ebcc, user_id=6f2843eba984420ebf9c7b636ad3601b, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:46.799795 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1d2d1-1c3d-4139-8e8d-c778b82c4397 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:46.813573 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1281/2565] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:13:46 2021] PUT /identity/v3/projects/9bfbaf9c79c24eb0ab1ca6b752f9ebcc/users/6f2843eba984420ebf9c7b636ad3601b/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:13:46.817173 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35a263-ffd1-487b-b0c3-aede80b0adac admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:46.827783 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35a263-ffd1-487b-b0c3-aede80b0adac admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:46.904237 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb99d13-9954-4906-ac3e-3de1c6c98ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:46.904873 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb99d13-9954-4906-ac3e-3de1c6c98ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:46.905163 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb99d13-9954-4906-ac3e-3de1c6c98ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:46.905448 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb99d13-9954-4906-ac3e-3de1c6c98ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:46.906221 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb99d13-9954-4906-ac3e-3de1c6c98ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:46.932362 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb99d13-9954-4906-ac3e-3de1c6c98ae0 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:46.951084 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1285/2566] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:13:46 2021] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:13:46.953408 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1d2d1-1c3d-4139-8e8d-c778b82c4397 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:46.972832 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1d2d1-1c3d-4139-8e8d-c778b82c4397 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:46.980548 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8d434-cdf6-4997-972f-f4a9f4be221c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:46.982150 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8d434-cdf6-4997-972f-f4a9f4be221c admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:46.982744 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8d434-cdf6-4997-972f-f4a9f4be221c admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:46.983335 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8d434-cdf6-4997-972f-f4a9f4be221c admin admin] PATH_INFO: `/v3/projects/9bfbaf9c79c24eb0ab1ca6b752f9ebcc/users/6f2843eba984420ebf9c7b636ad3601b/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:46.986971 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc8d434-cdf6-4997-972f-f4a9f4be221c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bfbaf9c79c24eb0ab1ca6b752f9ebcc, user_id=6f2843eba984420ebf9c7b636ad3601b, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:47.044001 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc8d434-cdf6-4997-972f-f4a9f4be221c admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:47.072459 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1282/2567] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:13:46 2021] PUT /identity/v3/projects/9bfbaf9c79c24eb0ab1ca6b752f9ebcc/users/6f2843eba984420ebf9c7b636ad3601b/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:13:47.085529 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cd4cd-c77a-454f-9452-ff47b4120ce1 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:47.086187 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cd4cd-c77a-454f-9452-ff47b4120ce1 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:47.086773 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67cd4cd-c77a-454f-9452-ff47b4120ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:47.164015 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-c67cd4cd-c77a-454f-9452-ff47b4120ce1 None None] MFA Rules not processed for user `6f2843eba984420ebf9c7b636ad3601b`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:13:47.166001 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-c67cd4cd-c77a-454f-9452-ff47b4120ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:47.305180 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1286/2568] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:13:47 2021] POST /identity/v3/auth/tokens => generated 3755 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:13:47.311653 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8d434-cdf6-4997-972f-f4a9f4be221c admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:47.313593 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-abc8d434-cdf6-4997-972f-f4a9f4be221c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:47.400960 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8d434-cdf6-4997-972f-f4a9f4be221c admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:47.405261 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a41a81-3919-4805-8269-da3a81ba8bbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:47.405840 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a41a81-3919-4805-8269-da3a81ba8bbd service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:47.406121 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a41a81-3919-4805-8269-da3a81ba8bbd service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:47.406798 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a41a81-3919-4805-8269-da3a81ba8bbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:47.420544 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a41a81-3919-4805-8269-da3a81ba8bbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:47.448546 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a41a81-3919-4805-8269-da3a81ba8bbd service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:47.461147 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1283/2569] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:13:47 2021] GET /identity/v3/auth/tokens => generated 3755 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:13:47.865886 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67cd4cd-c77a-454f-9452-ff47b4120ce1 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:47.875733 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67cd4cd-c77a-454f-9452-ff47b4120ce1 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:47.880475 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc125ec-45f8-4b00-954a-617f309c1c91 tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2843eba984420ebf9c7b636ad3601b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bfbaf9c79c24eb0ab1ca6b752f9ebcc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:47.881088 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc125ec-45f8-4b00-954a-617f309c1c91 tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:47.881374 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc125ec-45f8-4b00-954a-617f309c1c91 tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:47.881661 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc125ec-45f8-4b00-954a-617f309c1c91 tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:47.882347 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc125ec-45f8-4b00-954a-617f309c1c91 tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:13:47.882669 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc125ec-45f8-4b00-954a-617f309c1c91 tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:47.909229 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc125ec-45f8-4b00-954a-617f309c1c91 tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:47.924431 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1287/2570] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:13:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:13:47.928677 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a41a81-3919-4805-8269-da3a81ba8bbd service cinder] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:47.939663 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a41a81-3919-4805-8269-da3a81ba8bbd service cinder] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:47.944564 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2cc02-4f25-4abc-b27c-a4bb741ccb92 tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2843eba984420ebf9c7b636ad3601b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bfbaf9c79c24eb0ab1ca6b752f9ebcc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:47.945253 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2cc02-4f25-4abc-b27c-a4bb741ccb92 tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:47.945578 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2cc02-4f25-4abc-b27c-a4bb741ccb92 tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:47.945992 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2cc02-4f25-4abc-b27c-a4bb741ccb92 tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:47.946733 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2cc02-4f25-4abc-b27c-a4bb741ccb92 tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:47.972618 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2cc02-4f25-4abc-b27c-a4bb741ccb92 tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:48.002591 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1284/2571] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:13:47 2021] POST /identity/v3/projects => generated 354 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:13:48.006778 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc125ec-45f8-4b00-954a-617f309c1c91 tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:48.018597 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc125ec-45f8-4b00-954a-617f309c1c91 tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:48.214853 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3b669-0b25-415c-8240-ff6ecc25a165 tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2843eba984420ebf9c7b636ad3601b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bfbaf9c79c24eb0ab1ca6b752f9ebcc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:48.215481 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3b669-0b25-415c-8240-ff6ecc25a165 tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:48.215773 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3b669-0b25-415c-8240-ff6ecc25a165 tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:48.216056 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3b669-0b25-415c-8240-ff6ecc25a165 tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:48.216748 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3b669-0b25-415c-8240-ff6ecc25a165 tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:13:48.217046 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3b669-0b25-415c-8240-ff6ecc25a165 tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:48.243384 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3b669-0b25-415c-8240-ff6ecc25a165 tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:48.256881 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1288/2572] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:13:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:13:48.302612 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2cc02-4f25-4abc-b27c-a4bb741ccb92 tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:48.312448 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2cc02-4f25-4abc-b27c-a4bb741ccb92 tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:48.317312 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f60475-f556-4d37-b724-cfd57ea0961c tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f2843eba984420ebf9c7b636ad3601b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bfbaf9c79c24eb0ab1ca6b752f9ebcc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:48.318092 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f60475-f556-4d37-b724-cfd57ea0961c tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:48.318383 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f60475-f556-4d37-b724-cfd57ea0961c tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:48.318665 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f60475-f556-4d37-b724-cfd57ea0961c tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] PATH_INFO: `/v3/projects/ddbb4e563a5d477aac8a665e0d68a270` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:48.319784 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f60475-f556-4d37-b724-cfd57ea0961c tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ddbb4e563a5d477aac8a665e0d68a270)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:48.346316 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f60475-f556-4d37-b724-cfd57ea0961c tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:48.398454 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-55f60475-f556-4d37-b724-cfd57ea0961c tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddbb4e563a5d477aac8a665e0d68a270', 'request_id': 'req-55f60475-f556-4d37-b724-cfd57ea0961c'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:48.403491 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-55f60475-f556-4d37-b724-cfd57ea0961c tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddbb4e563a5d477aac8a665e0d68a270', 'request_id': 'req-55f60475-f556-4d37-b724-cfd57ea0961c'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:48.414813 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-55f60475-f556-4d37-b724-cfd57ea0961c tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddbb4e563a5d477aac8a665e0d68a270', 'request_id': 'req-55f60475-f556-4d37-b724-cfd57ea0961c'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:48.427156 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-55f60475-f556-4d37-b724-cfd57ea0961c tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] The token cache is being invalidate because project ddbb4e563a5d477aac8a665e0d68a270 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:13:48.427456 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-55f60475-f556-4d37-b724-cfd57ea0961c tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:48.428044 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-55f60475-f556-4d37-b724-cfd57ea0961c tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:48.429441 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1285/2573] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:13:48 2021] DELETE /identity/v3/projects/ddbb4e563a5d477aac8a665e0d68a270 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:13:48.682571 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3b669-0b25-415c-8240-ff6ecc25a165 tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:48.684487 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-17c3b669-0b25-415c-8240-ff6ecc25a165 tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:48.768490 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3b669-0b25-415c-8240-ff6ecc25a165 tempest-VolumeQuotaClassesTest-1439001324 tempest-VolumeQuotaClassesTest-1439001324-project-admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:48.833257 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5394478-27ab-4056-bd48-08f3e2dbab1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:48.833973 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5394478-27ab-4056-bd48-08f3e2dbab1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:48.834260 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5394478-27ab-4056-bd48-08f3e2dbab1d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:48.834539 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5394478-27ab-4056-bd48-08f3e2dbab1d admin admin] PATH_INFO: `/v3/users/6354e17e1f88448cb6b5db59aa47aeb8` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:48.835662 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5394478-27ab-4056-bd48-08f3e2dbab1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6354e17e1f88448cb6b5db59aa47aeb8)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:48.862129 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5394478-27ab-4056-bd48-08f3e2dbab1d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:48.918574 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-f5394478-27ab-4056-bd48-08f3e2dbab1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6354e17e1f88448cb6b5db59aa47aeb8'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:48.919320 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-f5394478-27ab-4056-bd48-08f3e2dbab1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6354e17e1f88448cb6b5db59aa47aeb8'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:48.931078 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-f5394478-27ab-4056-bd48-08f3e2dbab1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6354e17e1f88448cb6b5db59aa47aeb8'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:48.938633 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-f5394478-27ab-4056-bd48-08f3e2dbab1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6354e17e1f88448cb6b5db59aa47aeb8'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:48.946931 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-f5394478-27ab-4056-bd48-08f3e2dbab1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6354e17e1f88448cb6b5db59aa47aeb8'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:48.952940 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1289/2574] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:13:48 2021] DELETE /identity/v3/users/6354e17e1f88448cb6b5db59aa47aeb8 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:13:48.957918 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2843d5-4202-460c-90fb-d1783686448a None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:48.958216 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2843d5-4202-460c-90fb-d1783686448a None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:48.958530 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2843d5-4202-460c-90fb-d1783686448a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:48.983211 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-ed2843d5-4202-460c-90fb-d1783686448a None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:13:48.984632 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-ed2843d5-4202-460c-90fb-d1783686448a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:49.052026 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1286/2575] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:13:48 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:13:49.062205 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5394478-27ab-4056-bd48-08f3e2dbab1d admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:49.063569 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-f5394478-27ab-4056-bd48-08f3e2dbab1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:49.129015 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5394478-27ab-4056-bd48-08f3e2dbab1d admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:49.132327 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971124d-c9ed-4fcb-bcd5-a0f94c738043 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:49.132905 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971124d-c9ed-4fcb-bcd5-a0f94c738043 service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:49.133218 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971124d-c9ed-4fcb-bcd5-a0f94c738043 service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:49.133455 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971124d-c9ed-4fcb-bcd5-a0f94c738043 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:49.142873 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971124d-c9ed-4fcb-bcd5-a0f94c738043 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:49.167850 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971124d-c9ed-4fcb-bcd5-a0f94c738043 service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:49.177655 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1290/2576] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:13:49 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:13:49.553583 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2843d5-4202-460c-90fb-d1783686448a None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:49.554957 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-ed2843d5-4202-460c-90fb-d1783686448a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:49.566752 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2843d5-4202-460c-90fb-d1783686448a None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:49.571080 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39287da-90dc-42b7-b909-984eac3ea897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:49.571908 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39287da-90dc-42b7-b909-984eac3ea897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:49.572237 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39287da-90dc-42b7-b909-984eac3ea897 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:49.572516 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39287da-90dc-42b7-b909-984eac3ea897 admin admin] PATH_INFO: `/v3/projects/7078fdcf93a044abb5458a07dae56cdd` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:49.573578 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39287da-90dc-42b7-b909-984eac3ea897 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7078fdcf93a044abb5458a07dae56cdd)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:49.600075 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39287da-90dc-42b7-b909-984eac3ea897 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:49.650295 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-a39287da-90dc-42b7-b909-984eac3ea897 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7078fdcf93a044abb5458a07dae56cdd', 'request_id': 'req-a39287da-90dc-42b7-b909-984eac3ea897'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:49.655315 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-a39287da-90dc-42b7-b909-984eac3ea897 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7078fdcf93a044abb5458a07dae56cdd', 'request_id': 'req-a39287da-90dc-42b7-b909-984eac3ea897'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:49.666528 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-a39287da-90dc-42b7-b909-984eac3ea897 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7078fdcf93a044abb5458a07dae56cdd', 'request_id': 'req-a39287da-90dc-42b7-b909-984eac3ea897'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:49.679223 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-a39287da-90dc-42b7-b909-984eac3ea897 admin admin] The token cache is being invalidate because project 7078fdcf93a044abb5458a07dae56cdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:13:49.679569 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-a39287da-90dc-42b7-b909-984eac3ea897 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:49.680113 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-a39287da-90dc-42b7-b909-984eac3ea897 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:49.681510 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1287/2577] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:13:49 2021] DELETE /identity/v3/projects/7078fdcf93a044abb5458a07dae56cdd => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:13:49.685563 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971124d-c9ed-4fcb-bcd5-a0f94c738043 service neutron] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:49.694800 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971124d-c9ed-4fcb-bcd5-a0f94c738043 service neutron] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:49.759538 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64455846-81f3-4ec6-8293-23a7ee84a128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:49.760347 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64455846-81f3-4ec6-8293-23a7ee84a128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:49.760632 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64455846-81f3-4ec6-8293-23a7ee84a128 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:49.760916 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64455846-81f3-4ec6-8293-23a7ee84a128 admin admin] PATH_INFO: `/v3/users/6f2843eba984420ebf9c7b636ad3601b` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:49.762094 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64455846-81f3-4ec6-8293-23a7ee84a128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f2843eba984420ebf9c7b636ad3601b)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:49.789318 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64455846-81f3-4ec6-8293-23a7ee84a128 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:49.847367 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-64455846-81f3-4ec6-8293-23a7ee84a128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f2843eba984420ebf9c7b636ad3601b'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:49.848108 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-64455846-81f3-4ec6-8293-23a7ee84a128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f2843eba984420ebf9c7b636ad3601b'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:49.860440 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-64455846-81f3-4ec6-8293-23a7ee84a128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f2843eba984420ebf9c7b636ad3601b'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:49.867965 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-64455846-81f3-4ec6-8293-23a7ee84a128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f2843eba984420ebf9c7b636ad3601b'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:49.877248 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-64455846-81f3-4ec6-8293-23a7ee84a128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f2843eba984420ebf9c7b636ad3601b'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:49.883371 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1291/2578] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:13:49 2021] DELETE /identity/v3/users/6f2843eba984420ebf9c7b636ad3601b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:13:50.259310 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39287da-90dc-42b7-b909-984eac3ea897 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:50.260970 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-a39287da-90dc-42b7-b909-984eac3ea897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:50.278356 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39287da-90dc-42b7-b909-984eac3ea897 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:50.352091 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd7893-0a41-4464-a9ed-de74af3c29a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:50.352880 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd7893-0a41-4464-a9ed-de74af3c29a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:50.353169 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd7893-0a41-4464-a9ed-de74af3c29a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:50.353446 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd7893-0a41-4464-a9ed-de74af3c29a2 admin admin] PATH_INFO: `/v3/projects/9bfbaf9c79c24eb0ab1ca6b752f9ebcc` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:50.354533 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd7893-0a41-4464-a9ed-de74af3c29a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bfbaf9c79c24eb0ab1ca6b752f9ebcc)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:50.381111 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd7893-0a41-4464-a9ed-de74af3c29a2 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:50.439168 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-15fd7893-0a41-4464-a9ed-de74af3c29a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bfbaf9c79c24eb0ab1ca6b752f9ebcc', 'request_id': 'req-15fd7893-0a41-4464-a9ed-de74af3c29a2'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:50.444738 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-15fd7893-0a41-4464-a9ed-de74af3c29a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bfbaf9c79c24eb0ab1ca6b752f9ebcc', 'request_id': 'req-15fd7893-0a41-4464-a9ed-de74af3c29a2'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:50.460015 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-15fd7893-0a41-4464-a9ed-de74af3c29a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bfbaf9c79c24eb0ab1ca6b752f9ebcc', 'request_id': 'req-15fd7893-0a41-4464-a9ed-de74af3c29a2'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:50.474240 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-15fd7893-0a41-4464-a9ed-de74af3c29a2 admin admin] The token cache is being invalidate because project 9bfbaf9c79c24eb0ab1ca6b752f9ebcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:13:50.474539 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-15fd7893-0a41-4464-a9ed-de74af3c29a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:50.475125 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-15fd7893-0a41-4464-a9ed-de74af3c29a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:50.476567 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1288/2579] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:13:50 2021] DELETE /identity/v3/projects/9bfbaf9c79c24eb0ab1ca6b752f9ebcc => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:13:50.482263 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b4997-b9b2-45a9-932a-022dc8acce54 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:50.482814 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b4997-b9b2-45a9-932a-022dc8acce54 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:50.482814 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639b4997-b9b2-45a9-932a-022dc8acce54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:50.507924 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-639b4997-b9b2-45a9-932a-022dc8acce54 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:13:50.509059 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-639b4997-b9b2-45a9-932a-022dc8acce54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:50.574011 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1292/2580] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:13:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:13:50.581935 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25868a-fc18-4bac-bbbd-d38c003ef6dd None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:50.582482 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25868a-fc18-4bac-bbbd-d38c003ef6dd None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:50.582482 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f25868a-fc18-4bac-bbbd-d38c003ef6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:50.604590 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-7f25868a-fc18-4bac-bbbd-d38c003ef6dd None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:13:50.605582 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-7f25868a-fc18-4bac-bbbd-d38c003ef6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:50.612978 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1289/2581] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:13:50 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:13:50.617299 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b4997-b9b2-45a9-932a-022dc8acce54 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:50.627899 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639b4997-b9b2-45a9-932a-022dc8acce54 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:50.632245 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adea0e2-27d3-418b-b3ac-69c7c5430d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:50.632963 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adea0e2-27d3-418b-b3ac-69c7c5430d54 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:50.633246 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adea0e2-27d3-418b-b3ac-69c7c5430d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:50.633526 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adea0e2-27d3-418b-b3ac-69c7c5430d54 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:50.634245 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adea0e2-27d3-418b-b3ac-69c7c5430d54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:13:50.634597 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adea0e2-27d3-418b-b3ac-69c7c5430d54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:50.660478 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adea0e2-27d3-418b-b3ac-69c7c5430d54 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:50.674198 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1293/2582] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:13:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:13:50.678581 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25868a-fc18-4bac-bbbd-d38c003ef6dd None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:50.687417 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f25868a-fc18-4bac-bbbd-d38c003ef6dd None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:50.691659 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37945559-43b8-4cc1-9af6-24352430c765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:50.692210 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37945559-43b8-4cc1-9af6-24352430c765 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:50.692487 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37945559-43b8-4cc1-9af6-24352430c765 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:50.692764 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37945559-43b8-4cc1-9af6-24352430c765 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:50.693393 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37945559-43b8-4cc1-9af6-24352430c765 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:50.718380 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37945559-43b8-4cc1-9af6-24352430c765 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:50.748470 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1290/2583] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:13:50 2021] POST /identity/v3/projects => generated 393 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:13:50.753141 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adea0e2-27d3-418b-b3ac-69c7c5430d54 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:50.762758 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adea0e2-27d3-418b-b3ac-69c7c5430d54 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:50.825664 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a141b2c-ca90-4dd0-aea7-dbd8b0f1ceba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:50.826474 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a141b2c-ca90-4dd0-aea7-dbd8b0f1ceba admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:50.826674 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a141b2c-ca90-4dd0-aea7-dbd8b0f1ceba admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:50.826882 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a141b2c-ca90-4dd0-aea7-dbd8b0f1ceba admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:50.827542 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a141b2c-ca90-4dd0-aea7-dbd8b0f1ceba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:50.853515 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a141b2c-ca90-4dd0-aea7-dbd8b0f1ceba admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:50.875483 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1294/2584] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:13:50 2021] POST /identity/v3/users => generated 297 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:13:50.880388 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37945559-43b8-4cc1-9af6-24352430c765 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:50.892108 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37945559-43b8-4cc1-9af6-24352430c765 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:50.897655 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60664e-ef54-47e3-900a-a11900ef31a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:50.898254 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60664e-ef54-47e3-900a-a11900ef31a4 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:50.899033 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60664e-ef54-47e3-900a-a11900ef31a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:50.899310 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60664e-ef54-47e3-900a-a11900ef31a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:50.900043 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60664e-ef54-47e3-900a-a11900ef31a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:50.925212 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60664e-ef54-47e3-900a-a11900ef31a4 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:50.937752 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1291/2585] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:13:50 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:13:50.942633 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a141b2c-ca90-4dd0-aea7-dbd8b0f1ceba admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:50.952459 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a141b2c-ca90-4dd0-aea7-dbd8b0f1ceba admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:50.957378 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e99a5-f526-47ad-9e08-c6c06f24ba52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:50.958210 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e99a5-f526-47ad-9e08-c6c06f24ba52 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:50.958540 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e99a5-f526-47ad-9e08-c6c06f24ba52 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:50.958826 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e99a5-f526-47ad-9e08-c6c06f24ba52 admin admin] PATH_INFO: `/v3/projects/4f3ff297fb8e4e2198ddb917ad85712c/users/9348432e1d1a4d6f96920c7e1e7a439f/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:50.980814 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e99a5-f526-47ad-9e08-c6c06f24ba52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f3ff297fb8e4e2198ddb917ad85712c, user_id=9348432e1d1a4d6f96920c7e1e7a439f, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:51.007853 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e99a5-f526-47ad-9e08-c6c06f24ba52 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:51.022326 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1295/2586] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:13:50 2021] PUT /identity/v3/projects/4f3ff297fb8e4e2198ddb917ad85712c/users/9348432e1d1a4d6f96920c7e1e7a439f/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:13:51.034145 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d50b4-afeb-480e-94f2-3e05de988176 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:51.034477 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d50b4-afeb-480e-94f2-3e05de988176 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:51.035194 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d50b4-afeb-480e-94f2-3e05de988176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:51.072864 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-d17d50b4-afeb-480e-94f2-3e05de988176 None None] MFA Rules not processed for user `9348432e1d1a4d6f96920c7e1e7a439f`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:13:51.074025 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-d17d50b4-afeb-480e-94f2-3e05de988176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:51.144860 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1292/2587] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:13:51 2021] POST /identity/v3/auth/tokens => generated 3700 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:13:51.149669 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e99a5-f526-47ad-9e08-c6c06f24ba52 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:51.232980 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e99a5-f526-47ad-9e08-c6c06f24ba52 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:51.239629 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d507aa1-e8f7-45b4-9759-3e4b65ff3b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:51.240673 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d507aa1-e8f7-45b4-9759-3e4b65ff3b01 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:51.240969 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d507aa1-e8f7-45b4-9759-3e4b65ff3b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:51.241278 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d507aa1-e8f7-45b4-9759-3e4b65ff3b01 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:51.241935 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d507aa1-e8f7-45b4-9759-3e4b65ff3b01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:51.267968 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d507aa1-e8f7-45b4-9759-3e4b65ff3b01 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:51.296689 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1296/2588] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:13:51 2021] POST /identity/v3/projects => generated 391 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:13:51.301300 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d50b4-afeb-480e-94f2-3e05de988176 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:51.311810 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d50b4-afeb-480e-94f2-3e05de988176 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:51.376371 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc39979-3608-4857-ba8e-801924a402f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:51.377516 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc39979-3608-4857-ba8e-801924a402f8 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:51.377803 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc39979-3608-4857-ba8e-801924a402f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:51.378081 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc39979-3608-4857-ba8e-801924a402f8 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:51.378712 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc39979-3608-4857-ba8e-801924a402f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:51.405864 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc39979-3608-4857-ba8e-801924a402f8 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:51.427183 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1293/2589] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:13:51 2021] POST /identity/v3/users => generated 302 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:13:51.431287 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d507aa1-e8f7-45b4-9759-3e4b65ff3b01 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:51.441838 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d507aa1-e8f7-45b4-9759-3e4b65ff3b01 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:51.446177 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba337d5-162f-440e-8666-7b0e77023b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:51.446772 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba337d5-162f-440e-8666-7b0e77023b0c admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:51.447059 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba337d5-162f-440e-8666-7b0e77023b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:51.447337 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba337d5-162f-440e-8666-7b0e77023b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:51.448063 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba337d5-162f-440e-8666-7b0e77023b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:51.473519 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba337d5-162f-440e-8666-7b0e77023b0c admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:51.485627 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1297/2590] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:13:51 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:13:51.490450 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc39979-3608-4857-ba8e-801924a402f8 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:51.499930 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc39979-3608-4857-ba8e-801924a402f8 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:51.504490 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d38a4-c1dd-4f87-9cd3-4bbf4379d3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:51.505340 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d38a4-c1dd-4f87-9cd3-4bbf4379d3f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:51.505624 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d38a4-c1dd-4f87-9cd3-4bbf4379d3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:51.505903 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1d38a4-c1dd-4f87-9cd3-4bbf4379d3f0 admin admin] PATH_INFO: `/v3/projects/794d2ab2691141db8c91761891bdc9f2/users/55d4c5214c2f473c8e181793e7de1787/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:51.526066 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d38a4-c1dd-4f87-9cd3-4bbf4379d3f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=794d2ab2691141db8c91761891bdc9f2, user_id=55d4c5214c2f473c8e181793e7de1787, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:51.553780 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1d38a4-c1dd-4f87-9cd3-4bbf4379d3f0 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:51.575966 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1294/2591] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:13:51 2021] PUT /identity/v3/projects/794d2ab2691141db8c91761891bdc9f2/users/55d4c5214c2f473c8e181793e7de1787/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:13:51.580177 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba337d5-162f-440e-8666-7b0e77023b0c admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:51.589774 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba337d5-162f-440e-8666-7b0e77023b0c admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:51.653852 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d6a88-4971-4df3-a9b9-838dbac25ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:51.654458 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d6a88-4971-4df3-a9b9-838dbac25ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:51.654769 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d6a88-4971-4df3-a9b9-838dbac25ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:51.655115 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d6a88-4971-4df3-a9b9-838dbac25ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:51.655849 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d6a88-4971-4df3-a9b9-838dbac25ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:51.681881 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d6a88-4971-4df3-a9b9-838dbac25ef1 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:51.692846 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1298/2592] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:13:51 2021] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:13:51.697188 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d38a4-c1dd-4f87-9cd3-4bbf4379d3f0 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:51.707388 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1d38a4-c1dd-4f87-9cd3-4bbf4379d3f0 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:51.713172 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5eb666-3890-420d-9ef3-5a33feabdf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:51.715885 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5eb666-3890-420d-9ef3-5a33feabdf2a admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:51.716560 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5eb666-3890-420d-9ef3-5a33feabdf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:51.716987 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5eb666-3890-420d-9ef3-5a33feabdf2a admin admin] PATH_INFO: `/v3/projects/794d2ab2691141db8c91761891bdc9f2/users/55d4c5214c2f473c8e181793e7de1787/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:51.723615 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5eb666-3890-420d-9ef3-5a33feabdf2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=794d2ab2691141db8c91761891bdc9f2, user_id=55d4c5214c2f473c8e181793e7de1787, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:51.779100 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5eb666-3890-420d-9ef3-5a33feabdf2a admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:51.793795 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1295/2593] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:13:51 2021] PUT /identity/v3/projects/794d2ab2691141db8c91761891bdc9f2/users/55d4c5214c2f473c8e181793e7de1787/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:13:51.798785 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d6a88-4971-4df3-a9b9-838dbac25ef1 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:51.809711 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d6a88-4971-4df3-a9b9-838dbac25ef1 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:51.881796 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3af794-9053-4484-a2f0-5a5110b8949e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:51.882392 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3af794-9053-4484-a2f0-5a5110b8949e admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:51.882675 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3af794-9053-4484-a2f0-5a5110b8949e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:51.882954 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3af794-9053-4484-a2f0-5a5110b8949e admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:51.883803 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3af794-9053-4484-a2f0-5a5110b8949e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:51.909851 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3af794-9053-4484-a2f0-5a5110b8949e admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:51.920149 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1299/2594] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:13:51 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:13:51.924599 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5eb666-3890-420d-9ef3-5a33feabdf2a admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:51.937923 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5eb666-3890-420d-9ef3-5a33feabdf2a admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:51.943840 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5bad92-1981-4140-b32b-b01eb70ff061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:51.945069 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5bad92-1981-4140-b32b-b01eb70ff061 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:51.945474 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5bad92-1981-4140-b32b-b01eb70ff061 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:51.945899 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5bad92-1981-4140-b32b-b01eb70ff061 admin admin] PATH_INFO: `/v3/projects/794d2ab2691141db8c91761891bdc9f2/users/55d4c5214c2f473c8e181793e7de1787/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:51.948431 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5bad92-1981-4140-b32b-b01eb70ff061 admin admin] RBAC: Authorizing `identity:create_grant(project_id=794d2ab2691141db8c91761891bdc9f2, user_id=55d4c5214c2f473c8e181793e7de1787, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:51.978791 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5bad92-1981-4140-b32b-b01eb70ff061 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:52.001505 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1296/2595] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:13:51 2021] PUT /identity/v3/projects/794d2ab2691141db8c91761891bdc9f2/users/55d4c5214c2f473c8e181793e7de1787/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:13:52.012921 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448987d-ce25-48db-ba88-0b47976aacad None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:52.013222 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448987d-ce25-48db-ba88-0b47976aacad None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:52.013505 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448987d-ce25-48db-ba88-0b47976aacad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:52.052743 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-3448987d-ce25-48db-ba88-0b47976aacad None None] MFA Rules not processed for user `55d4c5214c2f473c8e181793e7de1787`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:13:52.053798 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-3448987d-ce25-48db-ba88-0b47976aacad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:52.132964 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1300/2596] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:13:52 2021] POST /identity/v3/auth/tokens => generated 3765 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:13:52.143159 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5bad92-1981-4140-b32b-b01eb70ff061 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:52.144824 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-3d5bad92-1981-4140-b32b-b01eb70ff061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:52.211582 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5bad92-1981-4140-b32b-b01eb70ff061 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:52.215079 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58b534-c174-4f81-9549-d251724c524b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:52.215701 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58b534-c174-4f81-9549-d251724c524b service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:52.215983 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58b534-c174-4f81-9549-d251724c524b service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:52.216257 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58b534-c174-4f81-9549-d251724c524b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:52.225867 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58b534-c174-4f81-9549-d251724c524b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:52.250806 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58b534-c174-4f81-9549-d251724c524b service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:52.261052 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1297/2597] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:13:52 2021] GET /identity/v3/auth/tokens => generated 3765 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:13:52.310790 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448987d-ce25-48db-ba88-0b47976aacad None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:52.312067 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-3448987d-ce25-48db-ba88-0b47976aacad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:52.326283 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448987d-ce25-48db-ba88-0b47976aacad None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:52.330708 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd84e88-c8f1-4cbb-823c-01a5c1d3e166 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:52.331293 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd84e88-c8f1-4cbb-823c-01a5c1d3e166 service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:52.331611 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd84e88-c8f1-4cbb-823c-01a5c1d3e166 service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:52.331892 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd84e88-c8f1-4cbb-823c-01a5c1d3e166 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:52.396043 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd84e88-c8f1-4cbb-823c-01a5c1d3e166 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:52.421008 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd84e88-c8f1-4cbb-823c-01a5c1d3e166 service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:52.430053 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1301/2598] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:13:52 2021] GET /identity/v3/auth/tokens => generated 3700 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:13:56.229463 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58b534-c174-4f81-9549-d251724c524b service cinder] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:56.304376 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58b534-c174-4f81-9549-d251724c524b service cinder] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:56.308450 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27df2a-c5e5-4083-8b73-a46ec8182261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:56.309255 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27df2a-c5e5-4083-8b73-a46ec8182261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:56.309537 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27df2a-c5e5-4083-8b73-a46ec8182261 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:56.309812 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27df2a-c5e5-4083-8b73-a46ec8182261 admin admin] PATH_INFO: `/v3/users/9348432e1d1a4d6f96920c7e1e7a439f` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:56.310891 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27df2a-c5e5-4083-8b73-a46ec8182261 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9348432e1d1a4d6f96920c7e1e7a439f)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:56.336844 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27df2a-c5e5-4083-8b73-a46ec8182261 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:56.386939 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-de27df2a-c5e5-4083-8b73-a46ec8182261 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9348432e1d1a4d6f96920c7e1e7a439f'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:56.399162 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-de27df2a-c5e5-4083-8b73-a46ec8182261 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9348432e1d1a4d6f96920c7e1e7a439f'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:56.399840 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-de27df2a-c5e5-4083-8b73-a46ec8182261 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9348432e1d1a4d6f96920c7e1e7a439f'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:56.407064 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-de27df2a-c5e5-4083-8b73-a46ec8182261 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9348432e1d1a4d6f96920c7e1e7a439f'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:56.416564 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-de27df2a-c5e5-4083-8b73-a46ec8182261 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9348432e1d1a4d6f96920c7e1e7a439f'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:56.422558 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1298/2599] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:13:56 2021] DELETE /identity/v3/users/9348432e1d1a4d6f96920c7e1e7a439f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:13:56.427133 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf0148-bd07-4060-b6fa-fd60cba9c877 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:56.427699 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf0148-bd07-4060-b6fa-fd60cba9c877 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:56.427822 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf0148-bd07-4060-b6fa-fd60cba9c877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:56.450855 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-0dbf0148-bd07-4060-b6fa-fd60cba9c877 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:13:56.452099 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-0dbf0148-bd07-4060-b6fa-fd60cba9c877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:56.520899 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1302/2600] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:13:56 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:13:56.531742 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27df2a-c5e5-4083-8b73-a46ec8182261 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:56.533650 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-de27df2a-c5e5-4083-8b73-a46ec8182261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:56.601576 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27df2a-c5e5-4083-8b73-a46ec8182261 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:56.604955 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e838c0-8896-448c-ab69-05ccdc7bae0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:56.605536 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e838c0-8896-448c-ab69-05ccdc7bae0f service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:56.605844 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e838c0-8896-448c-ab69-05ccdc7bae0f service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:56.606124 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e838c0-8896-448c-ab69-05ccdc7bae0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:56.615905 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e838c0-8896-448c-ab69-05ccdc7bae0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:56.641143 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e838c0-8896-448c-ab69-05ccdc7bae0f service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:56.651638 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1299/2601] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:13:56 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:13:57.015173 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf0148-bd07-4060-b6fa-fd60cba9c877 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:57.016601 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-0dbf0148-bd07-4060-b6fa-fd60cba9c877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:57.029542 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf0148-bd07-4060-b6fa-fd60cba9c877 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:57.034440 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf66f5-de87-4302-ba66-a0b4ad449827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:57.035247 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf66f5-de87-4302-ba66-a0b4ad449827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:57.035594 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf66f5-de87-4302-ba66-a0b4ad449827 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:57.035882 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf66f5-de87-4302-ba66-a0b4ad449827 admin admin] PATH_INFO: `/v3/projects/4f3ff297fb8e4e2198ddb917ad85712c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:57.036982 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf66f5-de87-4302-ba66-a0b4ad449827 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f3ff297fb8e4e2198ddb917ad85712c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:57.063511 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf66f5-de87-4302-ba66-a0b4ad449827 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:57.119302 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-7ccf66f5-de87-4302-ba66-a0b4ad449827 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f3ff297fb8e4e2198ddb917ad85712c', 'request_id': 'req-7ccf66f5-de87-4302-ba66-a0b4ad449827'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:57.124550 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-7ccf66f5-de87-4302-ba66-a0b4ad449827 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f3ff297fb8e4e2198ddb917ad85712c', 'request_id': 'req-7ccf66f5-de87-4302-ba66-a0b4ad449827'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:57.135528 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-7ccf66f5-de87-4302-ba66-a0b4ad449827 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f3ff297fb8e4e2198ddb917ad85712c', 'request_id': 'req-7ccf66f5-de87-4302-ba66-a0b4ad449827'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:57.153069 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-7ccf66f5-de87-4302-ba66-a0b4ad449827 admin admin] The token cache is being invalidate because project 4f3ff297fb8e4e2198ddb917ad85712c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:13:57.153612 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-7ccf66f5-de87-4302-ba66-a0b4ad449827 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:57.154535 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-7ccf66f5-de87-4302-ba66-a0b4ad449827 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:57.156275 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1303/2602] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:13:57 2021] DELETE /identity/v3/projects/4f3ff297fb8e4e2198ddb917ad85712c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:13:57.160818 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e838c0-8896-448c-ab69-05ccdc7bae0f service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:57.169832 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e838c0-8896-448c-ab69-05ccdc7bae0f service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:57.231916 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4352115-ea80-43b7-a948-f547d809bca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:57.232714 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4352115-ea80-43b7-a948-f547d809bca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:57.232999 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4352115-ea80-43b7-a948-f547d809bca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:57.233275 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4352115-ea80-43b7-a948-f547d809bca2 admin admin] PATH_INFO: `/v3/users/55d4c5214c2f473c8e181793e7de1787` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:57.234358 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4352115-ea80-43b7-a948-f547d809bca2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55d4c5214c2f473c8e181793e7de1787)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:57.259960 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4352115-ea80-43b7-a948-f547d809bca2 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:57.308568 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-e4352115-ea80-43b7-a948-f547d809bca2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55d4c5214c2f473c8e181793e7de1787'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:57.320150 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-e4352115-ea80-43b7-a948-f547d809bca2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55d4c5214c2f473c8e181793e7de1787'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:57.320731 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-e4352115-ea80-43b7-a948-f547d809bca2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55d4c5214c2f473c8e181793e7de1787'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:57.328763 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-e4352115-ea80-43b7-a948-f547d809bca2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55d4c5214c2f473c8e181793e7de1787'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:57.336727 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-e4352115-ea80-43b7-a948-f547d809bca2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55d4c5214c2f473c8e181793e7de1787'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:57.342312 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1300/2603] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:13:57 2021] DELETE /identity/v3/users/55d4c5214c2f473c8e181793e7de1787 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:13:57.808793 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf66f5-de87-4302-ba66-a0b4ad449827 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:57.810332 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-7ccf66f5-de87-4302-ba66-a0b4ad449827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:57.824079 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf66f5-de87-4302-ba66-a0b4ad449827 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:57.894155 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece28e97-3f33-4f05-ae14-1121105c46be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:57.894860 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece28e97-3f33-4f05-ae14-1121105c46be admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:57.895139 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece28e97-3f33-4f05-ae14-1121105c46be admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:57.895415 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece28e97-3f33-4f05-ae14-1121105c46be admin admin] PATH_INFO: `/v3/projects/794d2ab2691141db8c91761891bdc9f2` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:57.896542 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece28e97-3f33-4f05-ae14-1121105c46be admin admin] RBAC: Authorizing `identity:delete_project(project_id=794d2ab2691141db8c91761891bdc9f2)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:57.932079 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece28e97-3f33-4f05-ae14-1121105c46be admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:57.980970 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-ece28e97-3f33-4f05-ae14-1121105c46be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '794d2ab2691141db8c91761891bdc9f2', 'request_id': 'req-ece28e97-3f33-4f05-ae14-1121105c46be'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:57.986920 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-ece28e97-3f33-4f05-ae14-1121105c46be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '794d2ab2691141db8c91761891bdc9f2', 'request_id': 'req-ece28e97-3f33-4f05-ae14-1121105c46be'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:57.998164 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-ece28e97-3f33-4f05-ae14-1121105c46be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '794d2ab2691141db8c91761891bdc9f2', 'request_id': 'req-ece28e97-3f33-4f05-ae14-1121105c46be'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:58.010363 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-ece28e97-3f33-4f05-ae14-1121105c46be admin admin] The token cache is being invalidate because project 794d2ab2691141db8c91761891bdc9f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:13:58.010646 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-ece28e97-3f33-4f05-ae14-1121105c46be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:58.011227 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-ece28e97-3f33-4f05-ae14-1121105c46be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:13:58.012625 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1304/2604] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:13:57 2021] DELETE /identity/v3/projects/794d2ab2691141db8c91761891bdc9f2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:13:58.018742 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ac20e-1b47-4881-baff-1a366a7b38fc None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:58.019036 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ac20e-1b47-4881-baff-1a366a7b38fc None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:58.019315 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ac20e-1b47-4881-baff-1a366a7b38fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:58.041051 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-b13ac20e-1b47-4881-baff-1a366a7b38fc None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:13:58.042194 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-b13ac20e-1b47-4881-baff-1a366a7b38fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:58.105525 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1301/2605] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:13:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:13:58.113666 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1721ec7-9985-4cfd-abc2-a212759b1757 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:58.113957 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1721ec7-9985-4cfd-abc2-a212759b1757 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:58.114236 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1721ec7-9985-4cfd-abc2-a212759b1757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:58.136253 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-e1721ec7-9985-4cfd-abc2-a212759b1757 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:13:58.137386 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-e1721ec7-9985-4cfd-abc2-a212759b1757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:58.144372 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1305/2606] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:13:58 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:13:58.148371 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ac20e-1b47-4881-baff-1a366a7b38fc None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:58.158533 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ac20e-1b47-4881-baff-1a366a7b38fc None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:58.162730 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32701888-3831-4c42-b3d1-e6bf2ce10f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:58.163333 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32701888-3831-4c42-b3d1-e6bf2ce10f6e admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:58.163648 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32701888-3831-4c42-b3d1-e6bf2ce10f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:58.163924 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32701888-3831-4c42-b3d1-e6bf2ce10f6e admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:58.164594 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32701888-3831-4c42-b3d1-e6bf2ce10f6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:13:58.164886 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32701888-3831-4c42-b3d1-e6bf2ce10f6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:58.190521 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32701888-3831-4c42-b3d1-e6bf2ce10f6e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:58.204602 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1302/2607] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:13:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:13:58.208946 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1721ec7-9985-4cfd-abc2-a212759b1757 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:58.217851 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1721ec7-9985-4cfd-abc2-a212759b1757 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:58.223348 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff295198-4649-456b-a212-49ea14b28501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:58.224318 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff295198-4649-456b-a212-49ea14b28501 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:58.224612 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff295198-4649-456b-a212-49ea14b28501 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:58.224890 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff295198-4649-456b-a212-49ea14b28501 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:58.225558 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff295198-4649-456b-a212-49ea14b28501 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:58.251495 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff295198-4649-456b-a212-49ea14b28501 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:58.282083 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1306/2608] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:13:58 2021] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:13:58.286618 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32701888-3831-4c42-b3d1-e6bf2ce10f6e admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:58.296560 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32701888-3831-4c42-b3d1-e6bf2ce10f6e admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:58.358306 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13692593-c760-4c80-bece-234472c034e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:58.358900 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13692593-c760-4c80-bece-234472c034e4 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:58.359183 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13692593-c760-4c80-bece-234472c034e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:58.359478 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13692593-c760-4c80-bece-234472c034e4 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:58.360107 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13692593-c760-4c80-bece-234472c034e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:58.385808 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13692593-c760-4c80-bece-234472c034e4 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:58.404726 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1303/2609] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:13:58 2021] POST /identity/v3/users => generated 293 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:13:58.409309 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff295198-4649-456b-a212-49ea14b28501 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:58.419141 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff295198-4649-456b-a212-49ea14b28501 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:58.423908 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec591e9f-2ff0-4e73-994a-1d9475c1aa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:58.424499 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec591e9f-2ff0-4e73-994a-1d9475c1aa53 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:58.424784 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec591e9f-2ff0-4e73-994a-1d9475c1aa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:58.425058 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec591e9f-2ff0-4e73-994a-1d9475c1aa53 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:58.425742 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec591e9f-2ff0-4e73-994a-1d9475c1aa53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:58.450484 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec591e9f-2ff0-4e73-994a-1d9475c1aa53 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:58.460338 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1307/2610] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:13:58 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:13:58.464406 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13692593-c760-4c80-bece-234472c034e4 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:58.474665 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13692593-c760-4c80-bece-234472c034e4 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:58.478843 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a078f-384d-4ae3-addd-3279e168344e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:58.479679 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a078f-384d-4ae3-addd-3279e168344e admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:58.479960 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a078f-384d-4ae3-addd-3279e168344e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:58.480228 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a078f-384d-4ae3-addd-3279e168344e admin admin] PATH_INFO: `/v3/projects/a7ae55ea72df4e3492ffe9b26c058b21/users/4a3a7fe60a5941fd841a3df031305f26/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:58.499809 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a078f-384d-4ae3-addd-3279e168344e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7ae55ea72df4e3492ffe9b26c058b21, user_id=4a3a7fe60a5941fd841a3df031305f26, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:58.526494 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a078f-384d-4ae3-addd-3279e168344e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:58.539682 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1304/2611] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:13:58 2021] PUT /identity/v3/projects/a7ae55ea72df4e3492ffe9b26c058b21/users/4a3a7fe60a5941fd841a3df031305f26/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:13:58.550585 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee006dfe-2266-4a15-a7fb-70141efc630a None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:58.550875 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee006dfe-2266-4a15-a7fb-70141efc630a None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:58.551155 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee006dfe-2266-4a15-a7fb-70141efc630a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:58.586885 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-ee006dfe-2266-4a15-a7fb-70141efc630a None None] MFA Rules not processed for user `4a3a7fe60a5941fd841a3df031305f26`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:13:58.588059 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-ee006dfe-2266-4a15-a7fb-70141efc630a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:58.658818 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1308/2612] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:13:58 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:13:58.663202 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a078f-384d-4ae3-addd-3279e168344e admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:58.729556 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a078f-384d-4ae3-addd-3279e168344e admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:58.733854 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72926d1-ac8e-4839-8f50-a815812bd2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:58.734437 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72926d1-ac8e-4839-8f50-a815812bd2f5 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:58.734726 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72926d1-ac8e-4839-8f50-a815812bd2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:58.735005 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72926d1-ac8e-4839-8f50-a815812bd2f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:58.735662 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72926d1-ac8e-4839-8f50-a815812bd2f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:58.760750 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72926d1-ac8e-4839-8f50-a815812bd2f5 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:58.786906 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1305/2613] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:13:58 2021] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:13:58.791007 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee006dfe-2266-4a15-a7fb-70141efc630a None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:58.801246 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee006dfe-2266-4a15-a7fb-70141efc630a None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:58.864200 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1cc826-6236-4c44-8168-c552998e5313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:58.864883 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cc826-6236-4c44-8168-c552998e5313 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:58.865105 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cc826-6236-4c44-8168-c552998e5313 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:58.865382 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1cc826-6236-4c44-8168-c552998e5313 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:58.866006 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1cc826-6236-4c44-8168-c552998e5313 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:58.891428 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1cc826-6236-4c44-8168-c552998e5313 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:58.911973 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1309/2614] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:13:58 2021] POST /identity/v3/users => generated 299 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:13:58.915824 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72926d1-ac8e-4839-8f50-a815812bd2f5 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:58.925810 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72926d1-ac8e-4839-8f50-a815812bd2f5 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:58.930007 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9adabe-22e2-49e3-a33d-5f44c59c0b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:58.930601 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9adabe-22e2-49e3-a33d-5f44c59c0b56 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:58.930895 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9adabe-22e2-49e3-a33d-5f44c59c0b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:58.931167 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9adabe-22e2-49e3-a33d-5f44c59c0b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:58.931890 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9adabe-22e2-49e3-a33d-5f44c59c0b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:58.958233 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9adabe-22e2-49e3-a33d-5f44c59c0b56 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:58.969766 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1306/2615] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:13:58 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:13:58.974020 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1cc826-6236-4c44-8168-c552998e5313 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:58.983512 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1cc826-6236-4c44-8168-c552998e5313 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:58.987750 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13814b14-5563-49bf-84fc-4e719fb82836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:58.988557 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13814b14-5563-49bf-84fc-4e719fb82836 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:58.988845 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13814b14-5563-49bf-84fc-4e719fb82836 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:58.989143 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13814b14-5563-49bf-84fc-4e719fb82836 admin admin] PATH_INFO: `/v3/projects/3a780fd9bdd640c59cbce5f0a55e5f3a/users/2777ef87ce504fd8a1a8e19efc104d2d/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:59.010520 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13814b14-5563-49bf-84fc-4e719fb82836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a780fd9bdd640c59cbce5f0a55e5f3a, user_id=2777ef87ce504fd8a1a8e19efc104d2d, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:59.037444 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13814b14-5563-49bf-84fc-4e719fb82836 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:59.050833 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1310/2616] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:13:58 2021] PUT /identity/v3/projects/3a780fd9bdd640c59cbce5f0a55e5f3a/users/2777ef87ce504fd8a1a8e19efc104d2d/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:13:59.054655 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9adabe-22e2-49e3-a33d-5f44c59c0b56 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:59.064723 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9adabe-22e2-49e3-a33d-5f44c59c0b56 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:59.127024 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca2ba7-a563-4b4e-beaf-e158e0888088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:59.127656 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca2ba7-a563-4b4e-beaf-e158e0888088 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:59.127947 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca2ba7-a563-4b4e-beaf-e158e0888088 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:59.128225 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca2ba7-a563-4b4e-beaf-e158e0888088 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:59.128908 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca2ba7-a563-4b4e-beaf-e158e0888088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:59.154867 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca2ba7-a563-4b4e-beaf-e158e0888088 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:59.164923 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1307/2617] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:13:59 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:13:59.169028 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13814b14-5563-49bf-84fc-4e719fb82836 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:59.178546 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13814b14-5563-49bf-84fc-4e719fb82836 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:59.182613 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb72fa-cf46-4336-b113-a105e8430d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:59.183652 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb72fa-cf46-4336-b113-a105e8430d5d admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:59.183935 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb72fa-cf46-4336-b113-a105e8430d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:59.184212 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb72fa-cf46-4336-b113-a105e8430d5d admin admin] PATH_INFO: `/v3/projects/3a780fd9bdd640c59cbce5f0a55e5f3a/users/2777ef87ce504fd8a1a8e19efc104d2d/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:59.185961 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb72fa-cf46-4336-b113-a105e8430d5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a780fd9bdd640c59cbce5f0a55e5f3a, user_id=2777ef87ce504fd8a1a8e19efc104d2d, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:59.212868 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb72fa-cf46-4336-b113-a105e8430d5d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:59.222580 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1311/2618] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:13:59 2021] PUT /identity/v3/projects/3a780fd9bdd640c59cbce5f0a55e5f3a/users/2777ef87ce504fd8a1a8e19efc104d2d/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:13:59.226494 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca2ba7-a563-4b4e-beaf-e158e0888088 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:59.236242 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca2ba7-a563-4b4e-beaf-e158e0888088 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:59.299072 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171026a-82d6-40d6-837a-f66d53f21d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:59.299715 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171026a-82d6-40d6-837a-f66d53f21d64 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:59.299984 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171026a-82d6-40d6-837a-f66d53f21d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:59.300261 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171026a-82d6-40d6-837a-f66d53f21d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:59.300944 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171026a-82d6-40d6-837a-f66d53f21d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:59.327298 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171026a-82d6-40d6-837a-f66d53f21d64 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:59.337330 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1308/2619] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:13:59 2021] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:13:59.341650 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb72fa-cf46-4336-b113-a105e8430d5d admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:59.351165 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb72fa-cf46-4336-b113-a105e8430d5d admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:59.355209 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e19872-90ad-464b-852a-3e95fda87b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:59.356032 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e19872-90ad-464b-852a-3e95fda87b12 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:59.356311 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e19872-90ad-464b-852a-3e95fda87b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:59.356580 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e19872-90ad-464b-852a-3e95fda87b12 admin admin] PATH_INFO: `/v3/projects/3a780fd9bdd640c59cbce5f0a55e5f3a/users/2777ef87ce504fd8a1a8e19efc104d2d/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:59.358288 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e19872-90ad-464b-852a-3e95fda87b12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a780fd9bdd640c59cbce5f0a55e5f3a, user_id=2777ef87ce504fd8a1a8e19efc104d2d, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:59.385276 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e19872-90ad-464b-852a-3e95fda87b12 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:59.398212 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1312/2620] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:13:59 2021] PUT /identity/v3/projects/3a780fd9bdd640c59cbce5f0a55e5f3a/users/2777ef87ce504fd8a1a8e19efc104d2d/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:13:59.408225 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e630f-90e4-4c09-9928-814c0d2e8ddb None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:59.408521 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e630f-90e4-4c09-9928-814c0d2e8ddb None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:59.408826 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e630f-90e4-4c09-9928-814c0d2e8ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:59.446631 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-560e630f-90e4-4c09-9928-814c0d2e8ddb None None] MFA Rules not processed for user `2777ef87ce504fd8a1a8e19efc104d2d`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:13:59.447743 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-560e630f-90e4-4c09-9928-814c0d2e8ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:59.521933 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1309/2621] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:13:59 2021] POST /identity/v3/auth/tokens => generated 3759 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:13:59.531522 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e19872-90ad-464b-852a-3e95fda87b12 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:13:59.533092 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-37e19872-90ad-464b-852a-3e95fda87b12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:13:59.596188 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e19872-90ad-464b-852a-3e95fda87b12 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:13:59.599580 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a04f80-56f1-4a1a-aaea-c319467e5b7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:13:59.600156 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a04f80-56f1-4a1a-aaea-c319467e5b7e service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:13:59.600445 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a04f80-56f1-4a1a-aaea-c319467e5b7e service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:13:59.600725 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a04f80-56f1-4a1a-aaea-c319467e5b7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:13:59.609483 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a04f80-56f1-4a1a-aaea-c319467e5b7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:13:59.635357 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a04f80-56f1-4a1a-aaea-c319467e5b7e service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:13:59.644731 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1313/2622] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:13:59 2021] GET /identity/v3/auth/tokens => generated 3759 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:14:00.511078 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e630f-90e4-4c09-9928-814c0d2e8ddb None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:14:00.577330 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e630f-90e4-4c09-9928-814c0d2e8ddb None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:14:00.581946 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bc611-0c26-407e-9665-d954d9af1c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:14:00.582741 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bc611-0c26-407e-9665-d954d9af1c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:00.583027 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bc611-0c26-407e-9665-d954d9af1c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:00.583307 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bc611-0c26-407e-9665-d954d9af1c8c admin admin] PATH_INFO: `/v3/users/4a3a7fe60a5941fd841a3df031305f26` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:00.584408 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bc611-0c26-407e-9665-d954d9af1c8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a3a7fe60a5941fd841a3df031305f26)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:14:00.610289 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bc611-0c26-407e-9665-d954d9af1c8c admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:14:00.663536 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-151bc611-0c26-407e-9665-d954d9af1c8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a3a7fe60a5941fd841a3df031305f26'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:14:00.675420 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-151bc611-0c26-407e-9665-d954d9af1c8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a3a7fe60a5941fd841a3df031305f26'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:14:00.676071 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-151bc611-0c26-407e-9665-d954d9af1c8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a3a7fe60a5941fd841a3df031305f26'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:14:00.682719 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-151bc611-0c26-407e-9665-d954d9af1c8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a3a7fe60a5941fd841a3df031305f26'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:14:00.690460 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-151bc611-0c26-407e-9665-d954d9af1c8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a3a7fe60a5941fd841a3df031305f26'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:14:00.696110 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1310/2623] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:14:00 2021] DELETE /identity/v3/users/4a3a7fe60a5941fd841a3df031305f26 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:14:00.700487 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9852f-5944-4c20-8054-54bed0a599e8 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:00.700956 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9852f-5944-4c20-8054-54bed0a599e8 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:00.701055 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9852f-5944-4c20-8054-54bed0a599e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:00.723122 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-7dd9852f-5944-4c20-8054-54bed0a599e8 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:14:00.724288 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-7dd9852f-5944-4c20-8054-54bed0a599e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:14:00.787511 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1314/2624] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:14:00 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:14:00.797533 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bc611-0c26-407e-9665-d954d9af1c8c admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:14:00.798854 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-151bc611-0c26-407e-9665-d954d9af1c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:14:00.861125 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bc611-0c26-407e-9665-d954d9af1c8c admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:14:00.864409 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e45ac-8401-4673-8cbf-474039a89dea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:14:00.864994 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e45ac-8401-4673-8cbf-474039a89dea service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:00.865280 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e45ac-8401-4673-8cbf-474039a89dea service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:00.865558 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4e45ac-8401-4673-8cbf-474039a89dea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:00.874084 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e45ac-8401-4673-8cbf-474039a89dea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:14:00.899485 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4e45ac-8401-4673-8cbf-474039a89dea service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:14:00.908757 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1311/2625] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:14:00 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:14:01.258186 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9852f-5944-4c20-8054-54bed0a599e8 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:14:01.259703 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-7dd9852f-5944-4c20-8054-54bed0a599e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:14:01.272931 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9852f-5944-4c20-8054-54bed0a599e8 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:14:01.278494 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b141fb7-1f95-443c-8301-6e8526818390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:14:01.279555 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b141fb7-1f95-443c-8301-6e8526818390 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:01.280017 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b141fb7-1f95-443c-8301-6e8526818390 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:01.280404 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b141fb7-1f95-443c-8301-6e8526818390 admin admin] PATH_INFO: `/v3/projects/a7ae55ea72df4e3492ffe9b26c058b21` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:01.282218 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b141fb7-1f95-443c-8301-6e8526818390 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7ae55ea72df4e3492ffe9b26c058b21)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:14:01.309069 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b141fb7-1f95-443c-8301-6e8526818390 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:14:01.360183 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-9b141fb7-1f95-443c-8301-6e8526818390 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7ae55ea72df4e3492ffe9b26c058b21', 'request_id': 'req-9b141fb7-1f95-443c-8301-6e8526818390'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:14:01.365199 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-9b141fb7-1f95-443c-8301-6e8526818390 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7ae55ea72df4e3492ffe9b26c058b21', 'request_id': 'req-9b141fb7-1f95-443c-8301-6e8526818390'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:14:01.376876 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-9b141fb7-1f95-443c-8301-6e8526818390 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7ae55ea72df4e3492ffe9b26c058b21', 'request_id': 'req-9b141fb7-1f95-443c-8301-6e8526818390'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:14:01.388735 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-9b141fb7-1f95-443c-8301-6e8526818390 admin admin] The token cache is being invalidate because project a7ae55ea72df4e3492ffe9b26c058b21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:14:01.389013 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-9b141fb7-1f95-443c-8301-6e8526818390 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:14:01.389591 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-9b141fb7-1f95-443c-8301-6e8526818390 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:14:01.390985 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1315/2626] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:14:01 2021] DELETE /identity/v3/projects/a7ae55ea72df4e3492ffe9b26c058b21 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:14:01.395630 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e45ac-8401-4673-8cbf-474039a89dea service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:14:01.405010 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4e45ac-8401-4673-8cbf-474039a89dea service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:14:01.466623 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41a397-4f08-4b48-9cc3-286c31923db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:14:01.467418 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41a397-4f08-4b48-9cc3-286c31923db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:01.467731 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41a397-4f08-4b48-9cc3-286c31923db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:01.468008 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41a397-4f08-4b48-9cc3-286c31923db7 admin admin] PATH_INFO: `/v3/users/2777ef87ce504fd8a1a8e19efc104d2d` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:01.469082 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41a397-4f08-4b48-9cc3-286c31923db7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2777ef87ce504fd8a1a8e19efc104d2d)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:14:01.495868 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41a397-4f08-4b48-9cc3-286c31923db7 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:14:01.543697 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-1c41a397-4f08-4b48-9cc3-286c31923db7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2777ef87ce504fd8a1a8e19efc104d2d'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:14:01.555356 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-1c41a397-4f08-4b48-9cc3-286c31923db7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2777ef87ce504fd8a1a8e19efc104d2d'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:14:01.556027 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-1c41a397-4f08-4b48-9cc3-286c31923db7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2777ef87ce504fd8a1a8e19efc104d2d'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:14:01.562614 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-1c41a397-4f08-4b48-9cc3-286c31923db7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2777ef87ce504fd8a1a8e19efc104d2d'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:14:01.570066 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-1c41a397-4f08-4b48-9cc3-286c31923db7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2777ef87ce504fd8a1a8e19efc104d2d'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:14:01.575661 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1312/2627] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:14:01 2021] DELETE /identity/v3/users/2777ef87ce504fd8a1a8e19efc104d2d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:14:01.924557 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b141fb7-1f95-443c-8301-6e8526818390 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:14:01.925933 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-9b141fb7-1f95-443c-8301-6e8526818390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:14:01.937779 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b141fb7-1f95-443c-8301-6e8526818390 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:14:02.000261 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2d9a5-a2a4-49b0-85e3-a1d13ae80319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:14:02.000961 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2d9a5-a2a4-49b0-85e3-a1d13ae80319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:02.001758 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2d9a5-a2a4-49b0-85e3-a1d13ae80319 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:02.002033 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2d9a5-a2a4-49b0-85e3-a1d13ae80319 admin admin] PATH_INFO: `/v3/projects/3a780fd9bdd640c59cbce5f0a55e5f3a` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:02.003087 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2d9a5-a2a4-49b0-85e3-a1d13ae80319 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a780fd9bdd640c59cbce5f0a55e5f3a)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:14:02.029129 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2d9a5-a2a4-49b0-85e3-a1d13ae80319 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:14:02.078543 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-abf2d9a5-a2a4-49b0-85e3-a1d13ae80319 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a780fd9bdd640c59cbce5f0a55e5f3a', 'request_id': 'req-abf2d9a5-a2a4-49b0-85e3-a1d13ae80319'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:14:02.083421 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-abf2d9a5-a2a4-49b0-85e3-a1d13ae80319 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a780fd9bdd640c59cbce5f0a55e5f3a', 'request_id': 'req-abf2d9a5-a2a4-49b0-85e3-a1d13ae80319'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:14:02.094520 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-abf2d9a5-a2a4-49b0-85e3-a1d13ae80319 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a780fd9bdd640c59cbce5f0a55e5f3a', 'request_id': 'req-abf2d9a5-a2a4-49b0-85e3-a1d13ae80319'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:14:02.105565 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-abf2d9a5-a2a4-49b0-85e3-a1d13ae80319 admin admin] The token cache is being invalidate because project 3a780fd9bdd640c59cbce5f0a55e5f3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:14:02.105847 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-abf2d9a5-a2a4-49b0-85e3-a1d13ae80319 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:14:02.106459 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-abf2d9a5-a2a4-49b0-85e3-a1d13ae80319 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:14:02.107882 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1316/2628] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:14:01 2021] DELETE /identity/v3/projects/3a780fd9bdd640c59cbce5f0a55e5f3a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:14:02.114357 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efe9b2-dc3e-48bb-af24-9b4050a168d0 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:02.114649 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efe9b2-dc3e-48bb-af24-9b4050a168d0 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:02.114928 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efe9b2-dc3e-48bb-af24-9b4050a168d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:02.136470 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-94efe9b2-dc3e-48bb-af24-9b4050a168d0 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:14:02.137600 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-94efe9b2-dc3e-48bb-af24-9b4050a168d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:14:02.202060 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1313/2629] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:14:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:14:02.209887 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff82ba-263e-4bbf-b6cf-fed1b947b978 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:02.210177 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff82ba-263e-4bbf-b6cf-fed1b947b978 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:02.210453 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff82ba-263e-4bbf-b6cf-fed1b947b978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:02.233116 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-a7ff82ba-263e-4bbf-b6cf-fed1b947b978 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:14:02.234280 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-a7ff82ba-263e-4bbf-b6cf-fed1b947b978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:14:02.241877 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1317/2630] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:14:02 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:14:02.246125 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94efe9b2-dc3e-48bb-af24-9b4050a168d0 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:14:02.255256 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94efe9b2-dc3e-48bb-af24-9b4050a168d0 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:14:02.259342 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a588772-6cc0-40fe-9a0a-757138f34365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:14:02.259955 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a588772-6cc0-40fe-9a0a-757138f34365 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:02.260263 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a588772-6cc0-40fe-9a0a-757138f34365 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:02.260538 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a588772-6cc0-40fe-9a0a-757138f34365 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:02.261212 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a588772-6cc0-40fe-9a0a-757138f34365 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:14:02.261507 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a588772-6cc0-40fe-9a0a-757138f34365 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:14:02.287618 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a588772-6cc0-40fe-9a0a-757138f34365 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:14:02.300675 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1314/2631] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:14:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 15:14:02.304959 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff82ba-263e-4bbf-b6cf-fed1b947b978 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:14:02.313669 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff82ba-263e-4bbf-b6cf-fed1b947b978 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:14:02.318021 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65edb736-6e60-489a-95a4-7cd345f79a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:14:02.318629 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edb736-6e60-489a-95a4-7cd345f79a7d admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:02.318965 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edb736-6e60-489a-95a4-7cd345f79a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:02.319247 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edb736-6e60-489a-95a4-7cd345f79a7d admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:02.319925 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65edb736-6e60-489a-95a4-7cd345f79a7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:14:02.346720 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65edb736-6e60-489a-95a4-7cd345f79a7d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:14:02.374090 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1318/2632] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:14:02 2021] POST /identity/v3/projects => generated 369 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:14:02.378207 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a588772-6cc0-40fe-9a0a-757138f34365 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:14:02.388181 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a588772-6cc0-40fe-9a0a-757138f34365 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:14:02.450658 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2179f6-9c05-419a-9e0a-714acb409150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:14:02.451263 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2179f6-9c05-419a-9e0a-714acb409150 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:02.451580 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2179f6-9c05-419a-9e0a-714acb409150 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:02.451859 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2179f6-9c05-419a-9e0a-714acb409150 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:02.452488 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2179f6-9c05-419a-9e0a-714acb409150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:14:02.478803 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2179f6-9c05-419a-9e0a-714acb409150 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:14:02.498553 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1315/2633] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:14:02 2021] POST /identity/v3/users => generated 285 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:14:02.502722 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65edb736-6e60-489a-95a4-7cd345f79a7d admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:14:02.512662 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65edb736-6e60-489a-95a4-7cd345f79a7d admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:14:02.517468 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0a028-7551-4f56-ba3b-e0190ced24f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:14:02.518091 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0a028-7551-4f56-ba3b-e0190ced24f7 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:02.518406 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0a028-7551-4f56-ba3b-e0190ced24f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:02.518683 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0a028-7551-4f56-ba3b-e0190ced24f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:02.519403 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0a028-7551-4f56-ba3b-e0190ced24f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:14:02.546103 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0a028-7551-4f56-ba3b-e0190ced24f7 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:14:02.556471 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1319/2634] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:14:02 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:14:02.560595 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2179f6-9c05-419a-9e0a-714acb409150 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:14:02.570388 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2179f6-9c05-419a-9e0a-714acb409150 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:14:02.574604 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59305c13-7f9e-4476-a262-3240be63b58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:14:02.575412 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59305c13-7f9e-4476-a262-3240be63b58f admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:02.575742 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59305c13-7f9e-4476-a262-3240be63b58f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:02.576020 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59305c13-7f9e-4476-a262-3240be63b58f admin admin] PATH_INFO: `/v3/projects/0a450d9b4c134a99ba935fc7f37303b6/users/efdddef674cf463f836974e48451684b/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:02.597162 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59305c13-7f9e-4476-a262-3240be63b58f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a450d9b4c134a99ba935fc7f37303b6, user_id=efdddef674cf463f836974e48451684b, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:14:02.623348 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59305c13-7f9e-4476-a262-3240be63b58f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:14:02.636534 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1316/2635] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:14:02 2021] PUT /identity/v3/projects/0a450d9b4c134a99ba935fc7f37303b6/users/efdddef674cf463f836974e48451684b/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:14:02.648270 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720ca4c-94dd-4f8a-a898-ccc5736d067b None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:02.648865 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720ca4c-94dd-4f8a-a898-ccc5736d067b None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:02.649151 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720ca4c-94dd-4f8a-a898-ccc5736d067b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:02.685573 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-7720ca4c-94dd-4f8a-a898-ccc5736d067b None None] MFA Rules not processed for user `efdddef674cf463f836974e48451684b`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:14:02.686732 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-7720ca4c-94dd-4f8a-a898-ccc5736d067b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:14:02.763908 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1320/2636] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:14:02 2021] POST /identity/v3/auth/tokens => generated 3676 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:14:02.775790 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59305c13-7f9e-4476-a262-3240be63b58f admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:14:02.777373 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-59305c13-7f9e-4476-a262-3240be63b58f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:14:02.839485 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59305c13-7f9e-4476-a262-3240be63b58f admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:14:02.842897 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40255f46-bb52-4968-8ba3-b16f1c5cd73a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '17c345fc642242469346303afbeda2f6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:14:02.843503 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40255f46-bb52-4968-8ba3-b16f1c5cd73a service glance] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:02.843791 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40255f46-bb52-4968-8ba3-b16f1c5cd73a service glance] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:02.844069 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40255f46-bb52-4968-8ba3-b16f1c5cd73a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:02.851992 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40255f46-bb52-4968-8ba3-b16f1c5cd73a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:14:02.877143 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40255f46-bb52-4968-8ba3-b16f1c5cd73a service glance] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:14:02.885527 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1317/2637] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:14:02 2021] GET /identity/v3/auth/tokens => generated 3676 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:14:38.764151 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720ca4c-94dd-4f8a-a898-ccc5736d067b None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:14:38.830404 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720ca4c-94dd-4f8a-a898-ccc5736d067b None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:14:38.834419 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8918830-3d77-4950-a561-0dd80653ad42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:14:38.835206 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8918830-3d77-4950-a561-0dd80653ad42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:38.835509 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8918830-3d77-4950-a561-0dd80653ad42 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:38.835785 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8918830-3d77-4950-a561-0dd80653ad42 admin admin] PATH_INFO: `/v3/users/efdddef674cf463f836974e48451684b` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:38.836846 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8918830-3d77-4950-a561-0dd80653ad42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efdddef674cf463f836974e48451684b)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:14:38.863007 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8918830-3d77-4950-a561-0dd80653ad42 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:14:38.917920 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-a8918830-3d77-4950-a561-0dd80653ad42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efdddef674cf463f836974e48451684b'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:14:38.918868 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-a8918830-3d77-4950-a561-0dd80653ad42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efdddef674cf463f836974e48451684b'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:14:38.936172 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-a8918830-3d77-4950-a561-0dd80653ad42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efdddef674cf463f836974e48451684b'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:14:38.944319 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-a8918830-3d77-4950-a561-0dd80653ad42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efdddef674cf463f836974e48451684b'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:14:38.952997 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-a8918830-3d77-4950-a561-0dd80653ad42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efdddef674cf463f836974e48451684b'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:14:38.959005 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1321/2638] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:14:38 2021] DELETE /identity/v3/users/efdddef674cf463f836974e48451684b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:14:38.963720 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ede541-193e-400d-a45e-6b412e754074 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:38.964214 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ede541-193e-400d-a45e-6b412e754074 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:38.964214 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ede541-193e-400d-a45e-6b412e754074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:38.988887 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-f3ede541-193e-400d-a45e-6b412e754074 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:14:38.990100 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-f3ede541-193e-400d-a45e-6b412e754074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:14:39.057722 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1318/2639] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:14:38 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:14:39.067804 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8918830-3d77-4950-a561-0dd80653ad42 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:14:39.069158 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-a8918830-3d77-4950-a561-0dd80653ad42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:14:39.134044 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8918830-3d77-4950-a561-0dd80653ad42 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:14:39.137549 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a26f85-e862-47d9-ab08-165c027b5652 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:14:39.138143 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a26f85-e862-47d9-ab08-165c027b5652 service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:39.138424 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a26f85-e862-47d9-ab08-165c027b5652 service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:39.138973 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a26f85-e862-47d9-ab08-165c027b5652 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:39.149986 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a26f85-e862-47d9-ab08-165c027b5652 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:14:39.175395 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a26f85-e862-47d9-ab08-165c027b5652 service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:14:39.185861 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1322/2640] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:14:39 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:14:39.603988 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ede541-193e-400d-a45e-6b412e754074 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:14:39.605613 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-f3ede541-193e-400d-a45e-6b412e754074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:14:39.618152 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ede541-193e-400d-a45e-6b412e754074 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:14:39.623073 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519d451-55e5-4099-94df-80bbe3b1e284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:14:39.623910 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519d451-55e5-4099-94df-80bbe3b1e284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:39.624414 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519d451-55e5-4099-94df-80bbe3b1e284 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:39.624595 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519d451-55e5-4099-94df-80bbe3b1e284 admin admin] PATH_INFO: `/v3/projects/0a450d9b4c134a99ba935fc7f37303b6` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:39.626256 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0519d451-55e5-4099-94df-80bbe3b1e284 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a450d9b4c134a99ba935fc7f37303b6)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:14:39.660825 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0519d451-55e5-4099-94df-80bbe3b1e284 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:14:39.718436 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-0519d451-55e5-4099-94df-80bbe3b1e284 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a450d9b4c134a99ba935fc7f37303b6', 'request_id': 'req-0519d451-55e5-4099-94df-80bbe3b1e284'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:14:39.723662 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-0519d451-55e5-4099-94df-80bbe3b1e284 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a450d9b4c134a99ba935fc7f37303b6', 'request_id': 'req-0519d451-55e5-4099-94df-80bbe3b1e284'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:14:39.734606 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-0519d451-55e5-4099-94df-80bbe3b1e284 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a450d9b4c134a99ba935fc7f37303b6', 'request_id': 'req-0519d451-55e5-4099-94df-80bbe3b1e284'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:14:39.746713 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-0519d451-55e5-4099-94df-80bbe3b1e284 admin admin] The token cache is being invalidate because project 0a450d9b4c134a99ba935fc7f37303b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:14:39.746910 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-0519d451-55e5-4099-94df-80bbe3b1e284 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:14:39.747556 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-0519d451-55e5-4099-94df-80bbe3b1e284 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:14:39.749104 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1319/2641] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:14:39 2021] DELETE /identity/v3/projects/0a450d9b4c134a99ba935fc7f37303b6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:14:39.757247 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fe782-ceba-4678-a58c-dfbc985de792 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:39.757535 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fe782-ceba-4678-a58c-dfbc985de792 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:39.757811 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fe782-ceba-4678-a58c-dfbc985de792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:39.781537 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-d42fe782-ceba-4678-a58c-dfbc985de792 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:14:39.782671 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-d42fe782-ceba-4678-a58c-dfbc985de792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:14:39.847999 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1323/2642] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:14:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:14:39.855972 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b71bf-53ca-420d-8a23-3a68315c5a42 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:39.856267 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b71bf-53ca-420d-8a23-3a68315c5a42 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:39.856552 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b71bf-53ca-420d-8a23-3a68315c5a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:39.879757 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-9b9b71bf-53ca-420d-8a23-3a68315c5a42 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:14:39.880906 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-9b9b71bf-53ca-420d-8a23-3a68315c5a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:14:39.888024 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1320/2643] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:14:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:14:39.892255 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fe782-ceba-4678-a58c-dfbc985de792 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:14:39.902239 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fe782-ceba-4678-a58c-dfbc985de792 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:14:39.906681 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c4031-a52e-4fa2-b443-5388604038bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:14:39.907309 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c4031-a52e-4fa2-b443-5388604038bc admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:39.907624 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c4031-a52e-4fa2-b443-5388604038bc admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:39.908109 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c4031-a52e-4fa2-b443-5388604038bc admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:39.908865 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c4031-a52e-4fa2-b443-5388604038bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:14:39.909170 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c4031-a52e-4fa2-b443-5388604038bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:14:39.934636 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84c4031-a52e-4fa2-b443-5388604038bc admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:14:39.948932 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1324/2644] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:14:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:14:39.953249 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b71bf-53ca-420d-8a23-3a68315c5a42 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:14:39.962248 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b71bf-53ca-420d-8a23-3a68315c5a42 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:14:39.966556 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910ef86-9ec2-40f8-9b33-8f497aecc057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:14:39.967232 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910ef86-9ec2-40f8-9b33-8f497aecc057 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:39.967421 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910ef86-9ec2-40f8-9b33-8f497aecc057 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:39.967737 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910ef86-9ec2-40f8-9b33-8f497aecc057 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:39.968373 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910ef86-9ec2-40f8-9b33-8f497aecc057 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:14:39.994068 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910ef86-9ec2-40f8-9b33-8f497aecc057 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:14:40.024239 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1321/2645] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:14:39 2021] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:14:40.029110 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c4031-a52e-4fa2-b443-5388604038bc admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:14:40.041288 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c4031-a52e-4fa2-b443-5388604038bc admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:14:40.111623 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8468f-ebb8-46ff-9bf2-8af9c9f5b733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:14:40.112279 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8468f-ebb8-46ff-9bf2-8af9c9f5b733 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:40.112566 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8468f-ebb8-46ff-9bf2-8af9c9f5b733 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:40.112844 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8468f-ebb8-46ff-9bf2-8af9c9f5b733 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:40.113479 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8468f-ebb8-46ff-9bf2-8af9c9f5b733 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:14:40.138883 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8468f-ebb8-46ff-9bf2-8af9c9f5b733 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:14:40.159676 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1325/2646] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:14:40 2021] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:14:40.163930 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910ef86-9ec2-40f8-9b33-8f497aecc057 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:14:40.174457 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910ef86-9ec2-40f8-9b33-8f497aecc057 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:14:40.178719 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f1dec-766b-48f3-8107-d3f59e8ef1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:14:40.179317 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f1dec-766b-48f3-8107-d3f59e8ef1a6 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:40.179632 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f1dec-766b-48f3-8107-d3f59e8ef1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:40.179916 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f1dec-766b-48f3-8107-d3f59e8ef1a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:40.180605 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f1dec-766b-48f3-8107-d3f59e8ef1a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:14:40.206940 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f1dec-766b-48f3-8107-d3f59e8ef1a6 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:14:40.217785 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1322/2647] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:14:40 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:14:40.222169 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8468f-ebb8-46ff-9bf2-8af9c9f5b733 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:14:40.231884 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8468f-ebb8-46ff-9bf2-8af9c9f5b733 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:14:40.237514 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5b05a-f663-4634-9e29-2dbadb1cdbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:14:40.238427 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5b05a-f663-4634-9e29-2dbadb1cdbdd admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:40.238777 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5b05a-f663-4634-9e29-2dbadb1cdbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:40.239116 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5b05a-f663-4634-9e29-2dbadb1cdbdd admin admin] PATH_INFO: `/v3/projects/fa7e2b9a0ba0465681b2e222f259d8ff/users/5aea8e2505884cc8a191f2ad70a142fc/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:40.259981 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5b05a-f663-4634-9e29-2dbadb1cdbdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa7e2b9a0ba0465681b2e222f259d8ff, user_id=5aea8e2505884cc8a191f2ad70a142fc, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:14:40.286986 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5b05a-f663-4634-9e29-2dbadb1cdbdd admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:14:40.301598 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1326/2648] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:14:40 2021] PUT /identity/v3/projects/fa7e2b9a0ba0465681b2e222f259d8ff/users/5aea8e2505884cc8a191f2ad70a142fc/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:14:40.306669 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4eba2-e78c-40a6-893d-10ad488bb75c None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:40.306956 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4eba2-e78c-40a6-893d-10ad488bb75c None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:40.307231 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4eba2-e78c-40a6-893d-10ad488bb75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:40.330684 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-c9f4eba2-e78c-40a6-893d-10ad488bb75c None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:14:40.331932 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-c9f4eba2-e78c-40a6-893d-10ad488bb75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:14:40.405731 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1323/2649] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:14:40 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:14:40.416626 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5b05a-f663-4634-9e29-2dbadb1cdbdd admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:14:40.418294 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-72e5b05a-f663-4634-9e29-2dbadb1cdbdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:14:40.490547 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5b05a-f663-4634-9e29-2dbadb1cdbdd admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:14:40.493994 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116233f2-6607-4005-ac1b-96215fdf938d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:14:40.494579 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116233f2-6607-4005-ac1b-96215fdf938d service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:40.494866 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116233f2-6607-4005-ac1b-96215fdf938d service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:40.495147 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116233f2-6607-4005-ac1b-96215fdf938d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:40.504933 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116233f2-6607-4005-ac1b-96215fdf938d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:14:40.530637 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116233f2-6607-4005-ac1b-96215fdf938d service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:14:40.541281 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1327/2650] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:14:40 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:14:46.563471 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90adfb-b271-41b5-b85c-44a04f376c60 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:46.564564 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90adfb-b271-41b5-b85c-44a04f376c60 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:46.564864 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90adfb-b271-41b5-b85c-44a04f376c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:46.602747 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-9b90adfb-b271-41b5-b85c-44a04f376c60 None None] MFA Rules not processed for user `5aea8e2505884cc8a191f2ad70a142fc`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:14:46.603345 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-9b90adfb-b271-41b5-b85c-44a04f376c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:14:46.696823 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1324/2651] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:14:46 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:14:46.701121 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116233f2-6607-4005-ac1b-96215fdf938d service neutron] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:14:46.712465 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116233f2-6607-4005-ac1b-96215fdf938d service neutron] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:14:46.723830 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d6e95-2b2f-48e8-8b88-cbafc34277e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:14:46.724710 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d6e95-2b2f-48e8-8b88-cbafc34277e2 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:46.725206 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d6e95-2b2f-48e8-8b88-cbafc34277e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:46.726296 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d6e95-2b2f-48e8-8b88-cbafc34277e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:46.727495 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d6e95-2b2f-48e8-8b88-cbafc34277e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:14:46.761078 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7d6e95-2b2f-48e8-8b88-cbafc34277e2 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:14:46.801516 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1328/2652] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:14:46 2021] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:14:46.807023 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90adfb-b271-41b5-b85c-44a04f376c60 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:14:46.821254 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90adfb-b271-41b5-b85c-44a04f376c60 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:14:46.893239 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ca84a-6fa2-41c7-92c0-98afd5a19c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:14:46.893855 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ca84a-6fa2-41c7-92c0-98afd5a19c81 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:46.894141 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ca84a-6fa2-41c7-92c0-98afd5a19c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:46.894418 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081ca84a-6fa2-41c7-92c0-98afd5a19c81 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:46.895055 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ca84a-6fa2-41c7-92c0-98afd5a19c81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:14:46.921366 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081ca84a-6fa2-41c7-92c0-98afd5a19c81 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:14:46.945469 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1325/2653] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:14:46 2021] POST /identity/v3/users => generated 295 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:14:46.946570 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d6e95-2b2f-48e8-8b88-cbafc34277e2 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:14:46.956829 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d6e95-2b2f-48e8-8b88-cbafc34277e2 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:14:46.961061 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5dd4b6-d56b-4ed0-8a2b-9c0ac968219d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:14:46.961651 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dd4b6-d56b-4ed0-8a2b-9c0ac968219d admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:46.961935 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dd4b6-d56b-4ed0-8a2b-9c0ac968219d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:46.962217 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5dd4b6-d56b-4ed0-8a2b-9c0ac968219d admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:46.962910 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5dd4b6-d56b-4ed0-8a2b-9c0ac968219d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:14:46.989058 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5dd4b6-d56b-4ed0-8a2b-9c0ac968219d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:14:46.999747 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1329/2654] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:14:46 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:14:47.005245 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ca84a-6fa2-41c7-92c0-98afd5a19c81 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:14:47.014785 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081ca84a-6fa2-41c7-92c0-98afd5a19c81 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:14:47.018900 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f054e-44fa-42aa-8d99-2ca0f86b0080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:14:47.019750 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f054e-44fa-42aa-8d99-2ca0f86b0080 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:47.020033 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f054e-44fa-42aa-8d99-2ca0f86b0080 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:47.020308 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f054e-44fa-42aa-8d99-2ca0f86b0080 admin admin] PATH_INFO: `/v3/projects/bc36826208124b66a3c3af55cb4022ac/users/a7abcd3a1b514cd9a80f962ca75af01d/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:47.042691 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f054e-44fa-42aa-8d99-2ca0f86b0080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc36826208124b66a3c3af55cb4022ac, user_id=a7abcd3a1b514cd9a80f962ca75af01d, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:14:47.073784 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f054e-44fa-42aa-8d99-2ca0f86b0080 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:14:47.087550 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1326/2655] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:14:47 2021] PUT /identity/v3/projects/bc36826208124b66a3c3af55cb4022ac/users/a7abcd3a1b514cd9a80f962ca75af01d/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:14:47.092474 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5dd4b6-d56b-4ed0-8a2b-9c0ac968219d admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:14:47.101774 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5dd4b6-d56b-4ed0-8a2b-9c0ac968219d admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:14:47.175646 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bd328-7a16-484a-a620-428cb0f97b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:14:47.176265 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bd328-7a16-484a-a620-428cb0f97b43 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:47.176565 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bd328-7a16-484a-a620-428cb0f97b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:47.176826 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bd328-7a16-484a-a620-428cb0f97b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:47.177526 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bd328-7a16-484a-a620-428cb0f97b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:14:47.203486 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bd328-7a16-484a-a620-428cb0f97b43 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:14:47.214037 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1330/2656] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:14:47 2021] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:14:47.218312 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f054e-44fa-42aa-8d99-2ca0f86b0080 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:14:47.229040 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f054e-44fa-42aa-8d99-2ca0f86b0080 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:14:47.233334 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851b840-9ed6-49c5-880e-6f4590da0506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:14:47.234148 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851b840-9ed6-49c5-880e-6f4590da0506 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:47.234436 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851b840-9ed6-49c5-880e-6f4590da0506 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:47.234712 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851b840-9ed6-49c5-880e-6f4590da0506 admin admin] PATH_INFO: `/v3/projects/bc36826208124b66a3c3af55cb4022ac/users/a7abcd3a1b514cd9a80f962ca75af01d/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:47.238793 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851b840-9ed6-49c5-880e-6f4590da0506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc36826208124b66a3c3af55cb4022ac, user_id=a7abcd3a1b514cd9a80f962ca75af01d, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:14:47.265777 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851b840-9ed6-49c5-880e-6f4590da0506 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:14:47.278069 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1327/2657] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:14:47 2021] PUT /identity/v3/projects/bc36826208124b66a3c3af55cb4022ac/users/a7abcd3a1b514cd9a80f962ca75af01d/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:14:47.282236 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bd328-7a16-484a-a620-428cb0f97b43 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:14:47.293334 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bd328-7a16-484a-a620-428cb0f97b43 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:14:47.361173 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55613eb7-002a-4f40-9d02-aaed7ab67f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:14:47.361795 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55613eb7-002a-4f40-9d02-aaed7ab67f83 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:47.362083 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55613eb7-002a-4f40-9d02-aaed7ab67f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:47.362362 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55613eb7-002a-4f40-9d02-aaed7ab67f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:47.363058 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55613eb7-002a-4f40-9d02-aaed7ab67f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:14:47.388359 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55613eb7-002a-4f40-9d02-aaed7ab67f83 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:14:47.400181 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1331/2658] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:14:47 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:14:47.404791 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851b840-9ed6-49c5-880e-6f4590da0506 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:14:47.415394 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851b840-9ed6-49c5-880e-6f4590da0506 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:14:47.419851 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a32ab8-7170-44da-9646-f203359a0d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:14:47.420666 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a32ab8-7170-44da-9646-f203359a0d83 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:47.420981 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a32ab8-7170-44da-9646-f203359a0d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:47.421260 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a32ab8-7170-44da-9646-f203359a0d83 admin admin] PATH_INFO: `/v3/projects/bc36826208124b66a3c3af55cb4022ac/users/a7abcd3a1b514cd9a80f962ca75af01d/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:47.422999 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a32ab8-7170-44da-9646-f203359a0d83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc36826208124b66a3c3af55cb4022ac, user_id=a7abcd3a1b514cd9a80f962ca75af01d, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:14:47.450282 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a32ab8-7170-44da-9646-f203359a0d83 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:14:47.465543 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1328/2659] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:14:47 2021] PUT /identity/v3/projects/bc36826208124b66a3c3af55cb4022ac/users/a7abcd3a1b514cd9a80f962ca75af01d/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:14:48.342594 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55613eb7-002a-4f40-9d02-aaed7ab67f83 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:14:48.344416 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-55613eb7-002a-4f40-9d02-aaed7ab67f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:14:48.453689 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55613eb7-002a-4f40-9d02-aaed7ab67f83 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:14:48.525961 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7edc31-2c97-4a3b-970f-f0e825f32d4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:14:48.526581 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7edc31-2c97-4a3b-970f-f0e825f32d4f service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:48.526847 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7edc31-2c97-4a3b-970f-f0e825f32d4f service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:48.527125 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7edc31-2c97-4a3b-970f-f0e825f32d4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:48.529075 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-2d7edc31-2c97-4a3b-970f-f0e825f32d4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:14:48.613924 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7edc31-2c97-4a3b-970f-f0e825f32d4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:14:48.639544 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7edc31-2c97-4a3b-970f-f0e825f32d4f service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:14:48.651382 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1332/2660] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:14:48 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:14:54.256853 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6171d23-2775-4029-b82a-78e2278e1fd9 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:54.257746 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6171d23-2775-4029-b82a-78e2278e1fd9 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:54.258195 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6171d23-2775-4029-b82a-78e2278e1fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:54.321839 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-f6171d23-2775-4029-b82a-78e2278e1fd9 None None] MFA Rules not processed for user `a7abcd3a1b514cd9a80f962ca75af01d`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:14:54.324822 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-f6171d23-2775-4029-b82a-78e2278e1fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:14:54.443960 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1329/2661] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:14:54 2021] POST /identity/v3/auth/tokens => generated 3751 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:14:54.455427 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7edc31-2c97-4a3b-970f-f0e825f32d4f service cinder] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:14:54.456819 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-2d7edc31-2c97-4a3b-970f-f0e825f32d4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:14:54.549375 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7edc31-2c97-4a3b-970f-f0e825f32d4f service cinder] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:14:54.554329 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760f3d7-7e22-4eed-bb44-ddb8a0dc6b18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:14:54.554928 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760f3d7-7e22-4eed-bb44-ddb8a0dc6b18 service nova] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:14:54.555207 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760f3d7-7e22-4eed-bb44-ddb8a0dc6b18 service nova] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:14:54.555515 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760f3d7-7e22-4eed-bb44-ddb8a0dc6b18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:14:54.623381 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760f3d7-7e22-4eed-bb44-ddb8a0dc6b18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:14:54.648938 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760f3d7-7e22-4eed-bb44-ddb8a0dc6b18 service nova] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:14:54.664696 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1333/2662] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:14:54 2021] GET /identity/v3/auth/tokens => generated 3682 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:15:06.993395 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6171d23-2775-4029-b82a-78e2278e1fd9 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:06.994864 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-f6171d23-2775-4029-b82a-78e2278e1fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:07.062327 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6171d23-2775-4029-b82a-78e2278e1fd9 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:07.065658 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ea3b3-d3dc-480f-aa1d-976c519e0ff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:07.066245 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ea3b3-d3dc-480f-aa1d-976c519e0ff7 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:07.066532 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ea3b3-d3dc-480f-aa1d-976c519e0ff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:07.066812 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ea3b3-d3dc-480f-aa1d-976c519e0ff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:07.068506 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-279ea3b3-d3dc-480f-aa1d-976c519e0ff7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:07.141993 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ea3b3-d3dc-480f-aa1d-976c519e0ff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:07.167938 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ea3b3-d3dc-480f-aa1d-976c519e0ff7 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:07.178946 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1330/2663] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:15:06 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:15:13.172429 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760f3d7-7e22-4eed-bb44-ddb8a0dc6b18 service nova] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:13.173846 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-f760f3d7-7e22-4eed-bb44-ddb8a0dc6b18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:13.187089 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760f3d7-7e22-4eed-bb44-ddb8a0dc6b18 service nova] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:13.192536 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2750afc-169c-4ad6-86dd-b81f8055ceb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:13.193473 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2750afc-169c-4ad6-86dd-b81f8055ceb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:13.193778 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2750afc-169c-4ad6-86dd-b81f8055ceb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:13.194052 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2750afc-169c-4ad6-86dd-b81f8055ceb2 admin admin] PATH_INFO: `/v3/users/9e7f42dfb1c443dfa39b62736029931a` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:13.195156 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2750afc-169c-4ad6-86dd-b81f8055ceb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e7f42dfb1c443dfa39b62736029931a)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:13.225308 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2750afc-169c-4ad6-86dd-b81f8055ceb2 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:13.290693 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-d2750afc-169c-4ad6-86dd-b81f8055ceb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e7f42dfb1c443dfa39b62736029931a'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:13.291386 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-d2750afc-169c-4ad6-86dd-b81f8055ceb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e7f42dfb1c443dfa39b62736029931a'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:13.306107 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-d2750afc-169c-4ad6-86dd-b81f8055ceb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e7f42dfb1c443dfa39b62736029931a'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:13.315430 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-d2750afc-169c-4ad6-86dd-b81f8055ceb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e7f42dfb1c443dfa39b62736029931a'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:13.339423 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-d2750afc-169c-4ad6-86dd-b81f8055ceb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e7f42dfb1c443dfa39b62736029931a'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:13.346412 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1334/2664] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:15:13 2021] DELETE /identity/v3/users/9e7f42dfb1c443dfa39b62736029931a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:15:13.625308 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ea3b3-d3dc-480f-aa1d-976c519e0ff7 service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:13.639303 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ea3b3-d3dc-480f-aa1d-976c519e0ff7 service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:13.712773 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0680daa-9214-4f91-af98-ffa2b0a7cb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:13.713583 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0680daa-9214-4f91-af98-ffa2b0a7cb0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:13.713866 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0680daa-9214-4f91-af98-ffa2b0a7cb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:13.714142 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0680daa-9214-4f91-af98-ffa2b0a7cb0e admin admin] PATH_INFO: `/v3/projects/16cd4eff02e14dd2bb565b0b65ce8156` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:13.715273 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0680daa-9214-4f91-af98-ffa2b0a7cb0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=16cd4eff02e14dd2bb565b0b65ce8156)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:13.742595 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0680daa-9214-4f91-af98-ffa2b0a7cb0e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:13.801452 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-b0680daa-9214-4f91-af98-ffa2b0a7cb0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16cd4eff02e14dd2bb565b0b65ce8156', 'request_id': 'req-b0680daa-9214-4f91-af98-ffa2b0a7cb0e'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:13.807120 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-b0680daa-9214-4f91-af98-ffa2b0a7cb0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16cd4eff02e14dd2bb565b0b65ce8156', 'request_id': 'req-b0680daa-9214-4f91-af98-ffa2b0a7cb0e'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:13.820904 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-b0680daa-9214-4f91-af98-ffa2b0a7cb0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16cd4eff02e14dd2bb565b0b65ce8156', 'request_id': 'req-b0680daa-9214-4f91-af98-ffa2b0a7cb0e'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:13.834970 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-b0680daa-9214-4f91-af98-ffa2b0a7cb0e admin admin] The token cache is being invalidate because project 16cd4eff02e14dd2bb565b0b65ce8156 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:15:13.835389 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-b0680daa-9214-4f91-af98-ffa2b0a7cb0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:13.836048 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-b0680daa-9214-4f91-af98-ffa2b0a7cb0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:13.837572 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1331/2665] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:15:13 2021] DELETE /identity/v3/projects/16cd4eff02e14dd2bb565b0b65ce8156 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:15:13.845839 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f143f-fe07-4cde-9253-15c81b6420af None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:13.846229 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f143f-fe07-4cde-9253-15c81b6420af None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:13.846590 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f143f-fe07-4cde-9253-15c81b6420af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:13.870888 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-1f2f143f-fe07-4cde-9253-15c81b6420af None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:15:13.872375 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-1f2f143f-fe07-4cde-9253-15c81b6420af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:13.947799 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1335/2666] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:15:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:15:13.954104 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb35911-40d5-4439-9d5c-fee6d4437cd3 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:13.954423 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb35911-40d5-4439-9d5c-fee6d4437cd3 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:13.954706 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb35911-40d5-4439-9d5c-fee6d4437cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:13.977616 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-5bb35911-40d5-4439-9d5c-fee6d4437cd3 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:15:13.978790 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-5bb35911-40d5-4439-9d5c-fee6d4437cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:13.988537 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1332/2667] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:15:13 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:15:13.992745 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f143f-fe07-4cde-9253-15c81b6420af None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:14.004680 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f143f-fe07-4cde-9253-15c81b6420af None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:14.009204 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63490e0-0305-4d19-9c6f-377c1aa2c224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:14.009912 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63490e0-0305-4d19-9c6f-377c1aa2c224 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:14.010202 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63490e0-0305-4d19-9c6f-377c1aa2c224 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:14.010544 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63490e0-0305-4d19-9c6f-377c1aa2c224 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:14.011294 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63490e0-0305-4d19-9c6f-377c1aa2c224 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:15:14.011813 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63490e0-0305-4d19-9c6f-377c1aa2c224 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:14.039049 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63490e0-0305-4d19-9c6f-377c1aa2c224 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:14.056339 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1336/2668] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:15:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:15:14.060266 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb35911-40d5-4439-9d5c-fee6d4437cd3 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:14.070459 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb35911-40d5-4439-9d5c-fee6d4437cd3 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:14.074914 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97383d5-e78c-4f54-a1da-14e4aa38c5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:14.075541 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97383d5-e78c-4f54-a1da-14e4aa38c5a9 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:14.075829 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97383d5-e78c-4f54-a1da-14e4aa38c5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:14.076109 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97383d5-e78c-4f54-a1da-14e4aa38c5a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:14.076757 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97383d5-e78c-4f54-a1da-14e4aa38c5a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:14.104744 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97383d5-e78c-4f54-a1da-14e4aa38c5a9 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:14.140021 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1333/2669] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:15:14 2021] POST /identity/v3/projects => generated 369 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:15:14.141397 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63490e0-0305-4d19-9c6f-377c1aa2c224 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:14.152362 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63490e0-0305-4d19-9c6f-377c1aa2c224 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:14.241207 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a016f6-841e-4b3e-a7d0-27f937edf701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:14.242536 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a016f6-841e-4b3e-a7d0-27f937edf701 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:14.242937 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a016f6-841e-4b3e-a7d0-27f937edf701 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:14.243321 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a016f6-841e-4b3e-a7d0-27f937edf701 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:14.244091 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a016f6-841e-4b3e-a7d0-27f937edf701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:14.271318 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a016f6-841e-4b3e-a7d0-27f937edf701 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:14.294467 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1337/2670] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:15:14 2021] POST /identity/v3/users => generated 285 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:15:14.299022 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97383d5-e78c-4f54-a1da-14e4aa38c5a9 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:14.309695 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97383d5-e78c-4f54-a1da-14e4aa38c5a9 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:14.314566 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05960017-8585-471f-a5cf-cf8d868c4dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:14.315176 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05960017-8585-471f-a5cf-cf8d868c4dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:14.315483 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05960017-8585-471f-a5cf-cf8d868c4dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:14.315773 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05960017-8585-471f-a5cf-cf8d868c4dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:14.316482 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05960017-8585-471f-a5cf-cf8d868c4dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:14.343724 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05960017-8585-471f-a5cf-cf8d868c4dd2 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:14.360397 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1334/2671] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:15:14 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:15:14.364850 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a016f6-841e-4b3e-a7d0-27f937edf701 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:14.375386 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a016f6-841e-4b3e-a7d0-27f937edf701 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:14.381958 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6fa77-5649-4d09-bcdc-aa265b0ecd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:14.383002 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6fa77-5649-4d09-bcdc-aa265b0ecd00 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:14.383295 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6fa77-5649-4d09-bcdc-aa265b0ecd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:14.383609 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf6fa77-5649-4d09-bcdc-aa265b0ecd00 admin admin] PATH_INFO: `/v3/projects/290c9eaa73bd4876b312d186bb67c1a5/users/ba597e1ba98f48fb84ea02c95090b989/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:14.413714 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6fa77-5649-4d09-bcdc-aa265b0ecd00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=290c9eaa73bd4876b312d186bb67c1a5, user_id=ba597e1ba98f48fb84ea02c95090b989, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:14.445543 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf6fa77-5649-4d09-bcdc-aa265b0ecd00 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:14.473706 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1338/2672] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:15:14 2021] PUT /identity/v3/projects/290c9eaa73bd4876b312d186bb67c1a5/users/ba597e1ba98f48fb84ea02c95090b989/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:15:14.484599 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d4170-0311-423c-ae1c-66227ea0bb9d None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:14.484958 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d4170-0311-423c-ae1c-66227ea0bb9d None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:14.485330 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d4170-0311-423c-ae1c-66227ea0bb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:14.536343 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-7c1d4170-0311-423c-ae1c-66227ea0bb9d None None] MFA Rules not processed for user `ba597e1ba98f48fb84ea02c95090b989`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:15:14.536343 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-7c1d4170-0311-423c-ae1c-66227ea0bb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:14.625840 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1335/2673] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:15:14 2021] POST /identity/v3/auth/tokens => generated 3676 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:15:14.637859 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6fa77-5649-4d09-bcdc-aa265b0ecd00 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:14.640352 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-fdf6fa77-5649-4d09-bcdc-aa265b0ecd00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:14.659037 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c3203-dbdc-4664-9a64-de2a9444dade None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:14.659338 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c3203-dbdc-4664-9a64-de2a9444dade None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:14.659657 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c3203-dbdc-4664-9a64-de2a9444dade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:14.683192 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-7b6c3203-dbdc-4664-9a64-de2a9444dade None None] MFA Rules not processed for user `5aea8e2505884cc8a191f2ad70a142fc`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:15:14.684405 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-7b6c3203-dbdc-4664-9a64-de2a9444dade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:14.747356 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf6fa77-5649-4d09-bcdc-aa265b0ecd00 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:14.753501 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9825ab2-d3d3-46a3-9b61-0fe96aaee165 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:14.754396 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9825ab2-d3d3-46a3-9b61-0fe96aaee165 service nova] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:14.754785 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9825ab2-d3d3-46a3-9b61-0fe96aaee165 service nova] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:14.755166 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9825ab2-d3d3-46a3-9b61-0fe96aaee165 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:14.755640 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1336/2674] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:15:14 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:15:14.765656 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9825ab2-d3d3-46a3-9b61-0fe96aaee165 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:14.792119 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9825ab2-d3d3-46a3-9b61-0fe96aaee165 service nova] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:14.802480 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1339/2675] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:15:14 2021] GET /identity/v3/auth/tokens => generated 3676 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:15:18.170189 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c3203-dbdc-4664-9a64-de2a9444dade None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:18.336418 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c3203-dbdc-4664-9a64-de2a9444dade None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:18.339083 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d201dfb-acb0-4397-a56f-111e98b54633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:18.340147 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d201dfb-acb0-4397-a56f-111e98b54633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:18.340475 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d201dfb-acb0-4397-a56f-111e98b54633 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:18.340791 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d201dfb-acb0-4397-a56f-111e98b54633 admin admin] PATH_INFO: `/v3/users/ba597e1ba98f48fb84ea02c95090b989` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:18.343411 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d201dfb-acb0-4397-a56f-111e98b54633 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba597e1ba98f48fb84ea02c95090b989)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:18.382864 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d201dfb-acb0-4397-a56f-111e98b54633 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:18.466267 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-5d201dfb-acb0-4397-a56f-111e98b54633 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba597e1ba98f48fb84ea02c95090b989'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:18.482532 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-5d201dfb-acb0-4397-a56f-111e98b54633 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba597e1ba98f48fb84ea02c95090b989'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:18.483732 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-5d201dfb-acb0-4397-a56f-111e98b54633 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba597e1ba98f48fb84ea02c95090b989'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:18.494032 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-5d201dfb-acb0-4397-a56f-111e98b54633 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba597e1ba98f48fb84ea02c95090b989'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:18.510440 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-5d201dfb-acb0-4397-a56f-111e98b54633 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba597e1ba98f48fb84ea02c95090b989'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:18.524078 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1337/2676] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:15:18 2021] DELETE /identity/v3/users/ba597e1ba98f48fb84ea02c95090b989 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:15:18.529390 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009172cd-bc17-4764-aef9-af14f2a19474 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:18.530467 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009172cd-bc17-4764-aef9-af14f2a19474 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:18.530917 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009172cd-bc17-4764-aef9-af14f2a19474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:18.557677 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-009172cd-bc17-4764-aef9-af14f2a19474 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:15:18.559510 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-009172cd-bc17-4764-aef9-af14f2a19474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:18.637455 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1340/2677] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:15:18 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:15:18.648293 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d201dfb-acb0-4397-a56f-111e98b54633 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:18.649685 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-5d201dfb-acb0-4397-a56f-111e98b54633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:18.734897 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d201dfb-acb0-4397-a56f-111e98b54633 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:18.738372 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca99e8c-d51a-4452-a21b-8455d0e64839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:18.738964 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca99e8c-d51a-4452-a21b-8455d0e64839 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:18.739252 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca99e8c-d51a-4452-a21b-8455d0e64839 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:18.739572 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca99e8c-d51a-4452-a21b-8455d0e64839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:18.749154 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca99e8c-d51a-4452-a21b-8455d0e64839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:18.774828 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca99e8c-d51a-4452-a21b-8455d0e64839 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:18.786586 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1338/2678] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:15:18 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:15:19.173594 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009172cd-bc17-4764-aef9-af14f2a19474 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:19.175153 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-009172cd-bc17-4764-aef9-af14f2a19474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:19.198182 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009172cd-bc17-4764-aef9-af14f2a19474 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:19.203479 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27357927-85bb-4c17-819d-8a98707b65a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:19.205416 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27357927-85bb-4c17-819d-8a98707b65a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:19.205820 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27357927-85bb-4c17-819d-8a98707b65a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:19.206300 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27357927-85bb-4c17-819d-8a98707b65a4 admin admin] PATH_INFO: `/v3/projects/290c9eaa73bd4876b312d186bb67c1a5` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:19.207626 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27357927-85bb-4c17-819d-8a98707b65a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=290c9eaa73bd4876b312d186bb67c1a5)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:19.234427 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27357927-85bb-4c17-819d-8a98707b65a4 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:19.294908 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-27357927-85bb-4c17-819d-8a98707b65a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '290c9eaa73bd4876b312d186bb67c1a5', 'request_id': 'req-27357927-85bb-4c17-819d-8a98707b65a4'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:19.302375 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-27357927-85bb-4c17-819d-8a98707b65a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '290c9eaa73bd4876b312d186bb67c1a5', 'request_id': 'req-27357927-85bb-4c17-819d-8a98707b65a4'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:19.316405 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-27357927-85bb-4c17-819d-8a98707b65a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '290c9eaa73bd4876b312d186bb67c1a5', 'request_id': 'req-27357927-85bb-4c17-819d-8a98707b65a4'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:19.338818 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-27357927-85bb-4c17-819d-8a98707b65a4 admin admin] The token cache is being invalidate because project 290c9eaa73bd4876b312d186bb67c1a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:15:19.339106 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-27357927-85bb-4c17-819d-8a98707b65a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:19.339756 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-27357927-85bb-4c17-819d-8a98707b65a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:19.341229 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1341/2679] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:15:19 2021] DELETE /identity/v3/projects/290c9eaa73bd4876b312d186bb67c1a5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:15:19.346985 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73b49c-a968-4268-8600-3253eda5bc7f None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:19.347742 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73b49c-a968-4268-8600-3253eda5bc7f None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:19.347742 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73b49c-a968-4268-8600-3253eda5bc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:19.373999 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-bf73b49c-a968-4268-8600-3253eda5bc7f None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:15:19.375166 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-bf73b49c-a968-4268-8600-3253eda5bc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:19.448390 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1339/2680] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:15:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:15:19.456560 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e90c3-2943-4e80-b446-e75f5b719263 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:19.456904 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e90c3-2943-4e80-b446-e75f5b719263 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:19.457257 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e90c3-2943-4e80-b446-e75f5b719263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:19.481691 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-578e90c3-2943-4e80-b446-e75f5b719263 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:15:19.483190 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-578e90c3-2943-4e80-b446-e75f5b719263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:19.490856 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1342/2681] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:15:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:15:19.495083 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73b49c-a968-4268-8600-3253eda5bc7f None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:19.505917 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73b49c-a968-4268-8600-3253eda5bc7f None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:19.510689 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164b906-c64c-4e3a-9901-267a732035cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:19.515487 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164b906-c64c-4e3a-9901-267a732035cd admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:19.516040 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164b906-c64c-4e3a-9901-267a732035cd admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:19.516339 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164b906-c64c-4e3a-9901-267a732035cd admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:19.517975 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164b906-c64c-4e3a-9901-267a732035cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:15:19.518195 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164b906-c64c-4e3a-9901-267a732035cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:19.550169 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164b906-c64c-4e3a-9901-267a732035cd admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:19.580317 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1340/2682] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:15:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:15:19.585047 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e90c3-2943-4e80-b446-e75f5b719263 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:19.595850 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e90c3-2943-4e80-b446-e75f5b719263 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:19.603709 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b46e7-2964-447d-b710-ee48e8308721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:19.604328 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b46e7-2964-447d-b710-ee48e8308721 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:19.604662 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b46e7-2964-447d-b710-ee48e8308721 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:19.604968 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95b46e7-2964-447d-b710-ee48e8308721 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:19.605623 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b46e7-2964-447d-b710-ee48e8308721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:19.632215 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95b46e7-2964-447d-b710-ee48e8308721 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:19.662584 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1343/2683] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:15:19 2021] POST /identity/v3/projects => generated 363 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:15:19.667694 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164b906-c64c-4e3a-9901-267a732035cd admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:19.679826 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164b906-c64c-4e3a-9901-267a732035cd admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:19.749834 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4d8b4-9b72-4efa-b2b2-ed7d49892e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:19.750451 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4d8b4-9b72-4efa-b2b2-ed7d49892e88 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:19.750736 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4d8b4-9b72-4efa-b2b2-ed7d49892e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:19.751019 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df4d8b4-9b72-4efa-b2b2-ed7d49892e88 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:19.752280 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4d8b4-9b72-4efa-b2b2-ed7d49892e88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:19.778309 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df4d8b4-9b72-4efa-b2b2-ed7d49892e88 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:19.804544 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1341/2684] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:15:19 2021] POST /identity/v3/users => generated 282 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:15:19.809334 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b46e7-2964-447d-b710-ee48e8308721 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:19.820653 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95b46e7-2964-447d-b710-ee48e8308721 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:19.825069 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cfac66-e172-4f4f-96f9-3e49d54384c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:19.825672 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfac66-e172-4f4f-96f9-3e49d54384c6 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:19.825961 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfac66-e172-4f4f-96f9-3e49d54384c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:19.826240 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfac66-e172-4f4f-96f9-3e49d54384c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:19.826938 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfac66-e172-4f4f-96f9-3e49d54384c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:19.853575 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cfac66-e172-4f4f-96f9-3e49d54384c6 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:19.865641 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1344/2685] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:15:19 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:15:19.870020 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4d8b4-9b72-4efa-b2b2-ed7d49892e88 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:19.880096 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df4d8b4-9b72-4efa-b2b2-ed7d49892e88 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:19.884686 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca42c8b-3b98-4ba1-a0bb-114ef57e1389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:19.885670 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca42c8b-3b98-4ba1-a0bb-114ef57e1389 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:19.886114 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca42c8b-3b98-4ba1-a0bb-114ef57e1389 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:19.886428 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca42c8b-3b98-4ba1-a0bb-114ef57e1389 admin admin] PATH_INFO: `/v3/projects/3b1f8565c6f447aba8e55d174e5b1b46/users/cba8d422aa42437fafa1cac586e4313a/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:19.908981 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca42c8b-3b98-4ba1-a0bb-114ef57e1389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b1f8565c6f447aba8e55d174e5b1b46, user_id=cba8d422aa42437fafa1cac586e4313a, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:19.936550 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca42c8b-3b98-4ba1-a0bb-114ef57e1389 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:19.952143 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1342/2686] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:15:19 2021] PUT /identity/v3/projects/3b1f8565c6f447aba8e55d174e5b1b46/users/cba8d422aa42437fafa1cac586e4313a/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:15:19.963212 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55fa1d-5bdd-4ce2-b138-4ffa3a98ab09 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:19.963536 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55fa1d-5bdd-4ce2-b138-4ffa3a98ab09 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:19.963819 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c55fa1d-5bdd-4ce2-b138-4ffa3a98ab09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:20.005470 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-9c55fa1d-5bdd-4ce2-b138-4ffa3a98ab09 None None] MFA Rules not processed for user `cba8d422aa42437fafa1cac586e4313a`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:15:20.006652 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-9c55fa1d-5bdd-4ce2-b138-4ffa3a98ab09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:20.090649 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1345/2687] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:15:19 2021] POST /identity/v3/auth/tokens => generated 3670 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:15:20.096427 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca42c8b-3b98-4ba1-a0bb-114ef57e1389 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:20.171454 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca42c8b-3b98-4ba1-a0bb-114ef57e1389 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:20.176846 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178419b0-434b-4153-90dc-71c3b8e3f1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:20.177456 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178419b0-434b-4153-90dc-71c3b8e3f1c9 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:20.177747 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178419b0-434b-4153-90dc-71c3b8e3f1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:20.178024 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178419b0-434b-4153-90dc-71c3b8e3f1c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:20.178823 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178419b0-434b-4153-90dc-71c3b8e3f1c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:20.205155 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178419b0-434b-4153-90dc-71c3b8e3f1c9 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:20.236513 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1343/2688] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:15:20 2021] POST /identity/v3/projects => generated 365 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:15:20.240859 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55fa1d-5bdd-4ce2-b138-4ffa3a98ab09 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:20.252544 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c55fa1d-5bdd-4ce2-b138-4ffa3a98ab09 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:20.330218 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753b287-c6d7-45b6-81ce-3b92f7679acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:20.331067 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753b287-c6d7-45b6-81ce-3b92f7679acf admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:20.331363 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753b287-c6d7-45b6-81ce-3b92f7679acf admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:20.331630 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3753b287-c6d7-45b6-81ce-3b92f7679acf admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:20.332434 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753b287-c6d7-45b6-81ce-3b92f7679acf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:20.360247 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3753b287-c6d7-45b6-81ce-3b92f7679acf admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:20.384949 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1346/2689] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:15:20 2021] POST /identity/v3/users => generated 289 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:15:20.386437 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178419b0-434b-4153-90dc-71c3b8e3f1c9 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:20.398554 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178419b0-434b-4153-90dc-71c3b8e3f1c9 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:20.403924 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ace388-2814-40f1-899b-adfe13ec1c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:20.404546 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ace388-2814-40f1-899b-adfe13ec1c8a admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:20.404851 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ace388-2814-40f1-899b-adfe13ec1c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:20.405117 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ace388-2814-40f1-899b-adfe13ec1c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:20.405827 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ace388-2814-40f1-899b-adfe13ec1c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:20.431987 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ace388-2814-40f1-899b-adfe13ec1c8a admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:20.447490 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1344/2690] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:15:20 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:15:20.449280 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753b287-c6d7-45b6-81ce-3b92f7679acf admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:20.459736 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3753b287-c6d7-45b6-81ce-3b92f7679acf admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:20.471089 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac71887-0797-45e6-a6da-6ad25319dccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:20.472057 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac71887-0797-45e6-a6da-6ad25319dccf admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:20.472681 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac71887-0797-45e6-a6da-6ad25319dccf admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:20.472681 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac71887-0797-45e6-a6da-6ad25319dccf admin admin] PATH_INFO: `/v3/projects/81796dbc1e4f4d29bf03d5ac71625c80/users/4e165a6ed594480cb8b3ca0b2742b1cb/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:20.496038 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac71887-0797-45e6-a6da-6ad25319dccf admin admin] RBAC: Authorizing `identity:create_grant(project_id=81796dbc1e4f4d29bf03d5ac71625c80, user_id=4e165a6ed594480cb8b3ca0b2742b1cb, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:20.523592 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac71887-0797-45e6-a6da-6ad25319dccf admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:20.538321 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1347/2691] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:15:20 2021] PUT /identity/v3/projects/81796dbc1e4f4d29bf03d5ac71625c80/users/4e165a6ed594480cb8b3ca0b2742b1cb/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:15:20.542403 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ace388-2814-40f1-899b-adfe13ec1c8a admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:20.552353 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ace388-2814-40f1-899b-adfe13ec1c8a admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:20.620995 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acac23d-77d6-4ea6-9906-067c9c90774f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:20.621548 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acac23d-77d6-4ea6-9906-067c9c90774f admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:20.621834 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acac23d-77d6-4ea6-9906-067c9c90774f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:20.622116 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acac23d-77d6-4ea6-9906-067c9c90774f admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:20.622824 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acac23d-77d6-4ea6-9906-067c9c90774f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:20.649439 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acac23d-77d6-4ea6-9906-067c9c90774f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:20.663052 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1345/2692] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:15:20 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:15:20.664258 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac71887-0797-45e6-a6da-6ad25319dccf admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:20.673982 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac71887-0797-45e6-a6da-6ad25319dccf admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:20.678081 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a2c4e-230f-4c14-8287-2d2f529541eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:20.679653 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a2c4e-230f-4c14-8287-2d2f529541eb admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:20.679653 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a2c4e-230f-4c14-8287-2d2f529541eb admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:20.679903 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a2c4e-230f-4c14-8287-2d2f529541eb admin admin] PATH_INFO: `/v3/projects/81796dbc1e4f4d29bf03d5ac71625c80/users/4e165a6ed594480cb8b3ca0b2742b1cb/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:20.681733 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a2c4e-230f-4c14-8287-2d2f529541eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=81796dbc1e4f4d29bf03d5ac71625c80, user_id=4e165a6ed594480cb8b3ca0b2742b1cb, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:20.709710 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a2c4e-230f-4c14-8287-2d2f529541eb admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:20.720522 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1348/2693] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:15:20 2021] PUT /identity/v3/projects/81796dbc1e4f4d29bf03d5ac71625c80/users/4e165a6ed594480cb8b3ca0b2742b1cb/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:15:20.724575 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acac23d-77d6-4ea6-9906-067c9c90774f admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:20.734644 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acac23d-77d6-4ea6-9906-067c9c90774f admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:20.802808 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e07cfbc-66af-45ed-bd85-cd01d3eda8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:20.803413 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07cfbc-66af-45ed-bd85-cd01d3eda8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:20.803725 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07cfbc-66af-45ed-bd85-cd01d3eda8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:20.803999 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e07cfbc-66af-45ed-bd85-cd01d3eda8d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:20.804688 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e07cfbc-66af-45ed-bd85-cd01d3eda8d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:20.831218 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e07cfbc-66af-45ed-bd85-cd01d3eda8d0 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:20.841890 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1346/2694] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:15:20 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:15:20.846198 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a2c4e-230f-4c14-8287-2d2f529541eb admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:20.856127 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a2c4e-230f-4c14-8287-2d2f529541eb admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:20.860496 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828485aa-600d-4fbf-a505-28f795a34916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:20.861434 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828485aa-600d-4fbf-a505-28f795a34916 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:20.861779 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828485aa-600d-4fbf-a505-28f795a34916 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:20.862187 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828485aa-600d-4fbf-a505-28f795a34916 admin admin] PATH_INFO: `/v3/projects/81796dbc1e4f4d29bf03d5ac71625c80/users/4e165a6ed594480cb8b3ca0b2742b1cb/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:20.864019 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828485aa-600d-4fbf-a505-28f795a34916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81796dbc1e4f4d29bf03d5ac71625c80, user_id=4e165a6ed594480cb8b3ca0b2742b1cb, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:20.890925 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828485aa-600d-4fbf-a505-28f795a34916 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:20.908527 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1349/2695] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:15:20 2021] PUT /identity/v3/projects/81796dbc1e4f4d29bf03d5ac71625c80/users/4e165a6ed594480cb8b3ca0b2742b1cb/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:15:20.918947 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad099f-c9f6-4449-9a14-e94c16ca6758 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:20.919243 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad099f-c9f6-4449-9a14-e94c16ca6758 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:20.919657 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad099f-c9f6-4449-9a14-e94c16ca6758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:20.962501 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-7cad099f-c9f6-4449-9a14-e94c16ca6758 None None] MFA Rules not processed for user `4e165a6ed594480cb8b3ca0b2742b1cb`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:15:20.963764 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-7cad099f-c9f6-4449-9a14-e94c16ca6758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:21.049996 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1347/2696] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:15:20 2021] POST /identity/v3/auth/tokens => generated 3739 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:15:21.062329 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828485aa-600d-4fbf-a505-28f795a34916 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:21.064681 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-828485aa-600d-4fbf-a505-28f795a34916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:21.132578 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828485aa-600d-4fbf-a505-28f795a34916 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:21.136595 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ad3be-26ae-4ed7-8176-a3dc473b7327 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:21.136595 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ad3be-26ae-4ed7-8176-a3dc473b7327 service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:21.136874 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ad3be-26ae-4ed7-8176-a3dc473b7327 service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:21.137028 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ad3be-26ae-4ed7-8176-a3dc473b7327 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:21.146634 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ad3be-26ae-4ed7-8176-a3dc473b7327 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:21.171765 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ad3be-26ae-4ed7-8176-a3dc473b7327 service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:21.182379 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1350/2697] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:15:21 2021] GET /identity/v3/auth/tokens => generated 3739 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:15:21.287387 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad099f-c9f6-4449-9a14-e94c16ca6758 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:21.297643 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad099f-c9f6-4449-9a14-e94c16ca6758 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:21.303261 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994fd97-de63-45fe-ade4-8a045d94c711 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:21.303939 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994fd97-de63-45fe-ade4-8a045d94c711 service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:21.304223 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994fd97-de63-45fe-ade4-8a045d94c711 service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:21.304500 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994fd97-de63-45fe-ade4-8a045d94c711 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:21.374796 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994fd97-de63-45fe-ade4-8a045d94c711 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:21.399765 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4994fd97-de63-45fe-ade4-8a045d94c711 service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:21.409656 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1348/2698] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:15:21 2021] GET /identity/v3/auth/tokens => generated 3670 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:15:24.123941 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ad3be-26ae-4ed7-8176-a3dc473b7327 service cinder] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:24.126118 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-ee5ad3be-26ae-4ed7-8176-a3dc473b7327 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:24.194572 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ad3be-26ae-4ed7-8176-a3dc473b7327 service cinder] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:24.198997 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143aac15-4d88-468b-8159-f36616a3a84c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:24.199618 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143aac15-4d88-468b-8159-f36616a3a84c service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:24.199903 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143aac15-4d88-468b-8159-f36616a3a84c service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:24.200174 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143aac15-4d88-468b-8159-f36616a3a84c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:24.201876 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-143aac15-4d88-468b-8159-f36616a3a84c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:24.295974 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143aac15-4d88-468b-8159-f36616a3a84c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:24.314804 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994fd97-de63-45fe-ade4-8a045d94c711 service cinder] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:24.322260 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143aac15-4d88-468b-8159-f36616a3a84c service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:24.334483 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1351/2699] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:15:24 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:15:24.394952 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4994fd97-de63-45fe-ade4-8a045d94c711 service cinder] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:24.399494 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84bff3-4b90-4cc2-b778-0819ef621095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:24.400314 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84bff3-4b90-4cc2-b778-0819ef621095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:24.400594 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84bff3-4b90-4cc2-b778-0819ef621095 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:24.400867 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84bff3-4b90-4cc2-b778-0819ef621095 admin admin] PATH_INFO: `/v3/users/cba8d422aa42437fafa1cac586e4313a` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:24.401973 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84bff3-4b90-4cc2-b778-0819ef621095 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cba8d422aa42437fafa1cac586e4313a)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:24.428720 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd84bff3-4b90-4cc2-b778-0819ef621095 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:24.484318 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-cd84bff3-4b90-4cc2-b778-0819ef621095 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cba8d422aa42437fafa1cac586e4313a'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:24.499462 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-cd84bff3-4b90-4cc2-b778-0819ef621095 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cba8d422aa42437fafa1cac586e4313a'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:24.500207 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-cd84bff3-4b90-4cc2-b778-0819ef621095 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cba8d422aa42437fafa1cac586e4313a'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:24.507815 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-cd84bff3-4b90-4cc2-b778-0819ef621095 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cba8d422aa42437fafa1cac586e4313a'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:24.517340 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-cd84bff3-4b90-4cc2-b778-0819ef621095 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cba8d422aa42437fafa1cac586e4313a'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:24.523396 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1349/2700] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:15:24 2021] DELETE /identity/v3/users/cba8d422aa42437fafa1cac586e4313a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:15:24.528212 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f13575-3ac3-421f-a4fd-614b69a4fbde None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:24.528501 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f13575-3ac3-421f-a4fd-614b69a4fbde None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:24.528782 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f13575-3ac3-421f-a4fd-614b69a4fbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:24.555017 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-32f13575-3ac3-421f-a4fd-614b69a4fbde None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:15:24.556315 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-32f13575-3ac3-421f-a4fd-614b69a4fbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:24.622635 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1352/2701] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:15:24 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:15:24.633047 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84bff3-4b90-4cc2-b778-0819ef621095 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:24.634393 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-cd84bff3-4b90-4cc2-b778-0819ef621095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:24.701256 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd84bff3-4b90-4cc2-b778-0819ef621095 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:24.705161 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e7439-2735-4570-99ae-8d8400c4433d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:24.705745 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e7439-2735-4570-99ae-8d8400c4433d service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:24.706028 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e7439-2735-4570-99ae-8d8400c4433d service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:24.706305 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e7439-2735-4570-99ae-8d8400c4433d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:24.720727 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e7439-2735-4570-99ae-8d8400c4433d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:24.746170 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e7439-2735-4570-99ae-8d8400c4433d service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:24.755866 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1350/2702] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:15:24 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:15:25.130099 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f13575-3ac3-421f-a4fd-614b69a4fbde None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:25.131669 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-32f13575-3ac3-421f-a4fd-614b69a4fbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:25.144618 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f13575-3ac3-421f-a4fd-614b69a4fbde None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:25.149510 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad80fe-b0fb-4b12-815c-e289eb378df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:25.150281 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad80fe-b0fb-4b12-815c-e289eb378df4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:25.150569 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad80fe-b0fb-4b12-815c-e289eb378df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:25.150901 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad80fe-b0fb-4b12-815c-e289eb378df4 admin admin] PATH_INFO: `/v3/projects/3b1f8565c6f447aba8e55d174e5b1b46` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:25.151969 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad80fe-b0fb-4b12-815c-e289eb378df4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b1f8565c6f447aba8e55d174e5b1b46)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:25.178197 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad80fe-b0fb-4b12-815c-e289eb378df4 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:25.232567 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-dfad80fe-b0fb-4b12-815c-e289eb378df4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b1f8565c6f447aba8e55d174e5b1b46', 'request_id': 'req-dfad80fe-b0fb-4b12-815c-e289eb378df4'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:25.237744 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-dfad80fe-b0fb-4b12-815c-e289eb378df4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b1f8565c6f447aba8e55d174e5b1b46', 'request_id': 'req-dfad80fe-b0fb-4b12-815c-e289eb378df4'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:25.249100 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-dfad80fe-b0fb-4b12-815c-e289eb378df4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b1f8565c6f447aba8e55d174e5b1b46', 'request_id': 'req-dfad80fe-b0fb-4b12-815c-e289eb378df4'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:25.263608 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-dfad80fe-b0fb-4b12-815c-e289eb378df4 admin admin] The token cache is being invalidate because project 3b1f8565c6f447aba8e55d174e5b1b46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:15:25.264151 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-dfad80fe-b0fb-4b12-815c-e289eb378df4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:25.264821 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-dfad80fe-b0fb-4b12-815c-e289eb378df4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:25.266289 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1353/2703] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:15:25 2021] DELETE /identity/v3/projects/3b1f8565c6f447aba8e55d174e5b1b46 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:15:25.271071 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e7439-2735-4570-99ae-8d8400c4433d service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:25.281151 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e7439-2735-4570-99ae-8d8400c4433d service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:25.362547 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1c4661-0793-4924-ac33-8cb1825e0382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:25.363362 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c4661-0793-4924-ac33-8cb1825e0382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:25.363676 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c4661-0793-4924-ac33-8cb1825e0382 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:25.363957 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1c4661-0793-4924-ac33-8cb1825e0382 admin admin] PATH_INFO: `/v3/users/4e165a6ed594480cb8b3ca0b2742b1cb` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:25.365057 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c4661-0793-4924-ac33-8cb1825e0382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e165a6ed594480cb8b3ca0b2742b1cb)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:25.391106 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1c4661-0793-4924-ac33-8cb1825e0382 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:25.442287 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-2b1c4661-0793-4924-ac33-8cb1825e0382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e165a6ed594480cb8b3ca0b2742b1cb'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:25.453790 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-2b1c4661-0793-4924-ac33-8cb1825e0382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e165a6ed594480cb8b3ca0b2742b1cb'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:25.455187 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-2b1c4661-0793-4924-ac33-8cb1825e0382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e165a6ed594480cb8b3ca0b2742b1cb'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:25.462876 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-2b1c4661-0793-4924-ac33-8cb1825e0382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e165a6ed594480cb8b3ca0b2742b1cb'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:25.471930 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-2b1c4661-0793-4924-ac33-8cb1825e0382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e165a6ed594480cb8b3ca0b2742b1cb'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:25.478031 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1351/2704] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:15:25 2021] DELETE /identity/v3/users/4e165a6ed594480cb8b3ca0b2742b1cb => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:15:25.864345 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad80fe-b0fb-4b12-815c-e289eb378df4 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:25.865775 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-dfad80fe-b0fb-4b12-815c-e289eb378df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:25.878085 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad80fe-b0fb-4b12-815c-e289eb378df4 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:25.945702 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf9c939-cd9e-41e8-b2ca-6ff212f6fb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:25.946494 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9c939-cd9e-41e8-b2ca-6ff212f6fb07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:25.946781 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9c939-cd9e-41e8-b2ca-6ff212f6fb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:25.947059 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf9c939-cd9e-41e8-b2ca-6ff212f6fb07 admin admin] PATH_INFO: `/v3/projects/81796dbc1e4f4d29bf03d5ac71625c80` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:25.948164 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9c939-cd9e-41e8-b2ca-6ff212f6fb07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81796dbc1e4f4d29bf03d5ac71625c80)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:25.974449 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf9c939-cd9e-41e8-b2ca-6ff212f6fb07 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:26.026271 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-abf9c939-cd9e-41e8-b2ca-6ff212f6fb07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81796dbc1e4f4d29bf03d5ac71625c80', 'request_id': 'req-abf9c939-cd9e-41e8-b2ca-6ff212f6fb07'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:26.031346 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-abf9c939-cd9e-41e8-b2ca-6ff212f6fb07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81796dbc1e4f4d29bf03d5ac71625c80', 'request_id': 'req-abf9c939-cd9e-41e8-b2ca-6ff212f6fb07'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:26.043661 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-abf9c939-cd9e-41e8-b2ca-6ff212f6fb07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81796dbc1e4f4d29bf03d5ac71625c80', 'request_id': 'req-abf9c939-cd9e-41e8-b2ca-6ff212f6fb07'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:26.056610 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-abf9c939-cd9e-41e8-b2ca-6ff212f6fb07 admin admin] The token cache is being invalidate because project 81796dbc1e4f4d29bf03d5ac71625c80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:15:26.056896 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-abf9c939-cd9e-41e8-b2ca-6ff212f6fb07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:26.057492 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-abf9c939-cd9e-41e8-b2ca-6ff212f6fb07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:26.058908 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1354/2705] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:15:25 2021] DELETE /identity/v3/projects/81796dbc1e4f4d29bf03d5ac71625c80 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:15:26.064920 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88713c-087c-44f3-a492-3e4775e1b88c None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:26.065260 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88713c-087c-44f3-a492-3e4775e1b88c None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:26.065565 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e88713c-087c-44f3-a492-3e4775e1b88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:26.088214 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-0e88713c-087c-44f3-a492-3e4775e1b88c None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:15:26.089373 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-0e88713c-087c-44f3-a492-3e4775e1b88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:26.161004 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1352/2706] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:15:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:15:26.170432 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd1986-16ac-4939-93cc-f0147db29d19 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:26.171023 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd1986-16ac-4939-93cc-f0147db29d19 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:26.171130 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd1986-16ac-4939-93cc-f0147db29d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:26.194565 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-81bd1986-16ac-4939-93cc-f0147db29d19 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:15:26.195973 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-81bd1986-16ac-4939-93cc-f0147db29d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:26.203070 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1355/2707] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:15:26 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:15:26.207907 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88713c-087c-44f3-a492-3e4775e1b88c None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:26.219108 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e88713c-087c-44f3-a492-3e4775e1b88c None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:26.222679 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb0b66-3be5-457a-82a8-e0363fdd7e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:26.223295 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb0b66-3be5-457a-82a8-e0363fdd7e8e admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:26.223633 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb0b66-3be5-457a-82a8-e0363fdd7e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:26.223917 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb0b66-3be5-457a-82a8-e0363fdd7e8e admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:26.224615 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb0b66-3be5-457a-82a8-e0363fdd7e8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:15:26.224916 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb0b66-3be5-457a-82a8-e0363fdd7e8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:26.250648 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fb0b66-3be5-457a-82a8-e0363fdd7e8e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:26.264547 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1353/2708] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:15:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:15:26.269441 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd1986-16ac-4939-93cc-f0147db29d19 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:26.279269 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd1986-16ac-4939-93cc-f0147db29d19 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:26.284762 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f65c2-c705-4cfa-9a72-19ccdc58332a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:26.285298 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f65c2-c705-4cfa-9a72-19ccdc58332a admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:26.285593 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f65c2-c705-4cfa-9a72-19ccdc58332a admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:26.285865 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f65c2-c705-4cfa-9a72-19ccdc58332a admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:26.286518 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f65c2-c705-4cfa-9a72-19ccdc58332a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:26.312006 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f65c2-c705-4cfa-9a72-19ccdc58332a admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:26.345788 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1356/2709] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:15:26 2021] POST /identity/v3/projects => generated 387 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:15:26.347180 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb0b66-3be5-457a-82a8-e0363fdd7e8e admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:26.356733 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb0b66-3be5-457a-82a8-e0363fdd7e8e admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:26.421108 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453c040-b65a-43f4-ab4a-53e98ad7f3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:26.421816 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453c040-b65a-43f4-ab4a-53e98ad7f3ff admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:26.421971 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453c040-b65a-43f4-ab4a-53e98ad7f3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:26.422251 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453c040-b65a-43f4-ab4a-53e98ad7f3ff admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:26.422929 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453c040-b65a-43f4-ab4a-53e98ad7f3ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:26.448150 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453c040-b65a-43f4-ab4a-53e98ad7f3ff admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:26.470516 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1354/2710] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:15:26 2021] POST /identity/v3/users => generated 294 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:15:26.473116 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f65c2-c705-4cfa-9a72-19ccdc58332a admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:26.482924 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f65c2-c705-4cfa-9a72-19ccdc58332a admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:26.487254 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6232d566-76e5-4b19-ad6f-c192c7820af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:26.487895 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232d566-76e5-4b19-ad6f-c192c7820af5 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:26.488179 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232d566-76e5-4b19-ad6f-c192c7820af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:26.488454 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6232d566-76e5-4b19-ad6f-c192c7820af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:26.489177 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232d566-76e5-4b19-ad6f-c192c7820af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:26.514665 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6232d566-76e5-4b19-ad6f-c192c7820af5 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:26.527123 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1357/2711] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:15:26 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:15:26.531765 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453c040-b65a-43f4-ab4a-53e98ad7f3ff admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:26.542361 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453c040-b65a-43f4-ab4a-53e98ad7f3ff admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:26.548378 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce330ed3-a208-4b7b-adfd-09b50162aa32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:26.548378 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce330ed3-a208-4b7b-adfd-09b50162aa32 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:26.548631 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce330ed3-a208-4b7b-adfd-09b50162aa32 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:26.548815 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce330ed3-a208-4b7b-adfd-09b50162aa32 admin admin] PATH_INFO: `/v3/projects/477fb136976647db9239976d5c3f8bf9/users/3032d79b070f4b78a7a2c2fcaf607235/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:26.569886 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce330ed3-a208-4b7b-adfd-09b50162aa32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=477fb136976647db9239976d5c3f8bf9, user_id=3032d79b070f4b78a7a2c2fcaf607235, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:26.597524 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce330ed3-a208-4b7b-adfd-09b50162aa32 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:26.611973 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1355/2712] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:15:26 2021] PUT /identity/v3/projects/477fb136976647db9239976d5c3f8bf9/users/3032d79b070f4b78a7a2c2fcaf607235/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:15:26.622217 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fad287-5621-4127-ad42-05724abfa61c None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:26.622505 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fad287-5621-4127-ad42-05724abfa61c None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:26.622802 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fad287-5621-4127-ad42-05724abfa61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:26.661950 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-32fad287-5621-4127-ad42-05724abfa61c None None] MFA Rules not processed for user `3032d79b070f4b78a7a2c2fcaf607235`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:15:26.663097 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-32fad287-5621-4127-ad42-05724abfa61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:26.734443 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1358/2713] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:15:26 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:15:26.739804 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce330ed3-a208-4b7b-adfd-09b50162aa32 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:26.812987 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce330ed3-a208-4b7b-adfd-09b50162aa32 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:26.817839 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8d89f-71fc-472a-8af0-b12b474a2600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:26.818439 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8d89f-71fc-472a-8af0-b12b474a2600 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:26.818730 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8d89f-71fc-472a-8af0-b12b474a2600 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:26.819011 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f8d89f-71fc-472a-8af0-b12b474a2600 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:26.819694 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8d89f-71fc-472a-8af0-b12b474a2600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:26.845676 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f8d89f-71fc-472a-8af0-b12b474a2600 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:26.876559 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1356/2714] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:15:26 2021] POST /identity/v3/projects => generated 387 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:15:26.880722 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fad287-5621-4127-ad42-05724abfa61c None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:26.891094 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fad287-5621-4127-ad42-05724abfa61c None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:26.960381 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacffa2e-a156-4a75-8fd5-f864caff87a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:26.961152 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacffa2e-a156-4a75-8fd5-f864caff87a5 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:26.961553 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacffa2e-a156-4a75-8fd5-f864caff87a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:26.961922 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacffa2e-a156-4a75-8fd5-f864caff87a5 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:26.962682 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacffa2e-a156-4a75-8fd5-f864caff87a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:26.990088 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacffa2e-a156-4a75-8fd5-f864caff87a5 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:27.015475 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1359/2715] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:15:26 2021] POST /identity/v3/users => generated 294 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:15:27.017222 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8d89f-71fc-472a-8af0-b12b474a2600 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:27.027355 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f8d89f-71fc-472a-8af0-b12b474a2600 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:27.031722 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90307579-b7c8-469c-9f77-8cff73cc9327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:27.032878 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90307579-b7c8-469c-9f77-8cff73cc9327 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:27.033226 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90307579-b7c8-469c-9f77-8cff73cc9327 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:27.033493 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90307579-b7c8-469c-9f77-8cff73cc9327 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:27.034239 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90307579-b7c8-469c-9f77-8cff73cc9327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:27.059297 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90307579-b7c8-469c-9f77-8cff73cc9327 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:27.070948 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1357/2716] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:15:27 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:15:27.075082 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacffa2e-a156-4a75-8fd5-f864caff87a5 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:27.086647 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacffa2e-a156-4a75-8fd5-f864caff87a5 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:27.091068 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c64d0-770b-4a1d-973a-c2125dfc2a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:27.091922 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c64d0-770b-4a1d-973a-c2125dfc2a37 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:27.092205 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c64d0-770b-4a1d-973a-c2125dfc2a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:27.092482 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c64d0-770b-4a1d-973a-c2125dfc2a37 admin admin] PATH_INFO: `/v3/projects/d991c89ae5ea4e2daff1d3cc6d64ea14/users/61076261140a478a9d33dc4c9757f086/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:27.113654 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c64d0-770b-4a1d-973a-c2125dfc2a37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d991c89ae5ea4e2daff1d3cc6d64ea14, user_id=61076261140a478a9d33dc4c9757f086, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:27.140368 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c64d0-770b-4a1d-973a-c2125dfc2a37 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:27.154694 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1360/2717] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:15:27 2021] PUT /identity/v3/projects/d991c89ae5ea4e2daff1d3cc6d64ea14/users/61076261140a478a9d33dc4c9757f086/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:15:27.165560 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8fd2f-69c8-48e0-80ea-1adeda7dd7f6 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:27.165856 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8fd2f-69c8-48e0-80ea-1adeda7dd7f6 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:27.166140 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8fd2f-69c8-48e0-80ea-1adeda7dd7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:27.207106 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-f3a8fd2f-69c8-48e0-80ea-1adeda7dd7f6 None None] MFA Rules not processed for user `61076261140a478a9d33dc4c9757f086`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:15:27.208315 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-f3a8fd2f-69c8-48e0-80ea-1adeda7dd7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:27.285834 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1358/2718] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:15:27 2021] POST /identity/v3/auth/tokens => generated 3694 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:15:27.290311 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c64d0-770b-4a1d-973a-c2125dfc2a37 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:27.363026 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c64d0-770b-4a1d-973a-c2125dfc2a37 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:27.367284 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92907e-f79e-4db7-ad34-fb8f82796538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:27.367911 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92907e-f79e-4db7-ad34-fb8f82796538 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:27.368197 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92907e-f79e-4db7-ad34-fb8f82796538 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:27.368473 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92907e-f79e-4db7-ad34-fb8f82796538 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:27.369102 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92907e-f79e-4db7-ad34-fb8f82796538 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:27.395298 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f92907e-f79e-4db7-ad34-fb8f82796538 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:27.421699 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1361/2719] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:15:27 2021] POST /identity/v3/projects => generated 387 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:15:27.425848 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8fd2f-69c8-48e0-80ea-1adeda7dd7f6 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:27.436320 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8fd2f-69c8-48e0-80ea-1adeda7dd7f6 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:27.499600 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8b6c8-84e0-4d3e-848a-af7a2980c98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:27.500210 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8b6c8-84e0-4d3e-848a-af7a2980c98d admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:27.500498 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8b6c8-84e0-4d3e-848a-af7a2980c98d admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:27.500781 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8b6c8-84e0-4d3e-848a-af7a2980c98d admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:27.501937 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d8b6c8-84e0-4d3e-848a-af7a2980c98d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:27.528827 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d8b6c8-84e0-4d3e-848a-af7a2980c98d admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:27.548806 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1359/2720] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:15:27 2021] POST /identity/v3/users => generated 300 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:15:27.552843 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92907e-f79e-4db7-ad34-fb8f82796538 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:27.562798 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f92907e-f79e-4db7-ad34-fb8f82796538 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:27.567539 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816b4be-0878-4f91-bcd9-b5ef40f508f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:27.568139 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816b4be-0878-4f91-bcd9-b5ef40f508f1 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:27.568426 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816b4be-0878-4f91-bcd9-b5ef40f508f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:27.568706 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816b4be-0878-4f91-bcd9-b5ef40f508f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:27.569398 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816b4be-0878-4f91-bcd9-b5ef40f508f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:27.594929 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816b4be-0878-4f91-bcd9-b5ef40f508f1 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:27.606600 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1362/2721] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:15:27 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:15:27.610790 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8b6c8-84e0-4d3e-848a-af7a2980c98d admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:27.621195 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8b6c8-84e0-4d3e-848a-af7a2980c98d admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:27.625356 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e38b58-0a99-4787-8bfc-f29adfb33406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:27.626726 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e38b58-0a99-4787-8bfc-f29adfb33406 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:27.627122 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e38b58-0a99-4787-8bfc-f29adfb33406 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:27.627425 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e38b58-0a99-4787-8bfc-f29adfb33406 admin admin] PATH_INFO: `/v3/projects/a4718a1e56ce4ea0987d1ce190e44544/users/50cb4097edaf42a3a6676efb17ef0d6f/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:27.649467 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e38b58-0a99-4787-8bfc-f29adfb33406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4718a1e56ce4ea0987d1ce190e44544, user_id=50cb4097edaf42a3a6676efb17ef0d6f, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:27.681241 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e38b58-0a99-4787-8bfc-f29adfb33406 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:27.695238 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1360/2722] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:15:27 2021] PUT /identity/v3/projects/a4718a1e56ce4ea0987d1ce190e44544/users/50cb4097edaf42a3a6676efb17ef0d6f/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:15:27.699388 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816b4be-0878-4f91-bcd9-b5ef40f508f1 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:27.709554 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816b4be-0878-4f91-bcd9-b5ef40f508f1 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:27.773103 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ed8b8-6d43-4fe0-9582-1bcbbba44515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:27.773719 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ed8b8-6d43-4fe0-9582-1bcbbba44515 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:27.774151 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ed8b8-6d43-4fe0-9582-1bcbbba44515 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:27.774426 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ed8b8-6d43-4fe0-9582-1bcbbba44515 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:27.775123 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ed8b8-6d43-4fe0-9582-1bcbbba44515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:27.800898 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ed8b8-6d43-4fe0-9582-1bcbbba44515 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:27.811768 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1363/2723] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:15:27 2021] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:15:27.816696 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e38b58-0a99-4787-8bfc-f29adfb33406 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:27.826926 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e38b58-0a99-4787-8bfc-f29adfb33406 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:27.831421 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ccb6d-f9e9-4ede-bad7-616ce062b93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:27.832316 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ccb6d-f9e9-4ede-bad7-616ce062b93f admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:27.832577 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ccb6d-f9e9-4ede-bad7-616ce062b93f admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:27.832854 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ccb6d-f9e9-4ede-bad7-616ce062b93f admin admin] PATH_INFO: `/v3/projects/a4718a1e56ce4ea0987d1ce190e44544/users/50cb4097edaf42a3a6676efb17ef0d6f/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:27.834610 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ccb6d-f9e9-4ede-bad7-616ce062b93f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4718a1e56ce4ea0987d1ce190e44544, user_id=50cb4097edaf42a3a6676efb17ef0d6f, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:27.861591 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ccb6d-f9e9-4ede-bad7-616ce062b93f admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:27.873238 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1361/2724] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:15:27 2021] PUT /identity/v3/projects/a4718a1e56ce4ea0987d1ce190e44544/users/50cb4097edaf42a3a6676efb17ef0d6f/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:15:27.877248 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ed8b8-6d43-4fe0-9582-1bcbbba44515 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:27.887884 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ed8b8-6d43-4fe0-9582-1bcbbba44515 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:27.956134 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285b9a7-9d2d-4a27-8f6e-ea01ee365aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:27.956741 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285b9a7-9d2d-4a27-8f6e-ea01ee365aef admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:27.957028 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285b9a7-9d2d-4a27-8f6e-ea01ee365aef admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:27.957309 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285b9a7-9d2d-4a27-8f6e-ea01ee365aef admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:27.958004 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285b9a7-9d2d-4a27-8f6e-ea01ee365aef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:27.983340 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5285b9a7-9d2d-4a27-8f6e-ea01ee365aef admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:27.995259 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1364/2725] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:15:27 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:15:27.999782 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ccb6d-f9e9-4ede-bad7-616ce062b93f admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:28.010410 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ccb6d-f9e9-4ede-bad7-616ce062b93f admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:28.014629 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdcb9f9-429d-4feb-b471-324375d4b35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:28.015511 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdcb9f9-429d-4feb-b471-324375d4b35c admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:28.015796 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdcb9f9-429d-4feb-b471-324375d4b35c admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:28.016070 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdcb9f9-429d-4feb-b471-324375d4b35c admin admin] PATH_INFO: `/v3/projects/a4718a1e56ce4ea0987d1ce190e44544/users/50cb4097edaf42a3a6676efb17ef0d6f/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:28.017919 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdcb9f9-429d-4feb-b471-324375d4b35c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4718a1e56ce4ea0987d1ce190e44544, user_id=50cb4097edaf42a3a6676efb17ef0d6f, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:28.045972 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdcb9f9-429d-4feb-b471-324375d4b35c admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:28.129361 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285b9a7-9d2d-4a27-8f6e-ea01ee365aef admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:28.131078 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-5285b9a7-9d2d-4a27-8f6e-ea01ee365aef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:28.145025 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1362/2726] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:15:27 2021] PUT /identity/v3/projects/a4718a1e56ce4ea0987d1ce190e44544/users/50cb4097edaf42a3a6676efb17ef0d6f/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:15:28.158130 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d64f64-9765-4830-8e11-560c572e4a27 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:28.158830 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d64f64-9765-4830-8e11-560c572e4a27 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:28.159671 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d64f64-9765-4830-8e11-560c572e4a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:28.204223 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-e6d64f64-9765-4830-8e11-560c572e4a27 None None] MFA Rules not processed for user `50cb4097edaf42a3a6676efb17ef0d6f`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:15:28.205055 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-e6d64f64-9765-4830-8e11-560c572e4a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:28.205292 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285b9a7-9d2d-4a27-8f6e-ea01ee365aef admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:28.284918 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907742c9-180a-41be-9601-f36754451474 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:28.293929 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907742c9-180a-41be-9601-f36754451474 service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:28.294627 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907742c9-180a-41be-9601-f36754451474 service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:28.294846 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907742c9-180a-41be-9601-f36754451474 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:28.300252 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-907742c9-180a-41be-9601-f36754451474 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:28.320584 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1363/2727] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:15:28 2021] POST /identity/v3/auth/tokens => generated 3761 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:15:28.327668 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d64f64-9765-4830-8e11-560c572e4a27 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:28.332205 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-e6d64f64-9765-4830-8e11-560c572e4a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:28.400437 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907742c9-180a-41be-9601-f36754451474 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:28.403738 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d64f64-9765-4830-8e11-560c572e4a27 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:28.407713 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da04a2-93e6-4b97-8fc3-a01752e925c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:28.408305 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da04a2-93e6-4b97-8fc3-a01752e925c6 service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:28.408594 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da04a2-93e6-4b97-8fc3-a01752e925c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:28.408870 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da04a2-93e6-4b97-8fc3-a01752e925c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:28.419067 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da04a2-93e6-4b97-8fc3-a01752e925c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:28.426662 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907742c9-180a-41be-9601-f36754451474 service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:28.438014 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1365/2728] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:15:28 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:15:28.445015 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da04a2-93e6-4b97-8fc3-a01752e925c6 service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:28.455830 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1364/2729] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:15:28 2021] GET /identity/v3/auth/tokens => generated 3761 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:15:29.039078 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907742c9-180a-41be-9601-f36754451474 service neutron] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:29.040409 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-907742c9-180a-41be-9601-f36754451474 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:29.051351 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907742c9-180a-41be-9601-f36754451474 service neutron] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:29.054698 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8c91a-75cb-41ed-ac7f-2fa5618a5ca2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:29.055275 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8c91a-75cb-41ed-ac7f-2fa5618a5ca2 service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:29.055593 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8c91a-75cb-41ed-ac7f-2fa5618a5ca2 service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:29.055874 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8c91a-75cb-41ed-ac7f-2fa5618a5ca2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:29.120749 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8c91a-75cb-41ed-ac7f-2fa5618a5ca2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:29.147021 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8c91a-75cb-41ed-ac7f-2fa5618a5ca2 service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:29.156698 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1366/2730] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:15:29 2021] GET /identity/v3/auth/tokens => generated 3694 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:15:32.659821 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da04a2-93e6-4b97-8fc3-a01752e925c6 service cinder] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:32.669781 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da04a2-93e6-4b97-8fc3-a01752e925c6 service cinder] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:32.673804 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c1268-1ce2-49b6-aef6-d6b31765681e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:32.674503 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c1268-1ce2-49b6-aef6-d6b31765681e service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:32.674787 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c1268-1ce2-49b6-aef6-d6b31765681e service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:32.675064 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c1268-1ce2-49b6-aef6-d6b31765681e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:32.677190 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-552c1268-1ce2-49b6-aef6-d6b31765681e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:32.748485 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c1268-1ce2-49b6-aef6-d6b31765681e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:32.773696 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c1268-1ce2-49b6-aef6-d6b31765681e service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:32.784376 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1365/2731] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:15:32 2021] GET /identity/v3/auth/tokens => generated 3751 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:15:33.769491 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8c91a-75cb-41ed-ac7f-2fa5618a5ca2 service cinder] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:33.778672 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8c91a-75cb-41ed-ac7f-2fa5618a5ca2 service cinder] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:33.783087 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a9a76d-937f-45f2-808d-6365cd8a391a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:33.783908 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9a76d-937f-45f2-808d-6365cd8a391a service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:33.784195 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9a76d-937f-45f2-808d-6365cd8a391a service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:33.784470 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a9a76d-937f-45f2-808d-6365cd8a391a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:33.850815 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9a76d-937f-45f2-808d-6365cd8a391a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:33.875809 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a9a76d-937f-45f2-808d-6365cd8a391a service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:33.885643 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1367/2732] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:15:33 2021] GET /identity/v3/auth/tokens => generated 3694 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:15:36.549434 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c1268-1ce2-49b6-aef6-d6b31765681e service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:36.623032 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c1268-1ce2-49b6-aef6-d6b31765681e service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:36.628332 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71411b0-ca19-4130-bfde-4271b362bb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:36.629214 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71411b0-ca19-4130-bfde-4271b362bb3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:36.629500 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71411b0-ca19-4130-bfde-4271b362bb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:36.629776 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71411b0-ca19-4130-bfde-4271b362bb3d admin admin] PATH_INFO: `/v3/users/3032d79b070f4b78a7a2c2fcaf607235` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:36.631647 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71411b0-ca19-4130-bfde-4271b362bb3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3032d79b070f4b78a7a2c2fcaf607235)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:36.659189 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71411b0-ca19-4130-bfde-4271b362bb3d admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:36.714063 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-b71411b0-ca19-4130-bfde-4271b362bb3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3032d79b070f4b78a7a2c2fcaf607235'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:36.726876 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-b71411b0-ca19-4130-bfde-4271b362bb3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3032d79b070f4b78a7a2c2fcaf607235'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:36.727597 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-b71411b0-ca19-4130-bfde-4271b362bb3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3032d79b070f4b78a7a2c2fcaf607235'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:36.736030 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-b71411b0-ca19-4130-bfde-4271b362bb3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3032d79b070f4b78a7a2c2fcaf607235'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:36.744778 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-b71411b0-ca19-4130-bfde-4271b362bb3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3032d79b070f4b78a7a2c2fcaf607235'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:36.752391 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1366/2733] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:15:36 2021] DELETE /identity/v3/users/3032d79b070f4b78a7a2c2fcaf607235 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:15:36.756968 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534a816-1c0f-4f68-9f7e-fc8ad97df5db None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:36.757505 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534a816-1c0f-4f68-9f7e-fc8ad97df5db None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:36.757651 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534a816-1c0f-4f68-9f7e-fc8ad97df5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:36.782561 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-1534a816-1c0f-4f68-9f7e-fc8ad97df5db None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:15:36.783779 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-1534a816-1c0f-4f68-9f7e-fc8ad97df5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:36.855310 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1368/2734] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:15:36 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:15:36.866794 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71411b0-ca19-4130-bfde-4271b362bb3d admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:36.868172 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-b71411b0-ca19-4130-bfde-4271b362bb3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:36.946427 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71411b0-ca19-4130-bfde-4271b362bb3d admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:36.949907 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c8d7a-96c9-4bdc-8497-4557d7e06fed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:36.950520 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c8d7a-96c9-4bdc-8497-4557d7e06fed service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:36.950798 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c8d7a-96c9-4bdc-8497-4557d7e06fed service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:36.951070 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c8d7a-96c9-4bdc-8497-4557d7e06fed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:36.960601 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c8d7a-96c9-4bdc-8497-4557d7e06fed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:36.985972 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c8d7a-96c9-4bdc-8497-4557d7e06fed service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:37.001652 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1367/2735] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:15:36 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:15:37.392194 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534a816-1c0f-4f68-9f7e-fc8ad97df5db None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:37.393519 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-1534a816-1c0f-4f68-9f7e-fc8ad97df5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:37.406413 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534a816-1c0f-4f68-9f7e-fc8ad97df5db None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:37.413019 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1e726-999b-4e57-8ca3-d6bb326bbf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:37.413808 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1e726-999b-4e57-8ca3-d6bb326bbf06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:37.414114 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1e726-999b-4e57-8ca3-d6bb326bbf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:37.414363 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d1e726-999b-4e57-8ca3-d6bb326bbf06 admin admin] PATH_INFO: `/v3/projects/477fb136976647db9239976d5c3f8bf9` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:37.415453 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1e726-999b-4e57-8ca3-d6bb326bbf06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=477fb136976647db9239976d5c3f8bf9)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:37.441653 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d1e726-999b-4e57-8ca3-d6bb326bbf06 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:37.498995 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-d7d1e726-999b-4e57-8ca3-d6bb326bbf06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '477fb136976647db9239976d5c3f8bf9', 'request_id': 'req-d7d1e726-999b-4e57-8ca3-d6bb326bbf06'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:37.503999 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-d7d1e726-999b-4e57-8ca3-d6bb326bbf06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '477fb136976647db9239976d5c3f8bf9', 'request_id': 'req-d7d1e726-999b-4e57-8ca3-d6bb326bbf06'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:37.515121 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-d7d1e726-999b-4e57-8ca3-d6bb326bbf06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '477fb136976647db9239976d5c3f8bf9', 'request_id': 'req-d7d1e726-999b-4e57-8ca3-d6bb326bbf06'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:37.528535 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-d7d1e726-999b-4e57-8ca3-d6bb326bbf06 admin admin] The token cache is being invalidate because project 477fb136976647db9239976d5c3f8bf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:15:37.528835 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-d7d1e726-999b-4e57-8ca3-d6bb326bbf06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:37.529422 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-d7d1e726-999b-4e57-8ca3-d6bb326bbf06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:37.530943 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1369/2736] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:15:37 2021] DELETE /identity/v3/projects/477fb136976647db9239976d5c3f8bf9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:15:37.535650 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c8d7a-96c9-4bdc-8497-4557d7e06fed service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:37.545282 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c8d7a-96c9-4bdc-8497-4557d7e06fed service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:37.611396 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c964e-df9d-4409-bc03-dfabf772e7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:37.612221 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c964e-df9d-4409-bc03-dfabf772e7eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:37.612504 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c964e-df9d-4409-bc03-dfabf772e7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:37.612780 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c964e-df9d-4409-bc03-dfabf772e7eb admin admin] PATH_INFO: `/v3/users/61076261140a478a9d33dc4c9757f086` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:37.613876 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c964e-df9d-4409-bc03-dfabf772e7eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=61076261140a478a9d33dc4c9757f086)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:37.639618 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c964e-df9d-4409-bc03-dfabf772e7eb admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:37.698981 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-309c964e-df9d-4409-bc03-dfabf772e7eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61076261140a478a9d33dc4c9757f086'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:37.710855 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-309c964e-df9d-4409-bc03-dfabf772e7eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61076261140a478a9d33dc4c9757f086'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:37.711624 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-309c964e-df9d-4409-bc03-dfabf772e7eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61076261140a478a9d33dc4c9757f086'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:37.718929 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-309c964e-df9d-4409-bc03-dfabf772e7eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61076261140a478a9d33dc4c9757f086'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:37.727365 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-309c964e-df9d-4409-bc03-dfabf772e7eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61076261140a478a9d33dc4c9757f086'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:37.733838 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1368/2737] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:15:37 2021] DELETE /identity/v3/users/61076261140a478a9d33dc4c9757f086 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:15:38.112554 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1e726-999b-4e57-8ca3-d6bb326bbf06 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:38.113989 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-d7d1e726-999b-4e57-8ca3-d6bb326bbf06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:38.130429 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d1e726-999b-4e57-8ca3-d6bb326bbf06 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:38.278592 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfddefdd-b623-4c74-bc81-cb41b4efda36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:38.279299 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddefdd-b623-4c74-bc81-cb41b4efda36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:38.279612 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddefdd-b623-4c74-bc81-cb41b4efda36 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:38.279887 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfddefdd-b623-4c74-bc81-cb41b4efda36 admin admin] PATH_INFO: `/v3/projects/d991c89ae5ea4e2daff1d3cc6d64ea14` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:38.280999 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfddefdd-b623-4c74-bc81-cb41b4efda36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d991c89ae5ea4e2daff1d3cc6d64ea14)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:38.307660 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfddefdd-b623-4c74-bc81-cb41b4efda36 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:38.368466 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-cfddefdd-b623-4c74-bc81-cb41b4efda36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd991c89ae5ea4e2daff1d3cc6d64ea14', 'request_id': 'req-cfddefdd-b623-4c74-bc81-cb41b4efda36'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:38.373755 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-cfddefdd-b623-4c74-bc81-cb41b4efda36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd991c89ae5ea4e2daff1d3cc6d64ea14', 'request_id': 'req-cfddefdd-b623-4c74-bc81-cb41b4efda36'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:38.386024 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-cfddefdd-b623-4c74-bc81-cb41b4efda36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd991c89ae5ea4e2daff1d3cc6d64ea14', 'request_id': 'req-cfddefdd-b623-4c74-bc81-cb41b4efda36'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:38.399121 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-cfddefdd-b623-4c74-bc81-cb41b4efda36 admin admin] The token cache is being invalidate because project d991c89ae5ea4e2daff1d3cc6d64ea14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:15:38.399414 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-cfddefdd-b623-4c74-bc81-cb41b4efda36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:38.400065 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-cfddefdd-b623-4c74-bc81-cb41b4efda36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:38.401703 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1370/2738] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:15:38 2021] DELETE /identity/v3/projects/d991c89ae5ea4e2daff1d3cc6d64ea14 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:15:38.405623 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c964e-df9d-4409-bc03-dfabf772e7eb admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:38.406964 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-309c964e-df9d-4409-bc03-dfabf772e7eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:38.421139 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c964e-df9d-4409-bc03-dfabf772e7eb admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:38.488189 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc39217-b16d-4d76-80e3-deb85c62394d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:38.489200 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc39217-b16d-4d76-80e3-deb85c62394d admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:38.489591 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc39217-b16d-4d76-80e3-deb85c62394d admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:38.490054 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc39217-b16d-4d76-80e3-deb85c62394d admin admin] PATH_INFO: `/v3/users/50cb4097edaf42a3a6676efb17ef0d6f` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:38.491339 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc39217-b16d-4d76-80e3-deb85c62394d admin admin] RBAC: Authorizing `identity:delete_user(user_id=50cb4097edaf42a3a6676efb17ef0d6f)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:38.517714 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc39217-b16d-4d76-80e3-deb85c62394d admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:38.574626 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-5dc39217-b16d-4d76-80e3-deb85c62394d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50cb4097edaf42a3a6676efb17ef0d6f'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:38.586349 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-5dc39217-b16d-4d76-80e3-deb85c62394d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50cb4097edaf42a3a6676efb17ef0d6f'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:38.587039 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-5dc39217-b16d-4d76-80e3-deb85c62394d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50cb4097edaf42a3a6676efb17ef0d6f'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:38.595072 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-5dc39217-b16d-4d76-80e3-deb85c62394d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50cb4097edaf42a3a6676efb17ef0d6f'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:38.603197 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-5dc39217-b16d-4d76-80e3-deb85c62394d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50cb4097edaf42a3a6676efb17ef0d6f'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:38.611161 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1369/2739] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:15:38 2021] DELETE /identity/v3/users/50cb4097edaf42a3a6676efb17ef0d6f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:15:38.995161 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfddefdd-b623-4c74-bc81-cb41b4efda36 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:38.997237 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-cfddefdd-b623-4c74-bc81-cb41b4efda36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:39.017059 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfddefdd-b623-4c74-bc81-cb41b4efda36 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:39.084816 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969b3b5-9ff4-4254-beab-4c318bb06101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:39.085655 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969b3b5-9ff4-4254-beab-4c318bb06101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:39.085948 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969b3b5-9ff4-4254-beab-4c318bb06101 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:39.086224 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969b3b5-9ff4-4254-beab-4c318bb06101 admin admin] PATH_INFO: `/v3/projects/a4718a1e56ce4ea0987d1ce190e44544` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:39.087340 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969b3b5-9ff4-4254-beab-4c318bb06101 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4718a1e56ce4ea0987d1ce190e44544)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:39.113486 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969b3b5-9ff4-4254-beab-4c318bb06101 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:39.166233 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-e969b3b5-9ff4-4254-beab-4c318bb06101 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4718a1e56ce4ea0987d1ce190e44544', 'request_id': 'req-e969b3b5-9ff4-4254-beab-4c318bb06101'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:39.171230 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-e969b3b5-9ff4-4254-beab-4c318bb06101 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4718a1e56ce4ea0987d1ce190e44544', 'request_id': 'req-e969b3b5-9ff4-4254-beab-4c318bb06101'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:39.182755 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-e969b3b5-9ff4-4254-beab-4c318bb06101 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4718a1e56ce4ea0987d1ce190e44544', 'request_id': 'req-e969b3b5-9ff4-4254-beab-4c318bb06101'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:39.195923 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-e969b3b5-9ff4-4254-beab-4c318bb06101 admin admin] The token cache is being invalidate because project a4718a1e56ce4ea0987d1ce190e44544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:15:39.196204 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-e969b3b5-9ff4-4254-beab-4c318bb06101 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:39.196795 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-e969b3b5-9ff4-4254-beab-4c318bb06101 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:39.198213 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1371/2740] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:15:38 2021] DELETE /identity/v3/projects/a4718a1e56ce4ea0987d1ce190e44544 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:15:39.205629 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f82ccf-a7d5-464a-8dbd-d81a03c11bd4 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:39.206187 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f82ccf-a7d5-464a-8dbd-d81a03c11bd4 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:39.206187 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f82ccf-a7d5-464a-8dbd-d81a03c11bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:39.229545 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-01f82ccf-a7d5-464a-8dbd-d81a03c11bd4 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:15:39.230798 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-01f82ccf-a7d5-464a-8dbd-d81a03c11bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:39.302854 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1370/2741] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:15:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:15:39.311184 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4af1e-d0c4-4d97-9e2f-250719314f2f None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:39.311484 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4af1e-d0c4-4d97-9e2f-250719314f2f None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:39.311770 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc4af1e-d0c4-4d97-9e2f-250719314f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:39.336693 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-6fc4af1e-d0c4-4d97-9e2f-250719314f2f None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:15:39.337948 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-6fc4af1e-d0c4-4d97-9e2f-250719314f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:39.346283 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1372/2742] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:15:39 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:15:39.350526 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f82ccf-a7d5-464a-8dbd-d81a03c11bd4 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:39.361599 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f82ccf-a7d5-464a-8dbd-d81a03c11bd4 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:39.365759 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac72410-4aa2-4e98-bfdd-37e10c237336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:39.366344 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac72410-4aa2-4e98-bfdd-37e10c237336 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:39.366627 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac72410-4aa2-4e98-bfdd-37e10c237336 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:39.366900 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac72410-4aa2-4e98-bfdd-37e10c237336 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:39.367620 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac72410-4aa2-4e98-bfdd-37e10c237336 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:15:39.367914 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac72410-4aa2-4e98-bfdd-37e10c237336 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:39.393918 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac72410-4aa2-4e98-bfdd-37e10c237336 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:39.409099 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1371/2743] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:15:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:15:39.413545 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4af1e-d0c4-4d97-9e2f-250719314f2f None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:39.422617 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc4af1e-d0c4-4d97-9e2f-250719314f2f None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:39.426772 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b53e9-5b1a-41e0-ae7c-439caa8a5e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:39.427363 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b53e9-5b1a-41e0-ae7c-439caa8a5e84 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:39.427683 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b53e9-5b1a-41e0-ae7c-439caa8a5e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:39.427961 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b53e9-5b1a-41e0-ae7c-439caa8a5e84 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:39.428589 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b53e9-5b1a-41e0-ae7c-439caa8a5e84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:39.455687 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b53e9-5b1a-41e0-ae7c-439caa8a5e84 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:39.483481 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1373/2744] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:15:39 2021] POST /identity/v3/projects => generated 383 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:15:39.487783 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac72410-4aa2-4e98-bfdd-37e10c237336 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:39.497476 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac72410-4aa2-4e98-bfdd-37e10c237336 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:39.560458 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f8d8c-d5ab-4858-bbfc-8bc7b4fdf939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:39.561060 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f8d8c-d5ab-4858-bbfc-8bc7b4fdf939 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:39.561360 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f8d8c-d5ab-4858-bbfc-8bc7b4fdf939 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:39.561622 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f8d8c-d5ab-4858-bbfc-8bc7b4fdf939 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:39.562264 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f8d8c-d5ab-4858-bbfc-8bc7b4fdf939 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:39.588392 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f8d8c-d5ab-4858-bbfc-8bc7b4fdf939 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:39.608878 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1372/2745] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:15:39 2021] POST /identity/v3/users => generated 292 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:15:39.613770 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b53e9-5b1a-41e0-ae7c-439caa8a5e84 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:39.630099 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b53e9-5b1a-41e0-ae7c-439caa8a5e84 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:39.634453 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5770979-a696-4690-9893-1d1f228c23b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:39.635085 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5770979-a696-4690-9893-1d1f228c23b3 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:39.635365 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5770979-a696-4690-9893-1d1f228c23b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:39.635680 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5770979-a696-4690-9893-1d1f228c23b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:39.636373 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5770979-a696-4690-9893-1d1f228c23b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:39.661975 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5770979-a696-4690-9893-1d1f228c23b3 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:39.673420 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1374/2746] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:15:39 2021] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:15:39.677594 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f8d8c-d5ab-4858-bbfc-8bc7b4fdf939 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:39.687074 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f8d8c-d5ab-4858-bbfc-8bc7b4fdf939 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:39.691627 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201319a-ea8c-4e0e-94fb-395d32e57f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:39.692443 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201319a-ea8c-4e0e-94fb-395d32e57f46 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:39.692726 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201319a-ea8c-4e0e-94fb-395d32e57f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:39.693004 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201319a-ea8c-4e0e-94fb-395d32e57f46 admin admin] PATH_INFO: `/v3/projects/14e521c464e743ee889787ac4108f40b/users/98a0f95ca3604dcc83af5ba6a5772e4d/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:39.713355 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201319a-ea8c-4e0e-94fb-395d32e57f46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14e521c464e743ee889787ac4108f40b, user_id=98a0f95ca3604dcc83af5ba6a5772e4d, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:39.740095 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201319a-ea8c-4e0e-94fb-395d32e57f46 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:39.754954 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1373/2747] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:15:39 2021] PUT /identity/v3/projects/14e521c464e743ee889787ac4108f40b/users/98a0f95ca3604dcc83af5ba6a5772e4d/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:15:39.767111 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083a6cb-36d6-409a-bcaa-e6d7c010d7dd None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:39.767406 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083a6cb-36d6-409a-bcaa-e6d7c010d7dd None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:39.767726 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083a6cb-36d6-409a-bcaa-e6d7c010d7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:39.805724 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-5083a6cb-36d6-409a-bcaa-e6d7c010d7dd None None] MFA Rules not processed for user `98a0f95ca3604dcc83af5ba6a5772e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:15:39.806891 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-5083a6cb-36d6-409a-bcaa-e6d7c010d7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:39.888784 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1375/2748] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:15:39 2021] POST /identity/v3/auth/tokens => generated 3690 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:15:39.893851 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201319a-ea8c-4e0e-94fb-395d32e57f46 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:39.964659 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201319a-ea8c-4e0e-94fb-395d32e57f46 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:39.969048 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35191ad-5ced-420b-9011-27ecf47b66d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:39.970195 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35191ad-5ced-420b-9011-27ecf47b66d6 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:39.970483 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35191ad-5ced-420b-9011-27ecf47b66d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:39.970761 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35191ad-5ced-420b-9011-27ecf47b66d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:39.971392 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35191ad-5ced-420b-9011-27ecf47b66d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:39.996563 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35191ad-5ced-420b-9011-27ecf47b66d6 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:40.025558 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1374/2749] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:15:39 2021] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:15:40.029922 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083a6cb-36d6-409a-bcaa-e6d7c010d7dd None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:40.040873 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083a6cb-36d6-409a-bcaa-e6d7c010d7dd None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:40.108039 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851b900-d769-423d-bbe8-32f49f386bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:40.108649 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851b900-d769-423d-bbe8-32f49f386bfa admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:40.108938 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851b900-d769-423d-bbe8-32f49f386bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:40.109242 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851b900-d769-423d-bbe8-32f49f386bfa admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:40.109907 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851b900-d769-423d-bbe8-32f49f386bfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:40.135737 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851b900-d769-423d-bbe8-32f49f386bfa admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:40.156832 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1376/2750] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:15:40 2021] POST /identity/v3/users => generated 298 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:15:40.160906 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35191ad-5ced-420b-9011-27ecf47b66d6 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:40.170694 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35191ad-5ced-420b-9011-27ecf47b66d6 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:40.175025 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89d0bb-18f7-48d9-b725-6fa47169f1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:40.175656 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89d0bb-18f7-48d9-b725-6fa47169f1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:40.175950 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89d0bb-18f7-48d9-b725-6fa47169f1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:40.176231 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89d0bb-18f7-48d9-b725-6fa47169f1c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:40.176927 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89d0bb-18f7-48d9-b725-6fa47169f1c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:40.202506 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89d0bb-18f7-48d9-b725-6fa47169f1c1 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:40.214837 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1375/2751] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:15:40 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:15:40.219026 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851b900-d769-423d-bbe8-32f49f386bfa admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:40.229156 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851b900-d769-423d-bbe8-32f49f386bfa admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:40.234031 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a16d6e-61cc-4cd0-97ef-3876ebe6061d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:40.234855 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a16d6e-61cc-4cd0-97ef-3876ebe6061d admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:40.235172 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a16d6e-61cc-4cd0-97ef-3876ebe6061d admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:40.235459 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a16d6e-61cc-4cd0-97ef-3876ebe6061d admin admin] PATH_INFO: `/v3/projects/c7b77c8b3b114860b5c0317ad20bda5d/users/b2f5a433193647f7becb889a6444e1e8/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:40.256887 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a16d6e-61cc-4cd0-97ef-3876ebe6061d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7b77c8b3b114860b5c0317ad20bda5d, user_id=b2f5a433193647f7becb889a6444e1e8, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:40.289457 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a16d6e-61cc-4cd0-97ef-3876ebe6061d admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:40.303554 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1377/2752] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:15:40 2021] PUT /identity/v3/projects/c7b77c8b3b114860b5c0317ad20bda5d/users/b2f5a433193647f7becb889a6444e1e8/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:15:40.307709 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89d0bb-18f7-48d9-b725-6fa47169f1c1 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:40.318237 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89d0bb-18f7-48d9-b725-6fa47169f1c1 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:40.383277 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda89ab-c073-407d-8c80-a339fe1a1a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:40.383917 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda89ab-c073-407d-8c80-a339fe1a1a24 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:40.384204 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda89ab-c073-407d-8c80-a339fe1a1a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:40.384482 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda89ab-c073-407d-8c80-a339fe1a1a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:40.385169 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda89ab-c073-407d-8c80-a339fe1a1a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:40.411007 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda89ab-c073-407d-8c80-a339fe1a1a24 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:40.422728 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1376/2753] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:15:40 2021] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:15:40.427126 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a16d6e-61cc-4cd0-97ef-3876ebe6061d admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:40.437487 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a16d6e-61cc-4cd0-97ef-3876ebe6061d admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:40.442287 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86edda-1a24-40cd-bd8f-6bde8e32be35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:40.443107 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86edda-1a24-40cd-bd8f-6bde8e32be35 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:40.443393 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86edda-1a24-40cd-bd8f-6bde8e32be35 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:40.443705 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86edda-1a24-40cd-bd8f-6bde8e32be35 admin admin] PATH_INFO: `/v3/projects/c7b77c8b3b114860b5c0317ad20bda5d/users/b2f5a433193647f7becb889a6444e1e8/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:40.445612 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86edda-1a24-40cd-bd8f-6bde8e32be35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7b77c8b3b114860b5c0317ad20bda5d, user_id=b2f5a433193647f7becb889a6444e1e8, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:40.473064 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86edda-1a24-40cd-bd8f-6bde8e32be35 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:40.483545 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1378/2754] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:15:40 2021] PUT /identity/v3/projects/c7b77c8b3b114860b5c0317ad20bda5d/users/b2f5a433193647f7becb889a6444e1e8/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:15:40.488221 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda89ab-c073-407d-8c80-a339fe1a1a24 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:40.502120 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda89ab-c073-407d-8c80-a339fe1a1a24 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:40.568432 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92928b2c-c204-4da3-9d29-b32883e4f969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:40.569042 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92928b2c-c204-4da3-9d29-b32883e4f969 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:40.569329 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92928b2c-c204-4da3-9d29-b32883e4f969 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:40.569609 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92928b2c-c204-4da3-9d29-b32883e4f969 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:40.570299 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92928b2c-c204-4da3-9d29-b32883e4f969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:40.595215 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92928b2c-c204-4da3-9d29-b32883e4f969 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:40.606089 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1377/2755] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:15:40 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:15:40.610972 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86edda-1a24-40cd-bd8f-6bde8e32be35 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:40.621117 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86edda-1a24-40cd-bd8f-6bde8e32be35 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:40.626167 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a6a1d-8726-43bc-b626-4aa50288591f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:40.627040 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a6a1d-8726-43bc-b626-4aa50288591f admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:40.627323 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a6a1d-8726-43bc-b626-4aa50288591f admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:40.627630 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a6a1d-8726-43bc-b626-4aa50288591f admin admin] PATH_INFO: `/v3/projects/c7b77c8b3b114860b5c0317ad20bda5d/users/b2f5a433193647f7becb889a6444e1e8/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:40.629409 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a6a1d-8726-43bc-b626-4aa50288591f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7b77c8b3b114860b5c0317ad20bda5d, user_id=b2f5a433193647f7becb889a6444e1e8, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:40.656139 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a6a1d-8726-43bc-b626-4aa50288591f admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:40.670759 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1379/2756] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:15:40 2021] PUT /identity/v3/projects/c7b77c8b3b114860b5c0317ad20bda5d/users/b2f5a433193647f7becb889a6444e1e8/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:15:40.681590 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f90b5-eae0-4d0e-a735-85c4321971df None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:40.681903 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f90b5-eae0-4d0e-a735-85c4321971df None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:40.682181 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f90b5-eae0-4d0e-a735-85c4321971df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:40.720489 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-704f90b5-eae0-4d0e-a735-85c4321971df None None] MFA Rules not processed for user `b2f5a433193647f7becb889a6444e1e8`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:15:40.721638 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-704f90b5-eae0-4d0e-a735-85c4321971df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:40.800929 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1378/2757] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:15:40 2021] POST /identity/v3/auth/tokens => generated 3757 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:15:40.811170 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a6a1d-8726-43bc-b626-4aa50288591f admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:40.812829 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-631a6a1d-8726-43bc-b626-4aa50288591f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:40.880036 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a6a1d-8726-43bc-b626-4aa50288591f admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:40.883498 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec63c72-1e64-4f74-bb76-87b56cdf5196 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:40.884166 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec63c72-1e64-4f74-bb76-87b56cdf5196 service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:40.884454 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec63c72-1e64-4f74-bb76-87b56cdf5196 service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:40.884732 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec63c72-1e64-4f74-bb76-87b56cdf5196 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:40.894024 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec63c72-1e64-4f74-bb76-87b56cdf5196 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:40.919532 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec63c72-1e64-4f74-bb76-87b56cdf5196 service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:40.930166 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1380/2758] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:15:40 2021] GET /identity/v3/auth/tokens => generated 3757 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:15:41.037511 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f90b5-eae0-4d0e-a735-85c4321971df None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:41.046876 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f90b5-eae0-4d0e-a735-85c4321971df None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:41.050694 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2525daf-8137-4a0b-8d26-4441c9084fe7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:41.051264 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2525daf-8137-4a0b-8d26-4441c9084fe7 service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:41.051607 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2525daf-8137-4a0b-8d26-4441c9084fe7 service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:41.051884 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2525daf-8137-4a0b-8d26-4441c9084fe7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:41.116428 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2525daf-8137-4a0b-8d26-4441c9084fe7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:41.141493 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2525daf-8137-4a0b-8d26-4441c9084fe7 service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:41.151395 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1379/2759] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:15:41 2021] GET /identity/v3/auth/tokens => generated 3690 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:15:41.529758 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec63c72-1e64-4f74-bb76-87b56cdf5196 service cinder] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:41.607781 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec63c72-1e64-4f74-bb76-87b56cdf5196 service cinder] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:41.611892 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48e7ac-7c63-4801-afb0-bdf12c46be3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:41.612697 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48e7ac-7c63-4801-afb0-bdf12c46be3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:41.612977 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48e7ac-7c63-4801-afb0-bdf12c46be3a admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:41.613251 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48e7ac-7c63-4801-afb0-bdf12c46be3a admin admin] PATH_INFO: `/v3/users/98a0f95ca3604dcc83af5ba6a5772e4d` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:41.614336 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48e7ac-7c63-4801-afb0-bdf12c46be3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=98a0f95ca3604dcc83af5ba6a5772e4d)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:41.640627 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48e7ac-7c63-4801-afb0-bdf12c46be3a admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:41.690982 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-9e48e7ac-7c63-4801-afb0-bdf12c46be3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98a0f95ca3604dcc83af5ba6a5772e4d'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:41.691627 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-9e48e7ac-7c63-4801-afb0-bdf12c46be3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98a0f95ca3604dcc83af5ba6a5772e4d'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:41.703785 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-9e48e7ac-7c63-4801-afb0-bdf12c46be3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98a0f95ca3604dcc83af5ba6a5772e4d'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:41.711823 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-9e48e7ac-7c63-4801-afb0-bdf12c46be3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98a0f95ca3604dcc83af5ba6a5772e4d'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:41.719861 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-9e48e7ac-7c63-4801-afb0-bdf12c46be3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98a0f95ca3604dcc83af5ba6a5772e4d'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:41.725741 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1381/2760] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:15:41 2021] DELETE /identity/v3/users/98a0f95ca3604dcc83af5ba6a5772e4d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:15:41.730776 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daddaf0f-c580-4f2f-85ab-d55b5167eb0c None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:41.731543 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daddaf0f-c580-4f2f-85ab-d55b5167eb0c None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:41.731543 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daddaf0f-c580-4f2f-85ab-d55b5167eb0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:41.758834 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-daddaf0f-c580-4f2f-85ab-d55b5167eb0c None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:15:41.760035 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-daddaf0f-c580-4f2f-85ab-d55b5167eb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:41.828036 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1380/2761] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:15:41 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 15:15:41.838942 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48e7ac-7c63-4801-afb0-bdf12c46be3a admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:41.840350 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-9e48e7ac-7c63-4801-afb0-bdf12c46be3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:41.905059 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48e7ac-7c63-4801-afb0-bdf12c46be3a admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:41.908900 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128a857-97ae-4b10-80ee-10deb5dcf588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:41.909488 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128a857-97ae-4b10-80ee-10deb5dcf588 service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:41.909778 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128a857-97ae-4b10-80ee-10deb5dcf588 service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:41.910059 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8128a857-97ae-4b10-80ee-10deb5dcf588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:41.919680 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128a857-97ae-4b10-80ee-10deb5dcf588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:41.945774 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8128a857-97ae-4b10-80ee-10deb5dcf588 service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:41.956553 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1382/2762] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:15:41 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:15:42.352273 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daddaf0f-c580-4f2f-85ab-d55b5167eb0c None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:42.353546 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-daddaf0f-c580-4f2f-85ab-d55b5167eb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:42.365824 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daddaf0f-c580-4f2f-85ab-d55b5167eb0c None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:42.373556 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d278e7-a034-4f15-ad42-de9bbf9d7589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:42.374355 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d278e7-a034-4f15-ad42-de9bbf9d7589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:42.374641 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d278e7-a034-4f15-ad42-de9bbf9d7589 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:42.374916 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d278e7-a034-4f15-ad42-de9bbf9d7589 admin admin] PATH_INFO: `/v3/projects/14e521c464e743ee889787ac4108f40b` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:42.376075 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d278e7-a034-4f15-ad42-de9bbf9d7589 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14e521c464e743ee889787ac4108f40b)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:42.402318 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d278e7-a034-4f15-ad42-de9bbf9d7589 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:42.456507 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-06d278e7-a034-4f15-ad42-de9bbf9d7589 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14e521c464e743ee889787ac4108f40b', 'request_id': 'req-06d278e7-a034-4f15-ad42-de9bbf9d7589'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:42.461574 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-06d278e7-a034-4f15-ad42-de9bbf9d7589 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14e521c464e743ee889787ac4108f40b', 'request_id': 'req-06d278e7-a034-4f15-ad42-de9bbf9d7589'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:42.473258 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-06d278e7-a034-4f15-ad42-de9bbf9d7589 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14e521c464e743ee889787ac4108f40b', 'request_id': 'req-06d278e7-a034-4f15-ad42-de9bbf9d7589'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:42.486881 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-06d278e7-a034-4f15-ad42-de9bbf9d7589 admin admin] The token cache is being invalidate because project 14e521c464e743ee889787ac4108f40b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:15:42.487169 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-06d278e7-a034-4f15-ad42-de9bbf9d7589 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:42.487800 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-06d278e7-a034-4f15-ad42-de9bbf9d7589 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:42.489294 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1381/2763] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:15:42 2021] DELETE /identity/v3/projects/14e521c464e743ee889787ac4108f40b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:15:42.493256 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128a857-97ae-4b10-80ee-10deb5dcf588 service neutron] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:42.502846 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8128a857-97ae-4b10-80ee-10deb5dcf588 service neutron] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:42.572101 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62c4c6-569e-48f8-88d4-162eba19df72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:42.572899 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62c4c6-569e-48f8-88d4-162eba19df72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:42.573184 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62c4c6-569e-48f8-88d4-162eba19df72 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:42.573458 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62c4c6-569e-48f8-88d4-162eba19df72 admin admin] PATH_INFO: `/v3/users/b2f5a433193647f7becb889a6444e1e8` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:42.574528 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62c4c6-569e-48f8-88d4-162eba19df72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2f5a433193647f7becb889a6444e1e8)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:42.600531 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62c4c6-569e-48f8-88d4-162eba19df72 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:42.650967 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-eb62c4c6-569e-48f8-88d4-162eba19df72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2f5a433193647f7becb889a6444e1e8'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:42.651620 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-eb62c4c6-569e-48f8-88d4-162eba19df72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2f5a433193647f7becb889a6444e1e8'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:42.664058 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-eb62c4c6-569e-48f8-88d4-162eba19df72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2f5a433193647f7becb889a6444e1e8'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:42.673466 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-eb62c4c6-569e-48f8-88d4-162eba19df72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2f5a433193647f7becb889a6444e1e8'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:42.681641 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-eb62c4c6-569e-48f8-88d4-162eba19df72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2f5a433193647f7becb889a6444e1e8'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:42.687585 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1383/2764] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:15:42 2021] DELETE /identity/v3/users/b2f5a433193647f7becb889a6444e1e8 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:15:43.181432 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d278e7-a034-4f15-ad42-de9bbf9d7589 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:43.183091 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-06d278e7-a034-4f15-ad42-de9bbf9d7589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:43.198179 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d278e7-a034-4f15-ad42-de9bbf9d7589 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:43.265066 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd1015a-e6b1-4b0d-91a0-41a38148c652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:43.265780 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1015a-e6b1-4b0d-91a0-41a38148c652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:43.266056 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1015a-e6b1-4b0d-91a0-41a38148c652 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:43.266897 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd1015a-e6b1-4b0d-91a0-41a38148c652 admin admin] PATH_INFO: `/v3/projects/c7b77c8b3b114860b5c0317ad20bda5d` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:43.268062 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd1015a-e6b1-4b0d-91a0-41a38148c652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7b77c8b3b114860b5c0317ad20bda5d)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:43.293769 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd1015a-e6b1-4b0d-91a0-41a38148c652 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:43.350191 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-9cd1015a-e6b1-4b0d-91a0-41a38148c652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7b77c8b3b114860b5c0317ad20bda5d', 'request_id': 'req-9cd1015a-e6b1-4b0d-91a0-41a38148c652'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:43.355281 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-9cd1015a-e6b1-4b0d-91a0-41a38148c652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7b77c8b3b114860b5c0317ad20bda5d', 'request_id': 'req-9cd1015a-e6b1-4b0d-91a0-41a38148c652'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:43.368693 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-9cd1015a-e6b1-4b0d-91a0-41a38148c652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7b77c8b3b114860b5c0317ad20bda5d', 'request_id': 'req-9cd1015a-e6b1-4b0d-91a0-41a38148c652'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:43.381653 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-9cd1015a-e6b1-4b0d-91a0-41a38148c652 admin admin] The token cache is being invalidate because project c7b77c8b3b114860b5c0317ad20bda5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:15:43.381924 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-9cd1015a-e6b1-4b0d-91a0-41a38148c652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:43.382510 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-9cd1015a-e6b1-4b0d-91a0-41a38148c652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:43.383958 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1382/2765] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:15:43 2021] DELETE /identity/v3/projects/c7b77c8b3b114860b5c0317ad20bda5d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:15:43.389850 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1928a-b7d9-48b0-be43-19eacb1ba301 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:43.390142 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1928a-b7d9-48b0-be43-19eacb1ba301 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:43.390425 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1928a-b7d9-48b0-be43-19eacb1ba301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:43.413597 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-39d1928a-b7d9-48b0-be43-19eacb1ba301 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:15:43.414756 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-39d1928a-b7d9-48b0-be43-19eacb1ba301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:43.486425 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1384/2766] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:15:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:15:43.494127 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a2c12-7f9b-41d4-a35e-2f7a719439c1 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:43.494415 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a2c12-7f9b-41d4-a35e-2f7a719439c1 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:43.494695 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a2c12-7f9b-41d4-a35e-2f7a719439c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:43.517270 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-6e9a2c12-7f9b-41d4-a35e-2f7a719439c1 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:15:43.518325 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-6e9a2c12-7f9b-41d4-a35e-2f7a719439c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:43.528759 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1383/2767] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:15:43 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:15:43.532931 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1928a-b7d9-48b0-be43-19eacb1ba301 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:43.542246 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1928a-b7d9-48b0-be43-19eacb1ba301 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:43.546367 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb896929-78a6-4e8b-93b2-cdb5ba45cf42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:43.546950 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb896929-78a6-4e8b-93b2-cdb5ba45cf42 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:43.547234 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb896929-78a6-4e8b-93b2-cdb5ba45cf42 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:43.548058 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb896929-78a6-4e8b-93b2-cdb5ba45cf42 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:43.548741 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb896929-78a6-4e8b-93b2-cdb5ba45cf42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:15:43.549033 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb896929-78a6-4e8b-93b2-cdb5ba45cf42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:43.574526 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb896929-78a6-4e8b-93b2-cdb5ba45cf42 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:43.588177 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1385/2768] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:15:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:15:43.593122 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a2c12-7f9b-41d4-a35e-2f7a719439c1 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:43.607318 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a2c12-7f9b-41d4-a35e-2f7a719439c1 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:43.612091 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414606d-24db-4a54-9f98-594edef09b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:43.612681 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414606d-24db-4a54-9f98-594edef09b94 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:43.612957 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414606d-24db-4a54-9f98-594edef09b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:43.613229 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414606d-24db-4a54-9f98-594edef09b94 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:43.613853 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414606d-24db-4a54-9f98-594edef09b94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:43.639503 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414606d-24db-4a54-9f98-594edef09b94 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:43.668739 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1384/2769] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:15:43 2021] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:15:43.672806 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb896929-78a6-4e8b-93b2-cdb5ba45cf42 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:43.682457 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb896929-78a6-4e8b-93b2-cdb5ba45cf42 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:43.744641 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91b2d1-3d30-43b0-b8f8-bbfe2bc4386e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:43.745249 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91b2d1-3d30-43b0-b8f8-bbfe2bc4386e admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:43.745530 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91b2d1-3d30-43b0-b8f8-bbfe2bc4386e admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:43.745803 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91b2d1-3d30-43b0-b8f8-bbfe2bc4386e admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:43.746441 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91b2d1-3d30-43b0-b8f8-bbfe2bc4386e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:43.772127 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91b2d1-3d30-43b0-b8f8-bbfe2bc4386e admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:43.793066 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1386/2770] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:15:43 2021] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:15:43.797178 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414606d-24db-4a54-9f98-594edef09b94 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:43.807290 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414606d-24db-4a54-9f98-594edef09b94 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:43.811559 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6132e0-8a6c-46ce-8729-72a1b24bb332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:43.812163 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6132e0-8a6c-46ce-8729-72a1b24bb332 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:43.812445 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6132e0-8a6c-46ce-8729-72a1b24bb332 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:43.812723 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6132e0-8a6c-46ce-8729-72a1b24bb332 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:43.813446 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6132e0-8a6c-46ce-8729-72a1b24bb332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:43.842103 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6132e0-8a6c-46ce-8729-72a1b24bb332 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:43.850754 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1385/2771] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:15:43 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:15:43.855256 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91b2d1-3d30-43b0-b8f8-bbfe2bc4386e admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:43.865014 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91b2d1-3d30-43b0-b8f8-bbfe2bc4386e admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:43.869691 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7fad1-5d4e-49ba-a4be-c0cf02f8cf97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:43.870521 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7fad1-5d4e-49ba-a4be-c0cf02f8cf97 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:43.870812 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7fad1-5d4e-49ba-a4be-c0cf02f8cf97 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:43.871097 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7fad1-5d4e-49ba-a4be-c0cf02f8cf97 admin admin] PATH_INFO: `/v3/projects/782f214993474fae802b9a9d866852d6/users/a0dd44fb8a084588ae764a6dc441819d/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:43.892877 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7fad1-5d4e-49ba-a4be-c0cf02f8cf97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=782f214993474fae802b9a9d866852d6, user_id=a0dd44fb8a084588ae764a6dc441819d, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:43.922997 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7fad1-5d4e-49ba-a4be-c0cf02f8cf97 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:43.939033 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1387/2772] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:15:43 2021] PUT /identity/v3/projects/782f214993474fae802b9a9d866852d6/users/a0dd44fb8a084588ae764a6dc441819d/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:15:43.950306 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e48c12-db0c-41b2-8305-36d21f36954c None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:43.950603 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e48c12-db0c-41b2-8305-36d21f36954c None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:43.950887 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e48c12-db0c-41b2-8305-36d21f36954c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:43.991126 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-a1e48c12-db0c-41b2-8305-36d21f36954c None None] MFA Rules not processed for user `a0dd44fb8a084588ae764a6dc441819d`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:15:43.992326 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-a1e48c12-db0c-41b2-8305-36d21f36954c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:44.068106 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1386/2773] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:15:43 2021] POST /identity/v3/auth/tokens => generated 3692 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:15:44.072570 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7fad1-5d4e-49ba-a4be-c0cf02f8cf97 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:44.143408 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7fad1-5d4e-49ba-a4be-c0cf02f8cf97 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:44.147967 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae2ad3-5076-4be9-8cc6-887278c0fae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:44.148556 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae2ad3-5076-4be9-8cc6-887278c0fae9 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:44.148844 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae2ad3-5076-4be9-8cc6-887278c0fae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:44.149120 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae2ad3-5076-4be9-8cc6-887278c0fae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:44.149753 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae2ad3-5076-4be9-8cc6-887278c0fae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:44.175063 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae2ad3-5076-4be9-8cc6-887278c0fae9 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:44.202319 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1388/2774] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:15:44 2021] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:15:44.206881 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e48c12-db0c-41b2-8305-36d21f36954c None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:44.217892 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e48c12-db0c-41b2-8305-36d21f36954c None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:44.285970 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4102e0b-46e5-4ee6-8c67-3d45bec1aaa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:44.286149 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4102e0b-46e5-4ee6-8c67-3d45bec1aaa8 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:44.286438 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4102e0b-46e5-4ee6-8c67-3d45bec1aaa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:44.286720 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4102e0b-46e5-4ee6-8c67-3d45bec1aaa8 admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:44.287370 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4102e0b-46e5-4ee6-8c67-3d45bec1aaa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:44.314858 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4102e0b-46e5-4ee6-8c67-3d45bec1aaa8 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:44.338560 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1387/2775] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:15:44 2021] POST /identity/v3/users => generated 299 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:15:44.339770 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae2ad3-5076-4be9-8cc6-887278c0fae9 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:44.350398 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae2ad3-5076-4be9-8cc6-887278c0fae9 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:44.354651 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037039bd-7f0d-4044-a7cb-7940bd1649f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:44.355259 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037039bd-7f0d-4044-a7cb-7940bd1649f6 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:44.355571 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037039bd-7f0d-4044-a7cb-7940bd1649f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:44.355893 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037039bd-7f0d-4044-a7cb-7940bd1649f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:44.356573 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037039bd-7f0d-4044-a7cb-7940bd1649f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:44.382616 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037039bd-7f0d-4044-a7cb-7940bd1649f6 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:44.395850 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1389/2776] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:15:44 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:15:44.400373 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4102e0b-46e5-4ee6-8c67-3d45bec1aaa8 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:44.410068 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4102e0b-46e5-4ee6-8c67-3d45bec1aaa8 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:44.414473 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3ab79-218c-4ab2-8e33-e3c039b9651d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:44.415298 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3ab79-218c-4ab2-8e33-e3c039b9651d admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:44.415652 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3ab79-218c-4ab2-8e33-e3c039b9651d admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:44.415931 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3ab79-218c-4ab2-8e33-e3c039b9651d admin admin] PATH_INFO: `/v3/projects/469dfb07b7124801bd29a0637acd723d/users/9fc7b6ca85924e30bddb0c6d76715dae/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:44.436940 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3ab79-218c-4ab2-8e33-e3c039b9651d admin admin] RBAC: Authorizing `identity:create_grant(project_id=469dfb07b7124801bd29a0637acd723d, user_id=9fc7b6ca85924e30bddb0c6d76715dae, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:44.464098 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e3ab79-218c-4ab2-8e33-e3c039b9651d admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:44.477666 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1388/2777] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:15:44 2021] PUT /identity/v3/projects/469dfb07b7124801bd29a0637acd723d/users/9fc7b6ca85924e30bddb0c6d76715dae/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:15:44.481760 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037039bd-7f0d-4044-a7cb-7940bd1649f6 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:44.492122 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037039bd-7f0d-4044-a7cb-7940bd1649f6 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:44.555131 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b450a2-1b60-46e9-aae3-63ee52fb3eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:44.555766 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b450a2-1b60-46e9-aae3-63ee52fb3eae admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:44.556051 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b450a2-1b60-46e9-aae3-63ee52fb3eae admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:44.556331 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b450a2-1b60-46e9-aae3-63ee52fb3eae admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:44.557021 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b450a2-1b60-46e9-aae3-63ee52fb3eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:44.582465 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b450a2-1b60-46e9-aae3-63ee52fb3eae admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:44.593590 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1390/2778] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:15:44 2021] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:15:44.598173 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3ab79-218c-4ab2-8e33-e3c039b9651d admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:44.608008 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3ab79-218c-4ab2-8e33-e3c039b9651d admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:44.613008 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe2aca-65ce-4bdb-84ab-5689bf07ddbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:44.613825 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe2aca-65ce-4bdb-84ab-5689bf07ddbc admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:44.614113 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe2aca-65ce-4bdb-84ab-5689bf07ddbc admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:44.614518 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe2aca-65ce-4bdb-84ab-5689bf07ddbc admin admin] PATH_INFO: `/v3/projects/469dfb07b7124801bd29a0637acd723d/users/9fc7b6ca85924e30bddb0c6d76715dae/roles/c243fbeb99ae4f51910f72ddc1773778` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:44.616397 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe2aca-65ce-4bdb-84ab-5689bf07ddbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=469dfb07b7124801bd29a0637acd723d, user_id=9fc7b6ca85924e30bddb0c6d76715dae, role_id=c243fbeb99ae4f51910f72ddc1773778)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:44.642642 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe2aca-65ce-4bdb-84ab-5689bf07ddbc admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:44.653468 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1389/2779] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:15:44 2021] PUT /identity/v3/projects/469dfb07b7124801bd29a0637acd723d/users/9fc7b6ca85924e30bddb0c6d76715dae/roles/c243fbeb99ae4f51910f72ddc1773778 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:15:44.658558 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b450a2-1b60-46e9-aae3-63ee52fb3eae admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:44.671168 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b450a2-1b60-46e9-aae3-63ee52fb3eae admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:44.737809 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ca2cd-9813-40b3-9fb7-339cb3d55eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:44.738437 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ca2cd-9813-40b3-9fb7-339cb3d55eaf admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:44.738723 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ca2cd-9813-40b3-9fb7-339cb3d55eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:44.739002 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ca2cd-9813-40b3-9fb7-339cb3d55eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:44.739727 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ca2cd-9813-40b3-9fb7-339cb3d55eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:44.765066 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ca2cd-9813-40b3-9fb7-339cb3d55eaf admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:44.776264 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1391/2780] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:15:44 2021] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:15:44.780694 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe2aca-65ce-4bdb-84ab-5689bf07ddbc admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:44.790847 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe2aca-65ce-4bdb-84ab-5689bf07ddbc admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:44.795294 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb3246-21e2-4fd0-96d3-7fc36a6ed927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:44.796146 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb3246-21e2-4fd0-96d3-7fc36a6ed927 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:44.796491 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb3246-21e2-4fd0-96d3-7fc36a6ed927 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:44.796702 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb3246-21e2-4fd0-96d3-7fc36a6ed927 admin admin] PATH_INFO: `/v3/projects/469dfb07b7124801bd29a0637acd723d/users/9fc7b6ca85924e30bddb0c6d76715dae/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:44.799216 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb3246-21e2-4fd0-96d3-7fc36a6ed927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=469dfb07b7124801bd29a0637acd723d, user_id=9fc7b6ca85924e30bddb0c6d76715dae, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:44.825598 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb3246-21e2-4fd0-96d3-7fc36a6ed927 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:44.839907 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1390/2781] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:15:44 2021] PUT /identity/v3/projects/469dfb07b7124801bd29a0637acd723d/users/9fc7b6ca85924e30bddb0c6d76715dae/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:15:44.850999 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e325cbf-73dc-433b-b2ba-1e1193dae0fc None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:44.851262 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e325cbf-73dc-433b-b2ba-1e1193dae0fc None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:44.851728 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e325cbf-73dc-433b-b2ba-1e1193dae0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:44.889082 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-9e325cbf-73dc-433b-b2ba-1e1193dae0fc None None] MFA Rules not processed for user `9fc7b6ca85924e30bddb0c6d76715dae`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:15:44.890254 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-9e325cbf-73dc-433b-b2ba-1e1193dae0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:44.968981 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1392/2782] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:15:44 2021] POST /identity/v3/auth/tokens => generated 3759 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:15:44.979011 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb3246-21e2-4fd0-96d3-7fc36a6ed927 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:44.980654 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-bbdb3246-21e2-4fd0-96d3-7fc36a6ed927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:45.046850 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb3246-21e2-4fd0-96d3-7fc36a6ed927 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:45.050349 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c138c27-5faa-4e71-8fb5-302de58be3b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:45.050937 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c138c27-5faa-4e71-8fb5-302de58be3b1 service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:45.051221 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c138c27-5faa-4e71-8fb5-302de58be3b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:45.051533 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c138c27-5faa-4e71-8fb5-302de58be3b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:45.116025 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c138c27-5faa-4e71-8fb5-302de58be3b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:45.140695 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c138c27-5faa-4e71-8fb5-302de58be3b1 service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:45.150862 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1391/2783] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:15:44 2021] GET /identity/v3/auth/tokens => generated 3692 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:15:50.109039 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e325cbf-73dc-433b-b2ba-1e1193dae0fc None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:50.110364 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-9e325cbf-73dc-433b-b2ba-1e1193dae0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:50.121789 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e325cbf-73dc-433b-b2ba-1e1193dae0fc None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:50.125107 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d5e6d-3949-48ba-9634-21893b1aeb74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:50.126176 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d5e6d-3949-48ba-9634-21893b1aeb74 service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:50.126458 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d5e6d-3949-48ba-9634-21893b1aeb74 service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:50.126730 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d5e6d-3949-48ba-9634-21893b1aeb74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:50.135958 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d5e6d-3949-48ba-9634-21893b1aeb74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:50.161467 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d5e6d-3949-48ba-9634-21893b1aeb74 service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:50.171517 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1393/2784] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:15:50 2021] GET /identity/v3/auth/tokens => generated 3759 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:15:55.594738 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c138c27-5faa-4e71-8fb5-302de58be3b1 service cinder] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:55.663750 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c138c27-5faa-4e71-8fb5-302de58be3b1 service cinder] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:55.668161 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025d1b3-8982-40f9-8cb2-5f5eace2d0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:55.669088 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025d1b3-8982-40f9-8cb2-5f5eace2d0ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:55.669473 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025d1b3-8982-40f9-8cb2-5f5eace2d0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:55.669858 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025d1b3-8982-40f9-8cb2-5f5eace2d0ad admin admin] PATH_INFO: `/v3/users/a0dd44fb8a084588ae764a6dc441819d` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:55.671094 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025d1b3-8982-40f9-8cb2-5f5eace2d0ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0dd44fb8a084588ae764a6dc441819d)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:55.697192 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025d1b3-8982-40f9-8cb2-5f5eace2d0ad admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:55.750138 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-1025d1b3-8982-40f9-8cb2-5f5eace2d0ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0dd44fb8a084588ae764a6dc441819d'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:55.762803 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-1025d1b3-8982-40f9-8cb2-5f5eace2d0ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0dd44fb8a084588ae764a6dc441819d'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:55.763645 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-1025d1b3-8982-40f9-8cb2-5f5eace2d0ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0dd44fb8a084588ae764a6dc441819d'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:55.771680 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-1025d1b3-8982-40f9-8cb2-5f5eace2d0ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0dd44fb8a084588ae764a6dc441819d'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:55.779764 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-1025d1b3-8982-40f9-8cb2-5f5eace2d0ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0dd44fb8a084588ae764a6dc441819d'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:55.786289 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1392/2785] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:15:55 2021] DELETE /identity/v3/users/a0dd44fb8a084588ae764a6dc441819d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:15:55.790749 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44975331-a972-42ed-a032-2e5221289345 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:55.791254 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44975331-a972-42ed-a032-2e5221289345 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:55.791359 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44975331-a972-42ed-a032-2e5221289345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:55.814058 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-44975331-a972-42ed-a032-2e5221289345 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:15:55.815133 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-44975331-a972-42ed-a032-2e5221289345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:55.884031 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1394/2786] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:15:55 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:15:55.895287 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025d1b3-8982-40f9-8cb2-5f5eace2d0ad admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:55.896653 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-1025d1b3-8982-40f9-8cb2-5f5eace2d0ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:55.963805 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025d1b3-8982-40f9-8cb2-5f5eace2d0ad admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:55.967334 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4959b-85ed-40f0-ac20-5f56cc80a04f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:55.967955 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4959b-85ed-40f0-ac20-5f56cc80a04f service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:55.968240 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4959b-85ed-40f0-ac20-5f56cc80a04f service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:55.968518 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a4959b-85ed-40f0-ac20-5f56cc80a04f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:55.978251 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4959b-85ed-40f0-ac20-5f56cc80a04f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:56.003699 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a4959b-85ed-40f0-ac20-5f56cc80a04f service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:56.013658 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1393/2787] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:15:55 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:15:56.389953 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44975331-a972-42ed-a032-2e5221289345 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:56.391297 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-44975331-a972-42ed-a032-2e5221289345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:56.405199 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44975331-a972-42ed-a032-2e5221289345 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:56.409427 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aee8d6-4214-4982-af61-5275927124ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:56.410218 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aee8d6-4214-4982-af61-5275927124ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:56.410500 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aee8d6-4214-4982-af61-5275927124ac admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:56.410778 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aee8d6-4214-4982-af61-5275927124ac admin admin] PATH_INFO: `/v3/projects/782f214993474fae802b9a9d866852d6` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:56.411877 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aee8d6-4214-4982-af61-5275927124ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=782f214993474fae802b9a9d866852d6)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:56.438201 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aee8d6-4214-4982-af61-5275927124ac admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:56.490496 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b2aee8d6-4214-4982-af61-5275927124ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '782f214993474fae802b9a9d866852d6', 'request_id': 'req-b2aee8d6-4214-4982-af61-5275927124ac'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:56.495380 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b2aee8d6-4214-4982-af61-5275927124ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '782f214993474fae802b9a9d866852d6', 'request_id': 'req-b2aee8d6-4214-4982-af61-5275927124ac'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:56.507005 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b2aee8d6-4214-4982-af61-5275927124ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '782f214993474fae802b9a9d866852d6', 'request_id': 'req-b2aee8d6-4214-4982-af61-5275927124ac'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:56.519040 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b2aee8d6-4214-4982-af61-5275927124ac admin admin] The token cache is being invalidate because project 782f214993474fae802b9a9d866852d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:15:56.519322 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b2aee8d6-4214-4982-af61-5275927124ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:56.519959 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-b2aee8d6-4214-4982-af61-5275927124ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:56.521517 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1395/2788] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:15:56 2021] DELETE /identity/v3/projects/782f214993474fae802b9a9d866852d6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:15:56.525806 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4959b-85ed-40f0-ac20-5f56cc80a04f service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:56.534978 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a4959b-85ed-40f0-ac20-5f56cc80a04f service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:56.599327 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca698af-9476-4e89-ba59-72e93d46853b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:56.600249 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca698af-9476-4e89-ba59-72e93d46853b admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:56.600500 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca698af-9476-4e89-ba59-72e93d46853b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:56.600771 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca698af-9476-4e89-ba59-72e93d46853b admin admin] PATH_INFO: `/v3/users/9fc7b6ca85924e30bddb0c6d76715dae` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:56.601899 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca698af-9476-4e89-ba59-72e93d46853b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fc7b6ca85924e30bddb0c6d76715dae)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:56.628146 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca698af-9476-4e89-ba59-72e93d46853b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:56.678662 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-cca698af-9476-4e89-ba59-72e93d46853b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fc7b6ca85924e30bddb0c6d76715dae'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:56.690404 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-cca698af-9476-4e89-ba59-72e93d46853b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fc7b6ca85924e30bddb0c6d76715dae'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:56.691064 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-cca698af-9476-4e89-ba59-72e93d46853b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fc7b6ca85924e30bddb0c6d76715dae'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:56.698270 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-cca698af-9476-4e89-ba59-72e93d46853b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fc7b6ca85924e30bddb0c6d76715dae'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:56.706140 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-cca698af-9476-4e89-ba59-72e93d46853b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fc7b6ca85924e30bddb0c6d76715dae'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:56.712041 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1394/2789] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:15:56 2021] DELETE /identity/v3/users/9fc7b6ca85924e30bddb0c6d76715dae => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:15:57.095808 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aee8d6-4214-4982-af61-5275927124ac admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:57.097274 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-b2aee8d6-4214-4982-af61-5275927124ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:57.110367 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aee8d6-4214-4982-af61-5275927124ac admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:57.177164 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9861b1-4f94-4adb-a79a-ea08c2e019ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:57.177958 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9861b1-4f94-4adb-a79a-ea08c2e019ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:57.178238 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9861b1-4f94-4adb-a79a-ea08c2e019ca admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:57.178512 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9861b1-4f94-4adb-a79a-ea08c2e019ca admin admin] PATH_INFO: `/v3/projects/469dfb07b7124801bd29a0637acd723d` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:57.179635 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9861b1-4f94-4adb-a79a-ea08c2e019ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=469dfb07b7124801bd29a0637acd723d)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:57.205652 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9861b1-4f94-4adb-a79a-ea08c2e019ca admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:57.260387 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-ac9861b1-4f94-4adb-a79a-ea08c2e019ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '469dfb07b7124801bd29a0637acd723d', 'request_id': 'req-ac9861b1-4f94-4adb-a79a-ea08c2e019ca'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:57.266319 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-ac9861b1-4f94-4adb-a79a-ea08c2e019ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '469dfb07b7124801bd29a0637acd723d', 'request_id': 'req-ac9861b1-4f94-4adb-a79a-ea08c2e019ca'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:57.278237 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-ac9861b1-4f94-4adb-a79a-ea08c2e019ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '469dfb07b7124801bd29a0637acd723d', 'request_id': 'req-ac9861b1-4f94-4adb-a79a-ea08c2e019ca'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:57.295771 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-ac9861b1-4f94-4adb-a79a-ea08c2e019ca admin admin] The token cache is being invalidate because project 469dfb07b7124801bd29a0637acd723d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:15:57.296058 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-ac9861b1-4f94-4adb-a79a-ea08c2e019ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:57.296716 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-ac9861b1-4f94-4adb-a79a-ea08c2e019ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:15:57.298469 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1396/2790] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:15:57 2021] DELETE /identity/v3/projects/469dfb07b7124801bd29a0637acd723d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:15:57.305273 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2b156-390a-4ee8-9212-ed6cefd92a31 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:57.305565 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2b156-390a-4ee8-9212-ed6cefd92a31 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:57.306155 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2b156-390a-4ee8-9212-ed6cefd92a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:57.331696 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-65f2b156-390a-4ee8-9212-ed6cefd92a31 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:15:57.333128 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-65f2b156-390a-4ee8-9212-ed6cefd92a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:57.401284 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1395/2791] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:15:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:15:57.410898 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae236f4-9c70-41a5-9cb1-fc6437761a07 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:57.411193 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae236f4-9c70-41a5-9cb1-fc6437761a07 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:57.411508 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae236f4-9c70-41a5-9cb1-fc6437761a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:57.434278 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-5ae236f4-9c70-41a5-9cb1-fc6437761a07 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:15:57.435468 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-5ae236f4-9c70-41a5-9cb1-fc6437761a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:57.443039 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1397/2792] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:15:57 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:15:57.447521 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2b156-390a-4ee8-9212-ed6cefd92a31 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:57.457389 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2b156-390a-4ee8-9212-ed6cefd92a31 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:57.462535 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16618a45-e801-4dfd-9586-8fefdcee4ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:57.463137 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16618a45-e801-4dfd-9586-8fefdcee4ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:57.463424 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16618a45-e801-4dfd-9586-8fefdcee4ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:57.463738 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16618a45-e801-4dfd-9586-8fefdcee4ca9 admin admin] PATH_INFO: `/v3/domains` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:57.464462 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16618a45-e801-4dfd-9586-8fefdcee4ca9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65984) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:15:57.465724 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16618a45-e801-4dfd-9586-8fefdcee4ca9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:57.490156 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16618a45-e801-4dfd-9586-8fefdcee4ca9 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:57.505373 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1396/2793] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:15:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:15:57.509885 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae236f4-9c70-41a5-9cb1-fc6437761a07 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:57.519564 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae236f4-9c70-41a5-9cb1-fc6437761a07 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:57.524174 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5a57a-49c9-43b3-bf52-3393dcd31089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:57.524767 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5a57a-49c9-43b3-bf52-3393dcd31089 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:57.525064 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5a57a-49c9-43b3-bf52-3393dcd31089 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:57.525339 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5a57a-49c9-43b3-bf52-3393dcd31089 admin admin] PATH_INFO: `/v3/projects` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:57.525992 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5a57a-49c9-43b3-bf52-3393dcd31089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:57.551419 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e5a57a-49c9-43b3-bf52-3393dcd31089 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:57.580577 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1398/2794] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:15:57 2021] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:15:57.584575 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16618a45-e801-4dfd-9586-8fefdcee4ca9 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:57.595719 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16618a45-e801-4dfd-9586-8fefdcee4ca9 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:57.660920 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5928f-897b-4e22-901a-6ce6b933d37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:57.661578 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5928f-897b-4e22-901a-6ce6b933d37e admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:57.661741 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5928f-897b-4e22-901a-6ce6b933d37e admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:57.662022 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5928f-897b-4e22-901a-6ce6b933d37e admin admin] PATH_INFO: `/v3/users` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:57.662673 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5928f-897b-4e22-901a-6ce6b933d37e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:57.689579 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5928f-897b-4e22-901a-6ce6b933d37e admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:57.711198 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1397/2795] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:15:57 2021] POST /identity/v3/users => generated 289 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 15:15:57.715369 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5a57a-49c9-43b3-bf52-3393dcd31089 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:57.725631 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5a57a-49c9-43b3-bf52-3393dcd31089 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:57.729998 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55fa6e-1888-4954-b79d-ccbc5f6437e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:57.730599 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55fa6e-1888-4954-b79d-ccbc5f6437e2 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:57.730887 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55fa6e-1888-4954-b79d-ccbc5f6437e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:57.731268 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55fa6e-1888-4954-b79d-ccbc5f6437e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:57.731951 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55fa6e-1888-4954-b79d-ccbc5f6437e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:57.759090 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55fa6e-1888-4954-b79d-ccbc5f6437e2 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:57.770147 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1399/2796] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:15:57 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 15:15:57.774782 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5928f-897b-4e22-901a-6ce6b933d37e admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:57.784385 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5928f-897b-4e22-901a-6ce6b933d37e admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:57.788594 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67ffbb-c2b3-4a78-a912-aba6882f4f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:57.789402 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67ffbb-c2b3-4a78-a912-aba6882f4f07 admin admin] REQUEST_METHOD: `PUT` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:57.789691 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67ffbb-c2b3-4a78-a912-aba6882f4f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:57.789968 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67ffbb-c2b3-4a78-a912-aba6882f4f07 admin admin] PATH_INFO: `/v3/projects/c28e24d23bab4942849c00bd3dd51012/users/b1d3fd0e878947bfad745b46f2d7d0d6/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:57.809755 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67ffbb-c2b3-4a78-a912-aba6882f4f07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c28e24d23bab4942849c00bd3dd51012, user_id=b1d3fd0e878947bfad745b46f2d7d0d6, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:57.836710 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67ffbb-c2b3-4a78-a912-aba6882f4f07 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:57.849945 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1398/2797] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:15:57 2021] PUT /identity/v3/projects/c28e24d23bab4942849c00bd3dd51012/users/b1d3fd0e878947bfad745b46f2d7d0d6/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:15:57.861612 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8702fbd-93f4-4178-93c3-8da1d7e8caa7 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:57.861886 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8702fbd-93f4-4178-93c3-8da1d7e8caa7 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:57.862177 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8702fbd-93f4-4178-93c3-8da1d7e8caa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:57.899212 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-e8702fbd-93f4-4178-93c3-8da1d7e8caa7 None None] MFA Rules not processed for user `b1d3fd0e878947bfad745b46f2d7d0d6`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:15:57.900408 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-e8702fbd-93f4-4178-93c3-8da1d7e8caa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:57.972075 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1400/2798] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:15:57 2021] POST /identity/v3/auth/tokens => generated 3684 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:15:57.982379 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67ffbb-c2b3-4a78-a912-aba6882f4f07 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:15:57.984012 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-8d67ffbb-c2b3-4a78-a912-aba6882f4f07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:15:58.049094 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67ffbb-c2b3-4a78-a912-aba6882f4f07 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:15:58.052543 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8413b3-810d-457b-8e09-bea46e6ec2df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:15:58.053127 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8413b3-810d-457b-8e09-bea46e6ec2df service cinder] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:15:58.053413 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8413b3-810d-457b-8e09-bea46e6ec2df service cinder] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:15:58.053692 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8413b3-810d-457b-8e09-bea46e6ec2df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:15:58.062584 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8413b3-810d-457b-8e09-bea46e6ec2df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:15:58.088192 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8413b3-810d-457b-8e09-bea46e6ec2df service cinder] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:15:58.098147 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1399/2799] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:15:57 2021] GET /identity/v3/auth/tokens => generated 3684 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:16:14.295063 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8702fbd-93f4-4178-93c3-8da1d7e8caa7 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:16:14.297173 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-e8702fbd-93f4-4178-93c3-8da1d7e8caa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:16:14.389018 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8702fbd-93f4-4178-93c3-8da1d7e8caa7 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:16:14.398879 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241c287-f9e5-427f-b94e-673d8275cfc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:16:14.399511 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241c287-f9e5-427f-b94e-673d8275cfc2 service nova] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:16:14.400326 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241c287-f9e5-427f-b94e-673d8275cfc2 service nova] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:16:14.400624 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3241c287-f9e5-427f-b94e-673d8275cfc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:16:14.402353 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-3241c287-f9e5-427f-b94e-673d8275cfc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:16:14.415771 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241c287-f9e5-427f-b94e-673d8275cfc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:16:14.440768 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3241c287-f9e5-427f-b94e-673d8275cfc2 service nova] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:16:14.453582 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1401/2800] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:16:14 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:16:14.554744 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8413b3-810d-457b-8e09-bea46e6ec2df service cinder] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:16:14.556225 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-af8413b3-810d-457b-8e09-bea46e6ec2df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:16:14.631243 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8413b3-810d-457b-8e09-bea46e6ec2df service cinder] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:16:14.636057 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628057b-965d-490c-bcdb-af7dde0fac5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:16:14.637160 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628057b-965d-490c-bcdb-af7dde0fac5c service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:16:14.637160 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628057b-965d-490c-bcdb-af7dde0fac5c service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:16:14.637461 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628057b-965d-490c-bcdb-af7dde0fac5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:16:14.641888 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-5628057b-965d-490c-bcdb-af7dde0fac5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:16:14.653365 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628057b-965d-490c-bcdb-af7dde0fac5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:16:14.679805 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5628057b-965d-490c-bcdb-af7dde0fac5c service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:16:14.690233 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1400/2801] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:16:14 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:16:17.449001 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241c287-f9e5-427f-b94e-673d8275cfc2 service nova] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:16:17.450586 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-3241c287-f9e5-427f-b94e-673d8275cfc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:16:17.465320 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3241c287-f9e5-427f-b94e-673d8275cfc2 service nova] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:16:17.472028 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c237d-d135-4ec6-9f23-6141a8fea96f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:16:17.472622 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c237d-d135-4ec6-9f23-6141a8fea96f service nova] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:16:17.473057 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c237d-d135-4ec6-9f23-6141a8fea96f service nova] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:16:17.473343 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c237d-d135-4ec6-9f23-6141a8fea96f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:16:17.476611 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-ba0c237d-d135-4ec6-9f23-6141a8fea96f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:16:17.491140 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c237d-d135-4ec6-9f23-6141a8fea96f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:16:17.525172 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c237d-d135-4ec6-9f23-6141a8fea96f service nova] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:16:17.537327 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1402/2802] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:16:17 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:16:19.463840 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628057b-965d-490c-bcdb-af7dde0fac5c service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:16:19.534911 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628057b-965d-490c-bcdb-af7dde0fac5c service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:16:19.539030 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe488e-04c4-4144-8703-751747fd9ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:16:19.539889 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe488e-04c4-4144-8703-751747fd9ced admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:16:19.540169 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe488e-04c4-4144-8703-751747fd9ced admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:16:19.540442 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe488e-04c4-4144-8703-751747fd9ced admin admin] PATH_INFO: `/v3/users/b1d3fd0e878947bfad745b46f2d7d0d6` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:16:19.541536 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe488e-04c4-4144-8703-751747fd9ced admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1d3fd0e878947bfad745b46f2d7d0d6)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:16:19.568090 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe488e-04c4-4144-8703-751747fd9ced admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:16:19.621330 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-2afe488e-04c4-4144-8703-751747fd9ced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1d3fd0e878947bfad745b46f2d7d0d6'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:16:19.633409 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-2afe488e-04c4-4144-8703-751747fd9ced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1d3fd0e878947bfad745b46f2d7d0d6'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:16:19.634073 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-2afe488e-04c4-4144-8703-751747fd9ced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1d3fd0e878947bfad745b46f2d7d0d6'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:16:19.641464 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-2afe488e-04c4-4144-8703-751747fd9ced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1d3fd0e878947bfad745b46f2d7d0d6'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:16:19.649864 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-2afe488e-04c4-4144-8703-751747fd9ced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1d3fd0e878947bfad745b46f2d7d0d6'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:16:19.655787 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1401/2803] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:16:19 2021] DELETE /identity/v3/users/b1d3fd0e878947bfad745b46f2d7d0d6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:16:19.660291 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e82d91-8886-424c-93a2-c316fe785a7a None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:16:19.660846 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e82d91-8886-424c-93a2-c316fe785a7a None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:16:19.660960 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e82d91-8886-424c-93a2-c316fe785a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:16:19.683962 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-55e82d91-8886-424c-93a2-c316fe785a7a None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:16:19.685115 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-55e82d91-8886-424c-93a2-c316fe785a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:16:19.768264 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1403/2804] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:16:19 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:16:19.778286 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe488e-04c4-4144-8703-751747fd9ced admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:16:19.780115 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-2afe488e-04c4-4144-8703-751747fd9ced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:16:19.846248 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe488e-04c4-4144-8703-751747fd9ced admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:16:19.849619 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effed00-7127-429d-be64-d0c31049634b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:16:19.850212 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effed00-7127-429d-be64-d0c31049634b service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:16:19.850498 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effed00-7127-429d-be64-d0c31049634b service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:16:19.850776 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effed00-7127-429d-be64-d0c31049634b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:16:19.862680 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effed00-7127-429d-be64-d0c31049634b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:16:19.887801 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effed00-7127-429d-be64-d0c31049634b service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:16:19.897892 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1402/2805] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:16:19 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:16:20.048625 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e82d91-8886-424c-93a2-c316fe785a7a None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:16:20.050030 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-55e82d91-8886-424c-93a2-c316fe785a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:16:20.061987 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e82d91-8886-424c-93a2-c316fe785a7a None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:16:20.065398 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f8346-3220-4fb8-ad99-2839d8fadb4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:16:20.066006 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f8346-3220-4fb8-ad99-2839d8fadb4b service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:16:20.066435 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f8346-3220-4fb8-ad99-2839d8fadb4b service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:16:20.066718 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f8346-3220-4fb8-ad99-2839d8fadb4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:16:20.068524 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-881f8346-3220-4fb8-ad99-2839d8fadb4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:16:20.081404 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f8346-3220-4fb8-ad99-2839d8fadb4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:16:20.107290 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881f8346-3220-4fb8-ad99-2839d8fadb4b service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:16:20.118375 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1404/2806] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:16:20 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:16:20.535857 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effed00-7127-429d-be64-d0c31049634b service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:16:20.537905 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-2effed00-7127-429d-be64-d0c31049634b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:16:20.551239 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effed00-7127-429d-be64-d0c31049634b service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:16:20.555627 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b5378-940b-454b-b21b-92f45a2ee8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:16:20.556606 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b5378-940b-454b-b21b-92f45a2ee8e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:16:20.556758 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b5378-940b-454b-b21b-92f45a2ee8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:16:20.557227 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b5378-940b-454b-b21b-92f45a2ee8e8 admin admin] PATH_INFO: `/v3/projects/c28e24d23bab4942849c00bd3dd51012` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:16:20.558790 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b5378-940b-454b-b21b-92f45a2ee8e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c28e24d23bab4942849c00bd3dd51012)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:16:20.587174 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b5378-940b-454b-b21b-92f45a2ee8e8 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:16:20.646901 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-0f7b5378-940b-454b-b21b-92f45a2ee8e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c28e24d23bab4942849c00bd3dd51012', 'request_id': 'req-0f7b5378-940b-454b-b21b-92f45a2ee8e8'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:16:20.652714 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-0f7b5378-940b-454b-b21b-92f45a2ee8e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c28e24d23bab4942849c00bd3dd51012', 'request_id': 'req-0f7b5378-940b-454b-b21b-92f45a2ee8e8'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:16:20.667642 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-0f7b5378-940b-454b-b21b-92f45a2ee8e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c28e24d23bab4942849c00bd3dd51012', 'request_id': 'req-0f7b5378-940b-454b-b21b-92f45a2ee8e8'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:16:20.684172 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-0f7b5378-940b-454b-b21b-92f45a2ee8e8 admin admin] The token cache is being invalidate because project c28e24d23bab4942849c00bd3dd51012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:16:20.684460 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-0f7b5378-940b-454b-b21b-92f45a2ee8e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:16:20.685092 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-0f7b5378-940b-454b-b21b-92f45a2ee8e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:16:20.686589 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1403/2807] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:16:20 2021] DELETE /identity/v3/projects/c28e24d23bab4942849c00bd3dd51012 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:16:20.693161 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf611cf6-b71a-4420-a551-fba3d3b9045c None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:16:20.693707 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf611cf6-b71a-4420-a551-fba3d3b9045c None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:16:20.693818 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf611cf6-b71a-4420-a551-fba3d3b9045c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:16:20.718322 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-cf611cf6-b71a-4420-a551-fba3d3b9045c None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:16:20.719492 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-cf611cf6-b71a-4420-a551-fba3d3b9045c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:16:20.790289 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1405/2808] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:16:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:16:20.798085 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad6723-aec1-4ad9-884a-5b0f485b0e00 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:16:20.798383 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad6723-aec1-4ad9-884a-5b0f485b0e00 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:16:20.798667 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad6723-aec1-4ad9-884a-5b0f485b0e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:16:20.822500 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-39ad6723-aec1-4ad9-884a-5b0f485b0e00 None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:16:20.823737 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-39ad6723-aec1-4ad9-884a-5b0f485b0e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:16:20.831248 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1404/2809] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:16:20 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:16:20.835591 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf611cf6-b71a-4420-a551-fba3d3b9045c None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:16:20.845023 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf611cf6-b71a-4420-a551-fba3d3b9045c None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:16:20.849115 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af3eb1-04e4-420b-91a6-d776448a4202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:16:20.849698 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af3eb1-04e4-420b-91a6-d776448a4202 admin admin] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:16:20.849982 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af3eb1-04e4-420b-91a6-d776448a4202 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:16:20.850256 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af3eb1-04e4-420b-91a6-d776448a4202 admin admin] PATH_INFO: `/v3/domains` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:16:20.850981 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af3eb1-04e4-420b-91a6-d776448a4202 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=65985) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:159}} Oct 27 15:16:20.851268 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af3eb1-04e4-420b-91a6-d776448a4202 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:16:20.876589 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af3eb1-04e4-420b-91a6-d776448a4202 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:16:20.889495 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1406/2810] 10.222.0.89 () {58 vars in 1152 bytes} [Wed Oct 27 15:16:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 15:16:20.894512 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad6723-aec1-4ad9-884a-5b0f485b0e00 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:16:20.903877 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad6723-aec1-4ad9-884a-5b0f485b0e00 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:16:20.908277 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cea70e-121f-4a01-a143-00f2ba2b8f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:16:20.908969 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cea70e-121f-4a01-a143-00f2ba2b8f62 admin admin] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:16:20.909328 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cea70e-121f-4a01-a143-00f2ba2b8f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:16:20.909680 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cea70e-121f-4a01-a143-00f2ba2b8f62 admin admin] PATH_INFO: `/v3/projects` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:16:20.910326 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cea70e-121f-4a01-a143-00f2ba2b8f62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:16:20.935592 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cea70e-121f-4a01-a143-00f2ba2b8f62 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:16:20.963645 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1405/2811] 10.222.0.89 () {60 vars in 1152 bytes} [Wed Oct 27 15:16:20 2021] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:16:20.967581 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af3eb1-04e4-420b-91a6-d776448a4202 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:16:20.976986 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af3eb1-04e4-420b-91a6-d776448a4202 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:16:21.039301 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e29055-194c-4f07-915d-850c500d8aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:16:21.039942 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e29055-194c-4f07-915d-850c500d8aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:16:21.040229 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e29055-194c-4f07-915d-850c500d8aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:16:21.040564 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e29055-194c-4f07-915d-850c500d8aa1 admin admin] PATH_INFO: `/v3/users` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:16:21.041152 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e29055-194c-4f07-915d-850c500d8aa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:16:21.067685 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e29055-194c-4f07-915d-850c500d8aa1 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:16:21.088644 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1407/2812] 10.222.0.89 () {60 vars in 1143 bytes} [Wed Oct 27 15:16:20 2021] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 15:16:21.093898 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cea70e-121f-4a01-a143-00f2ba2b8f62 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:16:21.106535 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cea70e-121f-4a01-a143-00f2ba2b8f62 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:16:21.111393 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7627d407-f680-4258-9270-b35b557297d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:16:21.112189 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627d407-f680-4258-9270-b35b557297d2 admin admin] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:16:21.112680 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627d407-f680-4258-9270-b35b557297d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:16:21.113184 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7627d407-f680-4258-9270-b35b557297d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:16:21.114466 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7627d407-f680-4258-9270-b35b557297d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:16:21.143544 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7627d407-f680-4258-9270-b35b557297d2 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:16:21.157764 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1406/2813] 10.222.0.89 () {58 vars in 1121 bytes} [Wed Oct 27 15:16:21 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 15:16:21.159029 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e29055-194c-4f07-915d-850c500d8aa1 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:16:21.168901 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e29055-194c-4f07-915d-850c500d8aa1 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:16:21.174748 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d24c80-3c9e-48d9-97e8-f349f5c55d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:16:21.175685 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d24c80-3c9e-48d9-97e8-f349f5c55d72 admin admin] REQUEST_METHOD: `PUT` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:16:21.176095 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d24c80-3c9e-48d9-97e8-f349f5c55d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:16:21.176386 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d24c80-3c9e-48d9-97e8-f349f5c55d72 admin admin] PATH_INFO: `/v3/projects/09991be7a76e481d8877bf1e0f27b34e/users/8f0c90dd661f4dacb09d1e4160f6b90a/roles/cb40c4204c4e49d8b874875a1a860a9c` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:16:21.198796 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d24c80-3c9e-48d9-97e8-f349f5c55d72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09991be7a76e481d8877bf1e0f27b34e, user_id=8f0c90dd661f4dacb09d1e4160f6b90a, role_id=cb40c4204c4e49d8b874875a1a860a9c)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:16:21.227224 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d24c80-3c9e-48d9-97e8-f349f5c55d72 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:16:21.245297 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1408/2814] 10.222.0.89 () {60 vars in 1482 bytes} [Wed Oct 27 15:16:21 2021] PUT /identity/v3/projects/09991be7a76e481d8877bf1e0f27b34e/users/8f0c90dd661f4dacb09d1e4160f6b90a/roles/cb40c4204c4e49d8b874875a1a860a9c => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:16:21.250974 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bf052-9417-4192-9b45-1b447ab09e3d None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:16:21.251271 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bf052-9417-4192-9b45-1b447ab09e3d None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:16:21.251642 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bf052-9417-4192-9b45-1b447ab09e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:16:21.275836 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-077bf052-9417-4192-9b45-1b447ab09e3d None None] MFA Rules not processed for user `99b1f8461d2e454c9cd6d6d3c9dc623c`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:16:21.277022 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-077bf052-9417-4192-9b45-1b447ab09e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:16:21.360253 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1407/2815] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:16:21 2021] POST /identity/v3/auth/tokens => generated 3669 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:16:21.370119 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d24c80-3c9e-48d9-97e8-f349f5c55d72 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:16:21.371712 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-f0d24c80-3c9e-48d9-97e8-f349f5c55d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:16:21.439643 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d24c80-3c9e-48d9-97e8-f349f5c55d72 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:16:21.442999 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a8e8f-e932-45d1-8437-7ffec26c69eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:16:21.443612 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a8e8f-e932-45d1-8437-7ffec26c69eb service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:16:21.443895 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a8e8f-e932-45d1-8437-7ffec26c69eb service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:16:21.444187 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949a8e8f-e932-45d1-8437-7ffec26c69eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:16:21.453246 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a8e8f-e932-45d1-8437-7ffec26c69eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:16:21.478279 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949a8e8f-e932-45d1-8437-7ffec26c69eb service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:16:21.488710 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1409/2816] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:16:21 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:16:22.337818 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb432f-5ee5-4b66-b250-ba1458a38578 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:16:22.338444 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb432f-5ee5-4b66-b250-ba1458a38578 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:16:22.338444 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb432f-5ee5-4b66-b250-ba1458a38578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:16:22.381456 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-49bb432f-5ee5-4b66-b250-ba1458a38578 None None] MFA Rules not processed for user `8f0c90dd661f4dacb09d1e4160f6b90a`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:16:22.382866 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-49bb432f-5ee5-4b66-b250-ba1458a38578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:16:22.464718 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1408/2817] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:16:22 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:16:22.475907 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a8e8f-e932-45d1-8437-7ffec26c69eb service neutron] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:16:22.477878 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-949a8e8f-e932-45d1-8437-7ffec26c69eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:16:22.549908 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949a8e8f-e932-45d1-8437-7ffec26c69eb service neutron] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:16:22.553511 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5223e5-2842-46da-a9e7-b1afa0413f60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fca8f0282ea40ce9b378260b95b3d01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:16:22.554103 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5223e5-2842-46da-a9e7-b1afa0413f60 service cinder] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:16:22.554595 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5223e5-2842-46da-a9e7-b1afa0413f60 service cinder] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:16:22.556938 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5223e5-2842-46da-a9e7-b1afa0413f60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:16:22.564698 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5223e5-2842-46da-a9e7-b1afa0413f60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:16:22.590374 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5223e5-2842-46da-a9e7-b1afa0413f60 service cinder] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:16:22.602272 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1410/2818] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:16:22 2021] GET /identity/v3/auth/tokens => generated 3680 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 15:16:24.194389 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310245d-80f1-4c0b-a4d6-3002a62ebbe5 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:16:24.194938 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310245d-80f1-4c0b-a4d6-3002a62ebbe5 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:16:24.194938 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310245d-80f1-4c0b-a4d6-3002a62ebbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:16:24.221185 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-0310245d-80f1-4c0b-a4d6-3002a62ebbe5 None None] MFA Rules not processed for user `8f0c90dd661f4dacb09d1e4160f6b90a`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:16:24.222390 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-0310245d-80f1-4c0b-a4d6-3002a62ebbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:16:24.235007 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1409/2819] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:16:24 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:16:24.877924 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5223e5-2842-46da-a9e7-b1afa0413f60 service cinder] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:16:24.887940 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5223e5-2842-46da-a9e7-b1afa0413f60 service cinder] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:16:24.891692 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7591c9-f816-4759-bb89-21dd32eb5ef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:16:24.892468 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7591c9-f816-4759-bb89-21dd32eb5ef7 service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:16:24.892913 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7591c9-f816-4759-bb89-21dd32eb5ef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:16:24.893256 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7591c9-f816-4759-bb89-21dd32eb5ef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:16:24.894981 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-5a7591c9-f816-4759-bb89-21dd32eb5ef7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:16:24.905668 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7591c9-f816-4759-bb89-21dd32eb5ef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:16:24.931005 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7591c9-f816-4759-bb89-21dd32eb5ef7 service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:16:24.940183 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1411/2820] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:16:24 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:16:25.777491 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310245d-80f1-4c0b-a4d6-3002a62ebbe5 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:16:25.778975 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-0310245d-80f1-4c0b-a4d6-3002a62ebbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:16:25.880912 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310245d-80f1-4c0b-a4d6-3002a62ebbe5 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:16:25.885567 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6638f00-b508-4310-a7ca-5c1dad9ee596 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcbab075fd5b4a889c2002639ca9d60a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:16:25.886197 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6638f00-b508-4310-a7ca-5c1dad9ee596 service placement] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:16:25.886491 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6638f00-b508-4310-a7ca-5c1dad9ee596 service placement] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:16:25.886772 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6638f00-b508-4310-a7ca-5c1dad9ee596 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:16:25.888488 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-b6638f00-b508-4310-a7ca-5c1dad9ee596 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:16:25.900758 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6638f00-b508-4310-a7ca-5c1dad9ee596 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:16:25.928032 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6638f00-b508-4310-a7ca-5c1dad9ee596 service placement] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:16:25.939217 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1410/2821] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:16:25 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:16:26.048659 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7591c9-f816-4759-bb89-21dd32eb5ef7 service neutron] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:16:26.050097 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-5a7591c9-f816-4759-bb89-21dd32eb5ef7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:16:26.064659 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7591c9-f816-4759-bb89-21dd32eb5ef7 service neutron] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:16:26.069302 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbea7c-c7e6-43e3-b2dc-2466b20c8a22 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcbab075fd5b4a889c2002639ca9d60a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:16:26.069963 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbea7c-c7e6-43e3-b2dc-2466b20c8a22 service placement] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:16:26.070259 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbea7c-c7e6-43e3-b2dc-2466b20c8a22 service placement] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:16:26.070543 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbbea7c-c7e6-43e3-b2dc-2466b20c8a22 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:16:26.072254 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-7bbbea7c-c7e6-43e3-b2dc-2466b20c8a22 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:16:26.083754 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbea7c-c7e6-43e3-b2dc-2466b20c8a22 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:16:26.110306 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbbea7c-c7e6-43e3-b2dc-2466b20c8a22 service placement] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:16:26.120984 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1412/2822] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:16:26 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:16:33.484697 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6638f00-b508-4310-a7ca-5c1dad9ee596 service placement] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:16:33.486145 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-b6638f00-b508-4310-a7ca-5c1dad9ee596 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:16:33.498776 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6638f00-b508-4310-a7ca-5c1dad9ee596 service placement] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:16:33.503605 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a936945-34f7-4f76-9357-a93563f3fec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:16:33.504522 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a936945-34f7-4f76-9357-a93563f3fec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:16:33.504882 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a936945-34f7-4f76-9357-a93563f3fec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:16:33.505234 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a936945-34f7-4f76-9357-a93563f3fec5 admin admin] PATH_INFO: `/v3/users/4edc4c662d2948e083a04c001cff47f1` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:16:33.506414 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a936945-34f7-4f76-9357-a93563f3fec5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4edc4c662d2948e083a04c001cff47f1)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:16:33.533298 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a936945-34f7-4f76-9357-a93563f3fec5 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:16:33.587317 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-0a936945-34f7-4f76-9357-a93563f3fec5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4edc4c662d2948e083a04c001cff47f1'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:16:33.598708 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-0a936945-34f7-4f76-9357-a93563f3fec5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4edc4c662d2948e083a04c001cff47f1'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:16:33.599384 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-0a936945-34f7-4f76-9357-a93563f3fec5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4edc4c662d2948e083a04c001cff47f1'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:16:33.608910 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-0a936945-34f7-4f76-9357-a93563f3fec5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4edc4c662d2948e083a04c001cff47f1'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:16:33.617246 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-0a936945-34f7-4f76-9357-a93563f3fec5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4edc4c662d2948e083a04c001cff47f1'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:16:33.623129 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1411/2823] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:16:33 2021] DELETE /identity/v3/users/4edc4c662d2948e083a04c001cff47f1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 15:16:33.854534 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbea7c-c7e6-43e3-b2dc-2466b20c8a22 service placement] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:16:33.865773 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbbea7c-c7e6-43e3-b2dc-2466b20c8a22 service placement] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:16:33.930189 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01895086-2877-4bbf-8047-918a4213147a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:16:33.931000 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01895086-2877-4bbf-8047-918a4213147a admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:16:33.931290 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01895086-2877-4bbf-8047-918a4213147a admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:16:33.931602 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01895086-2877-4bbf-8047-918a4213147a admin admin] PATH_INFO: `/v3/projects/d220deb2c33140c686078aa4d9dca760` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:16:33.932720 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01895086-2877-4bbf-8047-918a4213147a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d220deb2c33140c686078aa4d9dca760)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:16:33.958951 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01895086-2877-4bbf-8047-918a4213147a admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:16:34.011704 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-01895086-2877-4bbf-8047-918a4213147a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd220deb2c33140c686078aa4d9dca760', 'request_id': 'req-01895086-2877-4bbf-8047-918a4213147a'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:16:34.016668 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-01895086-2877-4bbf-8047-918a4213147a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd220deb2c33140c686078aa4d9dca760', 'request_id': 'req-01895086-2877-4bbf-8047-918a4213147a'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:16:34.028410 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-01895086-2877-4bbf-8047-918a4213147a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd220deb2c33140c686078aa4d9dca760', 'request_id': 'req-01895086-2877-4bbf-8047-918a4213147a'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:16:34.046760 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-01895086-2877-4bbf-8047-918a4213147a admin admin] The token cache is being invalidate because project d220deb2c33140c686078aa4d9dca760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:16:34.047053 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-01895086-2877-4bbf-8047-918a4213147a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:16:34.048072 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-01895086-2877-4bbf-8047-918a4213147a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:16:34.049516 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1413/2824] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:16:33 2021] DELETE /identity/v3/projects/d220deb2c33140c686078aa4d9dca760 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:16:34.053832 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a936945-34f7-4f76-9357-a93563f3fec5 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:16:34.055180 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-0a936945-34f7-4f76-9357-a93563f3fec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:16:34.068148 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a936945-34f7-4f76-9357-a93563f3fec5 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:16:34.133051 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c66692-4ae1-4247-82af-bb325bff8183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:16:34.133769 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c66692-4ae1-4247-82af-bb325bff8183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:16:34.134053 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c66692-4ae1-4247-82af-bb325bff8183 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:16:34.134336 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c66692-4ae1-4247-82af-bb325bff8183 admin admin] PATH_INFO: `/v3/users/5d0ed1111aaa448cbdbee3edaba99089` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:16:34.135481 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c66692-4ae1-4247-82af-bb325bff8183 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d0ed1111aaa448cbdbee3edaba99089)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:16:34.161662 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c66692-4ae1-4247-82af-bb325bff8183 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:16:34.210859 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-92c66692-4ae1-4247-82af-bb325bff8183 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d0ed1111aaa448cbdbee3edaba99089'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:16:34.223381 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-92c66692-4ae1-4247-82af-bb325bff8183 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d0ed1111aaa448cbdbee3edaba99089'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:16:34.226142 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-92c66692-4ae1-4247-82af-bb325bff8183 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d0ed1111aaa448cbdbee3edaba99089'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:16:34.233137 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-92c66692-4ae1-4247-82af-bb325bff8183 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d0ed1111aaa448cbdbee3edaba99089'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:16:34.241867 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-92c66692-4ae1-4247-82af-bb325bff8183 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d0ed1111aaa448cbdbee3edaba99089'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:16:34.247754 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1412/2825] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:16:34 2021] DELETE /identity/v3/users/5d0ed1111aaa448cbdbee3edaba99089 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:16:34.571399 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01895086-2877-4bbf-8047-918a4213147a admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:16:34.572788 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-01895086-2877-4bbf-8047-918a4213147a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:16:34.588470 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01895086-2877-4bbf-8047-918a4213147a admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:16:34.671806 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c633f7-03c9-4e90-bfc5-4a8332f040c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:16:34.672935 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c633f7-03c9-4e90-bfc5-4a8332f040c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:16:34.673636 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c633f7-03c9-4e90-bfc5-4a8332f040c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:16:34.674301 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c633f7-03c9-4e90-bfc5-4a8332f040c3 admin admin] PATH_INFO: `/v3/projects/642b9302784d4e77a394768cab836462` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:16:34.676385 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c633f7-03c9-4e90-bfc5-4a8332f040c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=642b9302784d4e77a394768cab836462)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:16:34.704672 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c633f7-03c9-4e90-bfc5-4a8332f040c3 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:16:34.762987 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-13c633f7-03c9-4e90-bfc5-4a8332f040c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '642b9302784d4e77a394768cab836462', 'request_id': 'req-13c633f7-03c9-4e90-bfc5-4a8332f040c3'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:16:34.769330 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-13c633f7-03c9-4e90-bfc5-4a8332f040c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '642b9302784d4e77a394768cab836462', 'request_id': 'req-13c633f7-03c9-4e90-bfc5-4a8332f040c3'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:16:34.781930 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-13c633f7-03c9-4e90-bfc5-4a8332f040c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '642b9302784d4e77a394768cab836462', 'request_id': 'req-13c633f7-03c9-4e90-bfc5-4a8332f040c3'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:16:34.798550 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-13c633f7-03c9-4e90-bfc5-4a8332f040c3 admin admin] The token cache is being invalidate because project 642b9302784d4e77a394768cab836462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:16:34.798972 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-13c633f7-03c9-4e90-bfc5-4a8332f040c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:16:34.799949 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-13c633f7-03c9-4e90-bfc5-4a8332f040c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:16:34.802002 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1414/2826] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:16:34 2021] DELETE /identity/v3/projects/642b9302784d4e77a394768cab836462 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:16:41.925281 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fd95e-e0d3-45c7-9748-4439ce446d86 None None] REQUEST_METHOD: `POST` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:16:41.925905 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fd95e-e0d3-45c7-9748-4439ce446d86 None None] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:16:41.925905 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fd95e-e0d3-45c7-9748-4439ce446d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:16:41.948698 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.auth.core [None req-628fd95e-e0d3-45c7-9748-4439ce446d86 None None] MFA Rules not processed for user `8f0c90dd661f4dacb09d1e4160f6b90a`. Rule list: `[]` (Enabled: `True`). {{(pid=65984) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:16:41.949878 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-628fd95e-e0d3-45c7-9748-4439ce446d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:16:42.013534 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1413/2827] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:16:41 2021] POST /identity/v3/auth/tokens => generated 3680 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:17:03.020030 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8793da-52b9-4a74-9ef3-71dbf252c1f3 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:17:03.020562 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8793da-52b9-4a74-9ef3-71dbf252c1f3 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:17:03.020651 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8793da-52b9-4a74-9ef3-71dbf252c1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:17:03.044664 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-2d8793da-52b9-4a74-9ef3-71dbf252c1f3 None None] MFA Rules not processed for user `ed972e6b35be47a8af2e86651ccc6911`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:17:03.045789 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-2d8793da-52b9-4a74-9ef3-71dbf252c1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:17:03.105510 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1415/2828] 10.222.0.89 () {58 vars in 1014 bytes} [Wed Oct 27 15:17:03 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:17:03.157925 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628fd95e-e0d3-45c7-9748-4439ce446d86 None None] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:17:03.159344 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-628fd95e-e0d3-45c7-9748-4439ce446d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:17:03.234567 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628fd95e-e0d3-45c7-9748-4439ce446d86 None None] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:17:03.239143 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69963d6f-3693-4860-868e-0ed17fe1e091 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffba82bc9ddf42069a813b932bd310ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:17:03.239767 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69963d6f-3693-4860-868e-0ed17fe1e091 service swift] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:17:03.240079 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69963d6f-3693-4860-868e-0ed17fe1e091 service swift] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:17:03.240362 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69963d6f-3693-4860-868e-0ed17fe1e091 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:17:03.248894 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69963d6f-3693-4860-868e-0ed17fe1e091 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:17:03.275334 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69963d6f-3693-4860-868e-0ed17fe1e091 service swift] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:17:03.284510 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1414/2829] 10.222.0.89 () {60 vars in 1384 bytes} [Wed Oct 27 15:17:03 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 15:17:21.060882 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfebb5-001d-4f63-8005-cd21a130eea3 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:17:21.061396 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfebb5-001d-4f63-8005-cd21a130eea3 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:17:21.061509 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bfebb5-001d-4f63-8005-cd21a130eea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:17:21.083647 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-f5bfebb5-001d-4f63-8005-cd21a130eea3 None None] MFA Rules not processed for user `ed972e6b35be47a8af2e86651ccc6911`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:17:21.084740 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-f5bfebb5-001d-4f63-8005-cd21a130eea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:17:21.090896 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1416/2830] 10.222.0.89 () {58 vars in 967 bytes} [Wed Oct 27 15:17:21 2021] POST /identity/v3/auth/tokens => generated 3625 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:17:21.104012 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69963d6f-3693-4860-868e-0ed17fe1e091 service swift] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:17:21.113774 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69963d6f-3693-4860-868e-0ed17fe1e091 service swift] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:17:21.118342 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5179bc0-4b8c-4580-8730-303ab6a16721 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ffba82bc9ddf42069a813b932bd310ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:17:21.118909 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5179bc0-4b8c-4580-8730-303ab6a16721 service swift] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:17:21.119199 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5179bc0-4b8c-4580-8730-303ab6a16721 service swift] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:17:21.119510 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5179bc0-4b8c-4580-8730-303ab6a16721 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:17:21.128016 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5179bc0-4b8c-4580-8730-303ab6a16721 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:17:21.153840 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5179bc0-4b8c-4580-8730-303ab6a16721 service swift] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:17:21.161610 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1415/2831] 10.222.0.89 () {60 vars in 1384 bytes} [Wed Oct 27 15:17:21 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 15:17:23.444384 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfebb5-001d-4f63-8005-cd21a130eea3 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:17:23.445705 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-f5bfebb5-001d-4f63-8005-cd21a130eea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:17:23.514553 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bfebb5-001d-4f63-8005-cd21a130eea3 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:17:23.518978 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708b5d55-085f-4634-b713-ca688e8bd17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:17:23.519907 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b5d55-085f-4634-b713-ca688e8bd17b admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:17:23.520194 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b5d55-085f-4634-b713-ca688e8bd17b admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:17:23.520471 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b5d55-085f-4634-b713-ca688e8bd17b admin admin] PATH_INFO: `/v3/users/8f0c90dd661f4dacb09d1e4160f6b90a` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:17:23.521823 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b5d55-085f-4634-b713-ca688e8bd17b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f0c90dd661f4dacb09d1e4160f6b90a)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:17:23.547584 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708b5d55-085f-4634-b713-ca688e8bd17b admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:17:23.595871 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-708b5d55-085f-4634-b713-ca688e8bd17b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f0c90dd661f4dacb09d1e4160f6b90a'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:17:23.596517 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-708b5d55-085f-4634-b713-ca688e8bd17b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f0c90dd661f4dacb09d1e4160f6b90a'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:17:23.608123 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-708b5d55-085f-4634-b713-ca688e8bd17b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f0c90dd661f4dacb09d1e4160f6b90a'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:17:23.615207 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-708b5d55-085f-4634-b713-ca688e8bd17b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f0c90dd661f4dacb09d1e4160f6b90a'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:17:23.624001 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-708b5d55-085f-4634-b713-ca688e8bd17b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f0c90dd661f4dacb09d1e4160f6b90a'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:17:23.630044 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1417/2832] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:17:23 2021] DELETE /identity/v3/users/8f0c90dd661f4dacb09d1e4160f6b90a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:17:23.975154 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5179bc0-4b8c-4580-8730-303ab6a16721 service swift] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:17:23.985045 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5179bc0-4b8c-4580-8730-303ab6a16721 service swift] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:17:24.048509 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed3723-d241-4da3-a4ac-081f62dc309c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:17:24.049324 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed3723-d241-4da3-a4ac-081f62dc309c admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:17:24.049617 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed3723-d241-4da3-a4ac-081f62dc309c admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:17:24.049897 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed3723-d241-4da3-a4ac-081f62dc309c admin admin] PATH_INFO: `/v3/projects/09991be7a76e481d8877bf1e0f27b34e` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:17:24.050979 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed3723-d241-4da3-a4ac-081f62dc309c admin admin] RBAC: Authorizing `identity:delete_project(project_id=09991be7a76e481d8877bf1e0f27b34e)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:17:24.077774 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed3723-d241-4da3-a4ac-081f62dc309c admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:17:24.126884 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-7eed3723-d241-4da3-a4ac-081f62dc309c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09991be7a76e481d8877bf1e0f27b34e', 'request_id': 'req-7eed3723-d241-4da3-a4ac-081f62dc309c'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:17:24.131952 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-7eed3723-d241-4da3-a4ac-081f62dc309c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09991be7a76e481d8877bf1e0f27b34e', 'request_id': 'req-7eed3723-d241-4da3-a4ac-081f62dc309c'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:17:24.143960 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-7eed3723-d241-4da3-a4ac-081f62dc309c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09991be7a76e481d8877bf1e0f27b34e', 'request_id': 'req-7eed3723-d241-4da3-a4ac-081f62dc309c'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:17:24.156259 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-7eed3723-d241-4da3-a4ac-081f62dc309c admin admin] The token cache is being invalidate because project 09991be7a76e481d8877bf1e0f27b34e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65984) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:17:24.156625 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-7eed3723-d241-4da3-a4ac-081f62dc309c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:17:24.157210 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-7eed3723-d241-4da3-a4ac-081f62dc309c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:17:24.158612 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1416/2833] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:17:23 2021] DELETE /identity/v3/projects/09991be7a76e481d8877bf1e0f27b34e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:17:47.955734 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e370e-cac6-4d7d-b1d9-4292880150f5 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:17:47.956268 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e370e-cac6-4d7d-b1d9-4292880150f5 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:17:47.956374 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e370e-cac6-4d7d-b1d9-4292880150f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:17:47.990305 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-f05e370e-cac6-4d7d-b1d9-4292880150f5 None None] MFA Rules not processed for user `5aea8e2505884cc8a191f2ad70a142fc`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:17:47.991608 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-f05e370e-cac6-4d7d-b1d9-4292880150f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:17:48.052018 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1418/2834] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:17:47 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:17:48.522178 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed3723-d241-4da3-a4ac-081f62dc309c admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:17:48.523653 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-7eed3723-d241-4da3-a4ac-081f62dc309c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:17:48.587684 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed3723-d241-4da3-a4ac-081f62dc309c admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:17:48.591217 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56195e92-abd2-4c6b-9094-98f3c44eec07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:17:48.591837 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56195e92-abd2-4c6b-9094-98f3c44eec07 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:17:48.592130 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56195e92-abd2-4c6b-9094-98f3c44eec07 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:17:48.592414 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56195e92-abd2-4c6b-9094-98f3c44eec07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:17:48.594074 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-56195e92-abd2-4c6b-9094-98f3c44eec07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:17:48.603405 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56195e92-abd2-4c6b-9094-98f3c44eec07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:17:48.629168 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56195e92-abd2-4c6b-9094-98f3c44eec07 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:17:48.640508 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1417/2835] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:17:48 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:18:03.329567 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e370e-cac6-4d7d-b1d9-4292880150f5 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:18:03.331205 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-f05e370e-cac6-4d7d-b1d9-4292880150f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:18:03.461941 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e370e-cac6-4d7d-b1d9-4292880150f5 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:18:03.467032 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3878e3-3d17-4734-af1b-342e08d233dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:18:03.467635 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3878e3-3d17-4734-af1b-342e08d233dc service nova] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:18:03.467924 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3878e3-3d17-4734-af1b-342e08d233dc service nova] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:18:03.468201 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3878e3-3d17-4734-af1b-342e08d233dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:18:03.469853 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-8b3878e3-3d17-4734-af1b-342e08d233dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:18:03.481424 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3878e3-3d17-4734-af1b-342e08d233dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:18:03.506716 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3878e3-3d17-4734-af1b-342e08d233dc service nova] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:18:03.516871 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1419/2836] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:18:03 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:19:27.014010 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56195e92-abd2-4c6b-9094-98f3c44eec07 service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:19:27.018187 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-56195e92-abd2-4c6b-9094-98f3c44eec07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:19:27.136674 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56195e92-abd2-4c6b-9094-98f3c44eec07 service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:19:27.141439 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf9246-c6d2-4f63-bbe2-7fcd92c7d066 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcbab075fd5b4a889c2002639ca9d60a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:19:27.142064 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf9246-c6d2-4f63-bbe2-7fcd92c7d066 service placement] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:19:27.142372 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf9246-c6d2-4f63-bbe2-7fcd92c7d066 service placement] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:19:27.142665 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf9246-c6d2-4f63-bbe2-7fcd92c7d066 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:19:27.144420 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-f5cf9246-c6d2-4f63-bbe2-7fcd92c7d066 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:19:27.155590 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf9246-c6d2-4f63-bbe2-7fcd92c7d066 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:19:27.185476 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf9246-c6d2-4f63-bbe2-7fcd92c7d066 service placement] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:19:27.196461 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1418/2837] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:19:27 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:19:46.383683 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6d91e-8aef-435b-b690-ebd497d9b066 None None] REQUEST_METHOD: `POST` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:19:46.384275 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6d91e-8aef-435b-b690-ebd497d9b066 None None] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:19:46.384275 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6d91e-8aef-435b-b690-ebd497d9b066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:19:46.407215 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.auth.core [None req-2ca6d91e-8aef-435b-b690-ebd497d9b066 None None] MFA Rules not processed for user `5aea8e2505884cc8a191f2ad70a142fc`. Rule list: `[]` (Enabled: `True`). {{(pid=65985) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 15:19:46.408463 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-2ca6d91e-8aef-435b-b690-ebd497d9b066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:19:46.415214 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1420/2838] 10.222.0.89 () {58 vars in 957 bytes} [Wed Oct 27 15:19:46 2021] POST /identity/v3/auth/tokens => generated 3682 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 15:19:54.163152 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf9246-c6d2-4f63-bbe2-7fcd92c7d066 service placement] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:19:54.183961 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf9246-c6d2-4f63-bbe2-7fcd92c7d066 service placement] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:19:54.187278 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051bef0-d611-4780-82db-106a8d43546b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:19:54.187880 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051bef0-d611-4780-82db-106a8d43546b service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:19:54.188162 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051bef0-d611-4780-82db-106a8d43546b service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:19:54.188438 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8051bef0-d611-4780-82db-106a8d43546b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:19:54.190255 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-8051bef0-d611-4780-82db-106a8d43546b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:19:54.201860 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051bef0-d611-4780-82db-106a8d43546b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:19:54.227502 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8051bef0-d611-4780-82db-106a8d43546b service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:19:54.237005 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1419/2839] 10.222.0.89 () {60 vars in 1396 bytes} [Wed Oct 27 15:19:54 2021] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3682 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:21:28.645489 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6d91e-8aef-435b-b690-ebd497d9b066 None None] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:21:28.655040 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6d91e-8aef-435b-b690-ebd497d9b066 None None] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:21:28.658386 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a52a1b-b8fd-4107-b5aa-11cb6a5fe7bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:21:28.658958 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a52a1b-b8fd-4107-b5aa-11cb6a5fe7bd service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:21:28.659245 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a52a1b-b8fd-4107-b5aa-11cb6a5fe7bd service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:21:28.659560 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a52a1b-b8fd-4107-b5aa-11cb6a5fe7bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:21:28.661226 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-72a52a1b-b8fd-4107-b5aa-11cb6a5fe7bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:21:28.687825 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a52a1b-b8fd-4107-b5aa-11cb6a5fe7bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:21:28.712974 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a52a1b-b8fd-4107-b5aa-11cb6a5fe7bd service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:21:28.721560 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1421/2840] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:21:28 2021] GET /identity/v3/auth/tokens => generated 3551 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:21:52.549344 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051bef0-d611-4780-82db-106a8d43546b service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:21:52.550799 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-8051bef0-d611-4780-82db-106a8d43546b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:21:52.612800 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8051bef0-d611-4780-82db-106a8d43546b service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:21:52.620866 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4cb32f-f6c1-4f74-96fa-17c3adb61c91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '01acdb65e66441418d4abe1f0ed804bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:21:52.621594 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cb32f-f6c1-4f74-96fa-17c3adb61c91 service nova] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:21:52.621885 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cb32f-f6c1-4f74-96fa-17c3adb61c91 service nova] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:21:52.622162 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4cb32f-f6c1-4f74-96fa-17c3adb61c91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:21:52.624109 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-3e4cb32f-f6c1-4f74-96fa-17c3adb61c91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:21:52.636609 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4cb32f-f6c1-4f74-96fa-17c3adb61c91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:21:52.662694 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4cb32f-f6c1-4f74-96fa-17c3adb61c91 service nova] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:21:52.674262 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1420/2841] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:21:52 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:21:52.905011 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a52a1b-b8fd-4107-b5aa-11cb6a5fe7bd service neutron] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:21:52.906369 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-72a52a1b-b8fd-4107-b5aa-11cb6a5fe7bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:21:52.917260 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a52a1b-b8fd-4107-b5aa-11cb6a5fe7bd service neutron] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:21:52.922531 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd626028-01a0-424a-9c91-91464c787d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:21:52.924058 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd626028-01a0-424a-9c91-91464c787d76 service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:21:52.924345 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd626028-01a0-424a-9c91-91464c787d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:21:52.924616 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd626028-01a0-424a-9c91-91464c787d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:21:52.939495 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd626028-01a0-424a-9c91-91464c787d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:21:52.965513 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd626028-01a0-424a-9c91-91464c787d76 service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:21:52.977243 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1422/2842] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:21:52 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:21:54.236644 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4cb32f-f6c1-4f74-96fa-17c3adb61c91 service nova] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:21:54.248693 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4cb32f-f6c1-4f74-96fa-17c3adb61c91 service nova] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:21:54.253919 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd269e-70c7-4213-afea-2c8014de9c39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:21:54.254867 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd269e-70c7-4213-afea-2c8014de9c39 service neutron] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:21:54.255333 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd269e-70c7-4213-afea-2c8014de9c39 service neutron] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:21:54.255829 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dd269e-70c7-4213-afea-2c8014de9c39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:21:54.270172 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd269e-70c7-4213-afea-2c8014de9c39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:21:54.295206 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dd269e-70c7-4213-afea-2c8014de9c39 service neutron] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:21:54.306322 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1421/2843] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:21:54 2021] GET /identity/v3/auth/tokens => generated 3802 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:22:07.372548 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd626028-01a0-424a-9c91-91464c787d76 service neutron] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:22:07.381260 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd626028-01a0-424a-9c91-91464c787d76 service neutron] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:22:07.385342 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab66611-4b70-4b17-85d3-12c671097816 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab1b41f8980348fc878e492e26078e33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:22:07.385909 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab66611-4b70-4b17-85d3-12c671097816 service neutron] REQUEST_METHOD: `GET` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:22:07.386191 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab66611-4b70-4b17-85d3-12c671097816 service neutron] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:22:07.386468 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab66611-4b70-4b17-85d3-12c671097816 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:22:07.388158 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-dab66611-4b70-4b17-85d3-12c671097816 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:22:07.492196 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab66611-4b70-4b17-85d3-12c671097816 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:22:07.518377 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab66611-4b70-4b17-85d3-12c671097816 service neutron] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:22:07.546683 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1423/2844] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:22:07 2021] GET /identity/v3/auth/tokens => generated 3669 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 15:22:19.063270 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd269e-70c7-4213-afea-2c8014de9c39 service neutron] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:22:19.064678 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-16dd269e-70c7-4213-afea-2c8014de9c39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:22:19.078030 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dd269e-70c7-4213-afea-2c8014de9c39 service neutron] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:22:19.082578 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c7008-991c-4ceb-a8d6-6a4b2ea3617b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:22:19.083410 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c7008-991c-4ceb-a8d6-6a4b2ea3617b admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:22:19.083726 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c7008-991c-4ceb-a8d6-6a4b2ea3617b admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:22:19.084176 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c7008-991c-4ceb-a8d6-6a4b2ea3617b admin admin] PATH_INFO: `/v3/users/5aea8e2505884cc8a191f2ad70a142fc` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:22:19.084176 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c7008-991c-4ceb-a8d6-6a4b2ea3617b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aea8e2505884cc8a191f2ad70a142fc)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:22:19.111346 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c7008-991c-4ceb-a8d6-6a4b2ea3617b admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:22:19.172960 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-6f3c7008-991c-4ceb-a8d6-6a4b2ea3617b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aea8e2505884cc8a191f2ad70a142fc'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:22:19.186174 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-6f3c7008-991c-4ceb-a8d6-6a4b2ea3617b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aea8e2505884cc8a191f2ad70a142fc'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:22:19.187145 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-6f3c7008-991c-4ceb-a8d6-6a4b2ea3617b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aea8e2505884cc8a191f2ad70a142fc'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:22:19.196472 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-6f3c7008-991c-4ceb-a8d6-6a4b2ea3617b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aea8e2505884cc8a191f2ad70a142fc'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:22:19.204271 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-6f3c7008-991c-4ceb-a8d6-6a4b2ea3617b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aea8e2505884cc8a191f2ad70a142fc'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:22:19.210008 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1422/2845] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:22:19 2021] DELETE /identity/v3/users/5aea8e2505884cc8a191f2ad70a142fc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:22:19.476397 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab66611-4b70-4b17-85d3-12c671097816 service neutron] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:22:19.492827 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab66611-4b70-4b17-85d3-12c671097816 service neutron] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:22:19.555652 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27040e45-c793-46b7-af90-1d10de8be1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:22:19.556467 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27040e45-c793-46b7-af90-1d10de8be1b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:22:19.556774 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27040e45-c793-46b7-af90-1d10de8be1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:22:19.557053 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27040e45-c793-46b7-af90-1d10de8be1b1 admin admin] PATH_INFO: `/v3/projects/fa7e2b9a0ba0465681b2e222f259d8ff` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:22:19.558109 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27040e45-c793-46b7-af90-1d10de8be1b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa7e2b9a0ba0465681b2e222f259d8ff)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:22:19.583352 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27040e45-c793-46b7-af90-1d10de8be1b1 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:22:19.630960 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-27040e45-c793-46b7-af90-1d10de8be1b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa7e2b9a0ba0465681b2e222f259d8ff', 'request_id': 'req-27040e45-c793-46b7-af90-1d10de8be1b1'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:22:19.635770 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-27040e45-c793-46b7-af90-1d10de8be1b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa7e2b9a0ba0465681b2e222f259d8ff', 'request_id': 'req-27040e45-c793-46b7-af90-1d10de8be1b1'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:22:19.646922 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-27040e45-c793-46b7-af90-1d10de8be1b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa7e2b9a0ba0465681b2e222f259d8ff', 'request_id': 'req-27040e45-c793-46b7-af90-1d10de8be1b1'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:22:19.658469 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-27040e45-c793-46b7-af90-1d10de8be1b1 admin admin] The token cache is being invalidate because project fa7e2b9a0ba0465681b2e222f259d8ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:22:19.658748 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-27040e45-c793-46b7-af90-1d10de8be1b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:22:19.659330 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-27040e45-c793-46b7-af90-1d10de8be1b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:22:19.660731 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1424/2846] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:22:19 2021] DELETE /identity/v3/projects/fa7e2b9a0ba0465681b2e222f259d8ff => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:22:19.664662 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c7008-991c-4ceb-a8d6-6a4b2ea3617b admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:22:19.666561 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-6f3c7008-991c-4ceb-a8d6-6a4b2ea3617b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:22:19.678486 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c7008-991c-4ceb-a8d6-6a4b2ea3617b admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:22:19.740216 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2cf4d-0ed2-4c48-a24b-4d659193aa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:22:19.740953 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2cf4d-0ed2-4c48-a24b-4d659193aa84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:22:19.741266 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2cf4d-0ed2-4c48-a24b-4d659193aa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:22:19.741552 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2cf4d-0ed2-4c48-a24b-4d659193aa84 admin admin] PATH_INFO: `/v3/users/a7abcd3a1b514cd9a80f962ca75af01d` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:22:19.742676 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2cf4d-0ed2-4c48-a24b-4d659193aa84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7abcd3a1b514cd9a80f962ca75af01d)` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:22:19.768846 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2cf4d-0ed2-4c48-a24b-4d659193aa84 admin admin] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:22:19.816233 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-c4f2cf4d-0ed2-4c48-a24b-4d659193aa84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7abcd3a1b514cd9a80f962ca75af01d'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:22:19.827793 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-c4f2cf4d-0ed2-4c48-a24b-4d659193aa84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7abcd3a1b514cd9a80f962ca75af01d'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:22:19.828423 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-c4f2cf4d-0ed2-4c48-a24b-4d659193aa84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7abcd3a1b514cd9a80f962ca75af01d'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:22:19.835376 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-c4f2cf4d-0ed2-4c48-a24b-4d659193aa84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7abcd3a1b514cd9a80f962ca75af01d'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:22:19.843485 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.notifications [None req-c4f2cf4d-0ed2-4c48-a24b-4d659193aa84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7abcd3a1b514cd9a80f962ca75af01d'} {{(pid=65984) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:22:19.849139 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1423/2847] 10.222.0.89 () {58 vars in 1223 bytes} [Wed Oct 27 15:22:19 2021] DELETE /identity/v3/users/a7abcd3a1b514cd9a80f962ca75af01d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:22:20.063273 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27040e45-c793-46b7-af90-1d10de8be1b1 admin admin] Authenticating user token {{(pid=65985) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:22:20.064662 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.fernet_utils [None req-27040e45-c793-46b7-af90-1d10de8be1b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65985) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:22:20.079148 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27040e45-c793-46b7-af90-1d10de8be1b1 admin admin] Validating token access rules against request {{(pid=65985) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:22:20.141994 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9053c-02a4-4780-b251-9d45e53eb350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99b1f8461d2e454c9cd6d6d3c9dc623c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '788e6d12550a446aa50a0962b825388d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65985) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:22:20.143033 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9053c-02a4-4780-b251-9d45e53eb350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:22:20.143315 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9053c-02a4-4780-b251-9d45e53eb350 admin admin] SCRIPT_NAME: `/identity` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:22:20.143618 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9053c-02a4-4780-b251-9d45e53eb350 admin admin] PATH_INFO: `/v3/projects/bc36826208124b66a3c3af55cb4022ac` {{(pid=65985) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:22:20.144680 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9053c-02a4-4780-b251-9d45e53eb350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc36826208124b66a3c3af55cb4022ac)` {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:22:20.170462 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e9053c-02a4-4780-b251-9d45e53eb350 admin admin] RBAC: Authorization granted {{(pid=65985) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:22:20.220120 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-64e9053c-02a4-4780-b251-9d45e53eb350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc36826208124b66a3c3af55cb4022ac', 'request_id': 'req-64e9053c-02a4-4780-b251-9d45e53eb350'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:22:20.225088 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-64e9053c-02a4-4780-b251-9d45e53eb350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc36826208124b66a3c3af55cb4022ac', 'request_id': 'req-64e9053c-02a4-4780-b251-9d45e53eb350'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:22:20.236485 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-64e9053c-02a4-4780-b251-9d45e53eb350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc36826208124b66a3c3af55cb4022ac', 'request_id': 'req-64e9053c-02a4-4780-b251-9d45e53eb350'} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:22:20.249373 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-64e9053c-02a4-4780-b251-9d45e53eb350 admin admin] The token cache is being invalidate because project bc36826208124b66a3c3af55cb4022ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=65985) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 15:22:20.249657 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-64e9053c-02a4-4780-b251-9d45e53eb350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:22:20.250365 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: DEBUG keystone.notifications [None req-64e9053c-02a4-4780-b251-9d45e53eb350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=65985) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 15:22:20.251835 dv-cinder-815673-1-iscsi devstack@keystone.service[65985]: [pid: 65985|app: 0|req: 1425/2848] 10.222.0.89 () {58 vars in 1232 bytes} [Wed Oct 27 15:22:20 2021] DELETE /identity/v3/projects/bc36826208124b66a3c3af55cb4022ac => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 15:24:32.889362 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2cf4d-0ed2-4c48-a24b-4d659193aa84 admin admin] Authenticating user token {{(pid=65984) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 15:24:32.890981 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-c4f2cf4d-0ed2-4c48-a24b-4d659193aa84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:24:32.968722 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2cf4d-0ed2-4c48-a24b-4d659193aa84 admin admin] Validating token access rules against request {{(pid=65984) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 15:24:33.036723 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72878403-19ae-446d-ad71-48328664d0b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fcbab075fd5b4a889c2002639ca9d60a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f79f19c59cfd43c48871b51d6aaf501f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=65984) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 15:24:33.037313 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72878403-19ae-446d-ad71-48328664d0b6 service placement] REQUEST_METHOD: `GET` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 15:24:33.037600 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72878403-19ae-446d-ad71-48328664d0b6 service placement] SCRIPT_NAME: `/identity` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 15:24:33.037909 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72878403-19ae-446d-ad71-48328664d0b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=65984) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 15:24:33.039623 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.fernet_utils [None req-72878403-19ae-446d-ad71-48328664d0b6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=65984) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 15:24:33.058764 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72878403-19ae-446d-ad71-48328664d0b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:441}} Oct 27 15:24:33.086252 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72878403-19ae-446d-ad71-48328664d0b6 service placement] RBAC: Authorization granted {{(pid=65984) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 15:24:33.096626 dv-cinder-815673-1-iscsi devstack@keystone.service[65984]: [pid: 65984|app: 0|req: 1424/2849] 10.222.0.89 () {60 vars in 1365 bytes} [Wed Oct 27 15:24:32 2021] GET /identity/v3/auth/tokens => generated 3738 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)